-- Logs begin at Thu 2022-07-21 11:32:08 UTC, end at Thu 2022-07-21 12:31:37 UTC. -- Jul 21 11:59:58.854617 dv-cinder-850321-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 11:59:58.862508 dv-cinder-850321-1-smb devstack@keystone.service[80400]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 11:59:58.864603 dv-cinder-850321-1-smb devstack@keystone.service[80400]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 11:59:58 2022] *** Jul 21 11:59:58.864603 dv-cinder-850321-1-smb devstack@keystone.service[80400]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 11:59:58.864603 dv-cinder-850321-1-smb devstack@keystone.service[80400]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 11:59:58.864603 dv-cinder-850321-1-smb devstack@keystone.service[80400]: nodename: dv-cinder-850321-1-smb Jul 21 11:59:58.864603 dv-cinder-850321-1-smb devstack@keystone.service[80400]: machine: x86_64 Jul 21 11:59:58.864603 dv-cinder-850321-1-smb devstack@keystone.service[80400]: clock source: unix Jul 21 11:59:58.864603 dv-cinder-850321-1-smb devstack@keystone.service[80400]: pcre jit disabled Jul 21 11:59:58.864603 dv-cinder-850321-1-smb devstack@keystone.service[80400]: detected number of CPU cores: 4 Jul 21 11:59:58.864603 dv-cinder-850321-1-smb devstack@keystone.service[80400]: current working directory: / Jul 21 11:59:58.864603 dv-cinder-850321-1-smb devstack@keystone.service[80400]: detected binary path: /usr/bin/uwsgi-core Jul 21 11:59:58.864603 dv-cinder-850321-1-smb devstack@keystone.service[80400]: your processes number limit is 47680 Jul 21 11:59:58.864603 dv-cinder-850321-1-smb devstack@keystone.service[80400]: your memory page size is 4096 bytes Jul 21 11:59:58.864603 dv-cinder-850321-1-smb devstack@keystone.service[80400]: detected max file descriptor number: 2048 Jul 21 11:59:58.864603 dv-cinder-850321-1-smb devstack@keystone.service[80400]: lock engine: pthread robust mutexes Jul 21 11:59:58.865901 dv-cinder-850321-1-smb devstack@keystone.service[80400]: thunder lock: enabled Jul 21 11:59:58.865901 dv-cinder-850321-1-smb devstack@keystone.service[80400]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 11:59:58.865901 dv-cinder-850321-1-smb devstack@keystone.service[80400]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 11:59:58.909203 dv-cinder-850321-1-smb devstack@keystone.service[80400]: Python main interpreter initialized at 0x55dec98d39c0 Jul 21 11:59:58.909203 dv-cinder-850321-1-smb devstack@keystone.service[80400]: python threads support enabled Jul 21 11:59:58.909203 dv-cinder-850321-1-smb devstack@keystone.service[80400]: your server socket listen backlog is limited to 100 connections Jul 21 11:59:58.909203 dv-cinder-850321-1-smb devstack@keystone.service[80400]: your mercy for graceful operations on workers is 90 seconds Jul 21 11:59:58.909601 dv-cinder-850321-1-smb devstack@keystone.service[80400]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 11:59:58.909676 dv-cinder-850321-1-smb devstack@keystone.service[80400]: *** Operational MODE: preforking *** Jul 21 11:59:58.909960 dv-cinder-850321-1-smb devstack@keystone.service[80400]: *** uWSGI is running in multiple interpreter mode *** Jul 21 11:59:58.909960 dv-cinder-850321-1-smb devstack@keystone.service[80400]: spawned uWSGI master process (pid: 80400) Jul 21 11:59:58.910175 dv-cinder-850321-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 21 11:59:58.910893 dv-cinder-850321-1-smb devstack@keystone.service[80400]: spawned uWSGI worker 1 (pid: 80410, cores: 1) Jul 21 11:59:58.911124 dv-cinder-850321-1-smb devstack@keystone.service[80400]: spawned uWSGI worker 2 (pid: 80411, cores: 1) Jul 21 11:59:58.911309 dv-cinder-850321-1-smb devstack@keystone.service[80400]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 12:00:04.270398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 12:00:04.270398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: from cryptography.utils import int_from_bytes Jul 21 12:00:04.270398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 12:00:04.270398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: from cryptography.utils import int_from_bytes Jul 21 12:00:04.275488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 12:00:04.275488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: from cryptography.utils import int_from_bytes Jul 21 12:00:04.275488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 12:00:04.275488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: from cryptography.utils import int_from_bytes Jul 21 12:00:04.319318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 12:00:04.319548 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 12:00:04.319655 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 12:00:04.319780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 12:00:04.319887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] command line args: [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 12:00:04.320002 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] command line args: [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 12:00:04.320078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 12:00:04.320198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 12:00:04.320288 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ================================================================================ {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 12:00:04.320376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ================================================================================ {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 12:00:04.320486 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] admin_token = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.320571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] admin_token = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.320694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] config_dir = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.320769 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] config_dir = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.320857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.320964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.320964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] config_source = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.321161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] config_source = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.321266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] debug = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.321384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] debug = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.321460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.321827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.321988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.322120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.322235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.322371 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.322495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.322633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.322778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.322923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.323023 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] list_limit = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.323166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] list_limit = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.323284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] log_config_append = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.323423 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] log_config_append = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.323537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.323672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.323773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] log_dir = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.323919 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] log_dir = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.324043 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] log_file = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.324170 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] log_file = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.324284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.324412 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.324563 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.324697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.324859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.324971 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.325093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.325093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.325236 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.325361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.325448 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.325448 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.325627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.325701 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.325805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.325918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.326000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.326112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.326182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.326264 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.326366 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.326445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.326554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.326670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.326786 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.326879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.326960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.327082 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.327165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.327275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.327363 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.327363 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] publish_errors = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.327543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.327543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] publish_errors = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.327691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.327797 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.327873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.327975 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.328062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.328136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.328253 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.328347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.328450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.328545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.328612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] standard_threads = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.328764 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] standard_threads = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.328851 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.328947 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.329055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.329128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.329233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.329317 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.329415 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] use_journal = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.329517 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] use_journal = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.329592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] use_json = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.329690 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] use_json = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.329785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] use_stderr = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.329864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] use_syslog = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.329972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] use_stderr = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.330054 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] use_syslog = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.330123 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.330353 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.330503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 12:00:04.330625 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.330750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.331234 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.331347 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.331441 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.331568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.331697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.331815 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.331893 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.332065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.332149 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.332306 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.332396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.332512 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.332595 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.332754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.332844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.333078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.333246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.333353 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.333440 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.333551 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.333630 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.333802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.333906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.334016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.334096 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.334260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.334342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.334497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.334712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.334805 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.334902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.335006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.335137 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.335256 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.335341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.335495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.335574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.335727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.335835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.335960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.336097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.336223 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.336308 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.336469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.336556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.336715 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.336802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.336963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.337044 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.337189 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.337276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.337416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.337518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.337661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.337769 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.337885 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.338003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.338113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.338232 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.338385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.338547 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.338688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.338780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.338877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.338990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.339066 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.339333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.339490 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.339591 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.339721 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.339807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.339994 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.340143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.340249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.340323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.340525 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.340606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.340677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.340746 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.340901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.341004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.341136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.341217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.341312 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.341431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.341513 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.341633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.341724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.341831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.341933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.342005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.342161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.342247 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.342375 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.342456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.342589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.342708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.342875 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.342970 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.343139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.343222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.343381 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.343462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.343606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.343752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.343903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.344014 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.344014 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.344233 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.344233 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.344464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.344616 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.344721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.344864 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.345040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.345195 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.345388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.345543 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.345670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.345779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.345909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.346021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.346099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.346182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.346290 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.346370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.346474 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.346567 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.346649 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.346817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.346915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.347024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.347101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.347202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.347299 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.347366 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.347481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.347572 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.347656 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.347761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.347839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.347941 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.348042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.348120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.348231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.348309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.348403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.348555 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.348674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.348783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.348854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.348921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.349034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.349185 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.349350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.349456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.349558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.349637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.349696 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.349850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.349990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.350120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.350196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.350279 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.350380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.350507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.350632 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.350807 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.350891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.350984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.351095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.351227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.351427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.351547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.351626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.351709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.351817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.351891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.352004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.352115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.352235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.352328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.352400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.352518 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.352604 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.352750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.352852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.352987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.353097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.353233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.353333 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.353460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.353566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.353696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.353806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.353923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.354050 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.354191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.354291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.354384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.354487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] auth.external = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.354598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.354714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.354880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.355028 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.355125 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.355210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.355374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] auth.password = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.355496 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.355588 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] auth.token = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.355690 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.355774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.355847 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] auth.external = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.356035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.356157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.356234 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.356305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.356489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.356614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.356690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.356762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] auth.password = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.356945 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.357089 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] auth.token = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.357179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.357254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.357401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] credential.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.357526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.357603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.357673 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.357856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.357980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.358058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.358141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.358324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.358462 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.358544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.358619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.358750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] credential.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.358823 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.359019 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.359143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.359245 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.359323 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.359493 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.359618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.359696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.359768 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.359952 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.360077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.360155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.360226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.360433 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.360568 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.360661 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.360736 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.360887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.361002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.361133 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.361216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.361394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.361476 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.361636 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.361718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.361880 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.361967 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.362107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.362190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.362350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.362433 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.362579 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.362681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.362855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.362939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.363086 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.363166 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.363326 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.363408 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.363550 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.363633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.363795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.363876 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.364025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.364152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.364340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.364427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.364573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.364655 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.364812 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.364983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.365063 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.365133 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.365280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.365458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.365535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.365693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.365772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.365932 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.366009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.366181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.366258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.366415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.366493 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.366691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.366824 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.366902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.367062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.367157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.367307 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.367384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.367557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.367634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.367810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.367895 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.368042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.368121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.368272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.368350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.368501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.368590 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.368752 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.368829 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.369000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.369084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.369230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.369322 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.369468 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.369546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.369697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.369774 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.369932 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.370018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.370173 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.370252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.370409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.370486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.370635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.370747 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.370889 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.370967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.371118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.371195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.371352 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.371439 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.371587 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.371663 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.371820 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.371896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.372061 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.372150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.372287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.372370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.372519 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.372595 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.372746 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.372831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.372980 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.373062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.373212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.373288 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.373453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.373538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.373681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.373758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.373913 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.373989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.374138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.374215 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.374373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.374440 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.374600 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.374693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.374851 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.374953 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.375095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.375174 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.375328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.375404 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.375558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.375643 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.375787 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.375865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.376017 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.376094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.376241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.376318 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.376474 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.376552 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.376713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.376791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.376946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.377040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.377178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.377256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.377410 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.377487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.377640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.377720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.377867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.377950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.378091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.378169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.378321 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.378400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.378553 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.378631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.378807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.378886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.379035 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.379115 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.379267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.379343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.379493 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.379570 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.379803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.379881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.380052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.380135 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.380289 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.380365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.380513 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.380601 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.380761 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.380890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.381016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.381097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.381221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.381347 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.381451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.381529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.381681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.381759 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.381915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.382012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.382159 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.382252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.382388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.382466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.382622 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.382770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.382873 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.382951 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.383103 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.383179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.383334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.383413 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.383565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.383644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.383800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.383877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.384044 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.384123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.384270 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.384346 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.384494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.384570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.384727 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.384806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.384957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.385041 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.385189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.385267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.385428 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.385506 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.385659 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.385735 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.385884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.385966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.386116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.386195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.386355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.386471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.386592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.386690 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.386848 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.386929 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.387078 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.387154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.387306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] role.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.387383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.387533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] role.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.387608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.387762 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.387840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.388005 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.388083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.388237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.388315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.388472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.388549 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.388704 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] role.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.388780 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.388944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.389028 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] role.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.389167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.389243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.389410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.389495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.389652 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.389729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.389883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.389986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.390119 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.390198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.390358 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.390431 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.390596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.390691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.390859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.390948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.391102 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.391299 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.391376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.391531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.391607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.391775 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.391855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.392017 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.392094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.392260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.392338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.392504 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.392684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.392761 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.392919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.393024 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.393163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.393251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.393409 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.393486 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.393648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.393724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.393876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.393962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.394102 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.394181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.394349 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.394426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.394598 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.394789 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.394865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.394935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.395076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.395153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.395338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.395416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.395574 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.395651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.395805 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.395881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.396040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.396120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.396285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.396362 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.396517 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.396593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.396751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.396830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.396981 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.397063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.397216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.397293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.397450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.397528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.397686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.397762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.397916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.397992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.398147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.398219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.398380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.398457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.398609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.398703 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.398871 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.398949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.399111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.399188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.399333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.399409 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.399572 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.399650 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.399805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.399881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.400036 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.400109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.connection = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.400278 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.400377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.400520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.400598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.400746 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.400824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.400987 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.401081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.401230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.401307 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.401464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.401542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.connection = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.401696 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.401783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.401928 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.402013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.402169 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.402246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.402402 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.402479 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.402641 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.402744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.402892 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.402970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.403123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.403200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.403354 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.403438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.403594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.403671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.403816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.403892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.404054 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.404138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.404285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.404361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.404450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 12:00:04.404527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.404742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.404983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.405208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.405445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.405675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 12:00:04.405841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 12:00:04.435705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.435935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.436010 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.436083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.436155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.436307 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.445567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.445752 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.477239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.477472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.477472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.477642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.628857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.629051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.677874 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.678135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.678974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.679204 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.743935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.744144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.744261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.744383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.744497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.744587 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.744735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.744859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.744963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.745047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.745121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.745342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.770033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.770244 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.770577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.770750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.770841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.770980 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.771077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.771200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.771281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.771419 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.771499 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.771635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.771846 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.772055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.782547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.782979 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.795557 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.795759 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.795759 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.795909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.795983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.796054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.796178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.796268 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.796380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.796468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.796614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.796738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.796833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.796924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 12:00:04.814142 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.814285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.814357 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 12:00:04.814438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 12:00:04.814691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.814776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.814886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 12:00:04.814965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 12:00:04.815146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.815226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.815396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.815475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.815641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.815721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.815890 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.815970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.826996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.827249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.827511 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.827790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.828028 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.828301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.828562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.828838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.836297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.837365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.839618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.839885 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.840161 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.840551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.840700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.840788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.840863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.841069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.841194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.841309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.841539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.841664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.841819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.841931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.842072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.842197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.842310 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.842387 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.842608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.842895 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.843160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.843421 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.868897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.869753 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.870495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.870793 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.871384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.871661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.876036 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.876311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.876585 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.876883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.877157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.877430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.884013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.884175 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.884731 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.885025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.888796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.889049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.889353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.889623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.889746 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.889897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.890022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.890152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.890243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.890422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.890547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.890675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.890761 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.890954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.891214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.891478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.909167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.909442 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.909983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.910254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.914112 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.914906 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.917747 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.918033 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.918496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.918830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.923050 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.923820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.926687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.927445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.930395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.930693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.930984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.931195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.931284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.931503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.931678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.931765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.931842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.932065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.932335 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.932614 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.950697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.951088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.951357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.951529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.951653 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.951928 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.952190 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.952451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.959905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.960701 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.961560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.961829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.962364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.962630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.964880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.965152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.965425 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.965695 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.965789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.965965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.966077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.966237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.966507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.966858 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.979521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.979794 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.980065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.980239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:04.980337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.980523 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.980649 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.980799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.980944 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.981032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.981124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.981329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.981611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:04.981878 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.000796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:05.001486 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:05.004069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:05.004842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:05.007486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.008172 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.009096 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.009758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.010746 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:05.011013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.011294 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.011419 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:05.011648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.011912 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.018790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.019541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.020442 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:05.021218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:05.023689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.023974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.024250 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.024418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.024534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.024725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.024977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.025276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.033705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:05.033984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.034254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.034443 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:05.034746 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.035018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.042145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:05.042415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.042693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.042912 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 12:00:05.043012 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.043182 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.043267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.043454 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.043539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.043720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.043806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.043987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.044079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.044247 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.044331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.044507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.044649 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.044780 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.044862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.045021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.045104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.045283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.045368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.045540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.045623 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.045789 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.046038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.046301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 12:00:05.083662 dv-cinder-850321-1-smb devstack@keystone.service[80411]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dec98d39c0 pid: 80411 (default app) Jul 21 12:00:05.084247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dec98d39c0 pid: 80410 (default app) Jul 21 12:00:05.087121 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3780d3-3fd9-42c6-ba6b-1f362b111966 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:05.087409 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3780d3-3fd9-42c6-ba6b-1f362b111966 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:05.087692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3780d3-3fd9-42c6-ba6b-1f362b111966 None None] PATH_INFO: `/v3` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:05.091907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Thu Jul 21 12:00:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:12.745550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74de51-7738-48c6-ac87-85ef6d07f6b1 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:12.746108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74de51-7738-48c6-ac87-85ef6d07f6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:12.746108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74de51-7738-48c6-ac87-85ef6d07f6b1 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:12.750349 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:00:12.755998 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf165-f535-403d-8f31-274320dd5f37 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:12.756444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf165-f535-403d-8f31-274320dd5f37 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:12.756531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf165-f535-403d-8f31-274320dd5f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:12.824363 dv-cinder-850321-1-smb devstack@keystone.service[80411]: INFO dbcounter [None req-b8daf165-f535-403d-8f31-274320dd5f37 None None] Registered counter for database keystone Jul 21 12:00:12.846468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG oslo_db.sqlalchemy.engines [None req-b8daf165-f535-403d-8f31-274320dd5f37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 12:00:12.853576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writer thread running {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 12:00:13.050708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG passlib.handlers.bcrypt [None req-b8daf165-f535-403d-8f31-274320dd5f37 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80411) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 12:00:13.051130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG passlib.handlers.bcrypt [None req-b8daf165-f535-403d-8f31-274320dd5f37 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80411) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 12:00:13.106017 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b8daf165-f535-403d-8f31-274320dd5f37 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:13.107672 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b8daf165-f535-403d-8f31-274320dd5f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:13.242453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 12:00:13.442788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74de51-7738-48c6-ac87-85ef6d07f6b1 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:13.513364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: INFO dbcounter [None req-5a74de51-7738-48c6-ac87-85ef6d07f6b1 None None] Registered counter for database keystone Jul 21 12:00:13.535058 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG oslo_db.sqlalchemy.engines [None req-5a74de51-7738-48c6-ac87-85ef6d07f6b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 12:00:13.543813 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writer thread running {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 12:00:13.664826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74de51-7738-48c6-ac87-85ef6d07f6b1 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:13.672384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f173d6-d987-470a-9aaa-979a1cbe91d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:13.673398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f173d6-d987-470a-9aaa-979a1cbe91d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:13.673828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f173d6-d987-470a-9aaa-979a1cbe91d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:13.674253 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f173d6-d987-470a-9aaa-979a1cbe91d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:13.684312 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f173d6-d987-470a-9aaa-979a1cbe91d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:13.735911 dv-cinder-850321-1-smb devstack@keystone.service[80410]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f2f173d6-d987-470a-9aaa-979a1cbe91d0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 12:00:13.736177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f173d6-d987-470a-9aaa-979a1cbe91d0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:13.746857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Jul 21 12:00:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:00:13.754016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daf165-f535-403d-8f31-274320dd5f37 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:13.769405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daf165-f535-403d-8f31-274320dd5f37 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:13.775365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0bf34-b700-4de2-bbed-6729b7aef59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:13.776546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0bf34-b700-4de2-bbed-6729b7aef59f admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:13.776832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0bf34-b700-4de2-bbed-6729b7aef59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:13.777116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0bf34-b700-4de2-bbed-6729b7aef59f admin admin] PATH_INFO: `/v3/projects/2ea0112c11004c7db4f26fe8670575dc` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:13.778818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0bf34-b700-4de2-bbed-6729b7aef59f admin admin] RBAC: Authorizing `identity:get_project(project_id=2ea0112c11004c7db4f26fe8670575dc)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:13.832679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e6b0bf34-b700-4de2-bbed-6729b7aef59f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 12:00:13.833027 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0bf34-b700-4de2-bbed-6729b7aef59f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:13.837913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Thu Jul 21 12:00:13 2022] GET /identity/v3/projects/2ea0112c11004c7db4f26fe8670575dc => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:15.881424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6694-e980-4b0e-a7e2-dbdbd505a3fa None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:15.881973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6694-e980-4b0e-a7e2-dbdbd505a3fa None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:15.881973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6694-e980-4b0e-a7e2-dbdbd505a3fa None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:15.886078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:15.893338 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e212-9557-49f3-8d85-37c0c6fa6019 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:15.894078 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e212-9557-49f3-8d85-37c0c6fa6019 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:15.894216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e212-9557-49f3-8d85-37c0c6fa6019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:15.914636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a6c2e212-9557-49f3-8d85-37c0c6fa6019 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:15.916214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a6c2e212-9557-49f3-8d85-37c0c6fa6019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:15.924725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 12:00:15.947546 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea6694-e980-4b0e-a7e2-dbdbd505a3fa None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:15.960972 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea6694-e980-4b0e-a7e2-dbdbd505a3fa None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:15.965398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554538c4-4ea0-450a-a09b-36154107c05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:15.966051 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554538c4-4ea0-450a-a09b-36154107c05e admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:15.966334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554538c4-4ea0-450a-a09b-36154107c05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:15.966609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554538c4-4ea0-450a-a09b-36154107c05e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:15.975345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554538c4-4ea0-450a-a09b-36154107c05e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:15.977148 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554538c4-4ea0-450a-a09b-36154107c05e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:15.987011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Jul 21 12:00:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:00:15.993401 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2e212-9557-49f3-8d85-37c0c6fa6019 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:16.002899 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2e212-9557-49f3-8d85-37c0c6fa6019 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:16.007743 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4d483-e4d2-4ea9-8e60-4113530389a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:16.008684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4d483-e4d2-4ea9-8e60-4113530389a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:16.008964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4d483-e4d2-4ea9-8e60-4113530389a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:16.009239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4d483-e4d2-4ea9-8e60-4113530389a4 admin admin] PATH_INFO: `/v3/users/8e3560d1fa07476590360b2627638a18` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:16.010820 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4d483-e4d2-4ea9-8e60-4113530389a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=8e3560d1fa07476590360b2627638a18)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:16.012703 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4d483-e4d2-4ea9-8e60-4113530389a4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:16.014443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Thu Jul 21 12:00:15 2022] GET /identity/v3/users/8e3560d1fa07476590360b2627638a18 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:18.135097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df20c86-9810-4be0-bad4-1a652e21495c None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:18.135673 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df20c86-9810-4be0-bad4-1a652e21495c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:18.135673 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df20c86-9810-4be0-bad4-1a652e21495c None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:18.136974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:18.142925 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b330115-ca0f-4d6d-930d-82bb580108f8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:18.143456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b330115-ca0f-4d6d-930d-82bb580108f8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:18.143456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b330115-ca0f-4d6d-930d-82bb580108f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:18.161868 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5b330115-ca0f-4d6d-930d-82bb580108f8 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:18.163129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5b330115-ca0f-4d6d-930d-82bb580108f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:18.196839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b28ec-2463-4a5b-94e5-a6cdd93427ed None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:18.197129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b28ec-2463-4a5b-94e5-a6cdd93427ed None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:18.197444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b28ec-2463-4a5b-94e5-a6cdd93427ed None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:18.198823 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:00:18.206054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70440-0cdc-40d6-85b2-eccd06e353f5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:18.206343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70440-0cdc-40d6-85b2-eccd06e353f5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:18.206633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70440-0cdc-40d6-85b2-eccd06e353f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:18.246815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG passlib.handlers.bcrypt [None req-14b70440-0cdc-40d6-85b2-eccd06e353f5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80410) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 12:00:18.247228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG passlib.handlers.bcrypt [None req-14b70440-0cdc-40d6-85b2-eccd06e353f5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80410) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 12:00:18.248829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:18.272604 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b330115-ca0f-4d6d-930d-82bb580108f8 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:18.292997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-14b70440-0cdc-40d6-85b2-eccd06e353f5 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:18.294678 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-14b70440-0cdc-40d6-85b2-eccd06e353f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:18.299701 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:18.386336 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b330115-ca0f-4d6d-930d-82bb580108f8 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:18.401370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:00:18.421535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275142a-f314-4953-817b-2f45d4aa2b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:18.422360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275142a-f314-4953-817b-2f45d4aa2b2e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:18.422646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275142a-f314-4953-817b-2f45d4aa2b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:18.422961 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275142a-f314-4953-817b-2f45d4aa2b2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:18.425175 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b70440-0cdc-40d6-85b2-eccd06e353f5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:18.435224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275142a-f314-4953-817b-2f45d4aa2b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-d275142a-f314-4953-817b-2f45d4aa2b2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:18.446639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:18.447917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:18.449203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:18.449203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:18.449203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:18.449203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:18.449203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:18.449203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:18.449203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:18.449203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:18.449203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:18.449203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:18.449203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:00:18.449203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:00:18.449203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:00:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:18.454245 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275142a-f314-4953-817b-2f45d4aa2b2e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:18.534002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b70440-0cdc-40d6-85b2-eccd06e353f5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:18.537404 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:18.550189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:18.577869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275142a-f314-4953-817b-2f45d4aa2b2e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:18.583472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bb0bb-6f8e-4ba6-9512-abc16fc86bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:18.584520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb0bb-6f8e-4ba6-9512-abc16fc86bbc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:18.584824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb0bb-6f8e-4ba6-9512-abc16fc86bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:18.585092 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb0bb-6f8e-4ba6-9512-abc16fc86bbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:18.617959 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1566a-d366-4e60-961b-d5e27a2ca09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:18.618568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1566a-d366-4e60-961b-d5e27a2ca09d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:18.618889 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1566a-d366-4e60-961b-d5e27a2ca09d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:18.619155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1566a-d366-4e60-961b-d5e27a2ca09d None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:18.619906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1566a-d366-4e60-961b-d5e27a2ca09d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:18.620515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1566a-d366-4e60-961b-d5e27a2ca09d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:18.621824 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1566a-d366-4e60-961b-d5e27a2ca09d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:18.635178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:00:18.641138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1566a-d366-4e60-961b-d5e27a2ca09d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:18.660399 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36bb0bb-6f8e-4ba6-9512-abc16fc86bbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:18.661967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36bb0bb-6f8e-4ba6-9512-abc16fc86bbc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:18.745459 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1566a-d366-4e60-961b-d5e27a2ca09d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:18.779862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e5188-db9a-4924-8c4b-2fb0c8ec7c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:18.780742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e5188-db9a-4924-8c4b-2fb0c8ec7c27 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:18.781022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e5188-db9a-4924-8c4b-2fb0c8ec7c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:18.781264 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e5188-db9a-4924-8c4b-2fb0c8ec7c27 None admin] PATH_INFO: `/v3/users/8e3560d1fa07476590360b2627638a18` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:18.782523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e5188-db9a-4924-8c4b-2fb0c8ec7c27 None admin] RBAC: Authorizing `identity:get_user(user_id=8e3560d1fa07476590360b2627638a18)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:18.784060 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e5188-db9a-4924-8c4b-2fb0c8ec7c27 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:18.785783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 9/16] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:18 2022] GET /identity/v3/users/8e3560d1fa07476590360b2627638a18 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:18.791490 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e5188-db9a-4924-8c4b-2fb0c8ec7c27 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:18.793082 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 8/17] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:00:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 12:00:18.803680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bb0bb-6f8e-4ba6-9512-abc16fc86bbc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:18.807173 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:18.809401 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:18.917180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e5188-db9a-4924-8c4b-2fb0c8ec7c27 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:18.917571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bb0bb-6f8e-4ba6-9512-abc16fc86bbc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:18.952124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8e3e7-535a-4f56-ae5c-3ff7c4511706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:18.953380 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8e3e7-535a-4f56-ae5c-3ff7c4511706 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:18.953704 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8e3e7-535a-4f56-ae5c-3ff7c4511706 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:18.953968 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8e3e7-535a-4f56-ae5c-3ff7c4511706 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:18.955637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8e3e7-535a-4f56-ae5c-3ff7c4511706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:18.957169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8e3e7-535a-4f56-ae5c-3ff7c4511706 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:18.959365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:00:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:00:18.965075 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8e3e7-535a-4f56-ae5c-3ff7c4511706 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:18.972299 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254e9a9-5a65-4d7d-b364-89708d5a935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:18.973167 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254e9a9-5a65-4d7d-b364-89708d5a935f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:18.973448 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254e9a9-5a65-4d7d-b364-89708d5a935f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:18.973914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254e9a9-5a65-4d7d-b364-89708d5a935f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:18.994329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254e9a9-5a65-4d7d-b364-89708d5a935f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:18.995871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254e9a9-5a65-4d7d-b364-89708d5a935f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-2254e9a9-5a65-4d7d-b364-89708d5a935f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:00:19.019429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:19.020583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:19.021610 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:00:19.021610 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:00:19.021610 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:00:19.021610 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:00:19.021610 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:00:19.026740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254e9a9-5a65-4d7d-b364-89708d5a935f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:19.050644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:19.071744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8e3e7-535a-4f56-ae5c-3ff7c4511706 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:19.086616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:19.124105 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da41195-b4fc-413e-a5bc-0de42dfe3c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:19.125150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da41195-b4fc-413e-a5bc-0de42dfe3c75 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:19.125609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da41195-b4fc-413e-a5bc-0de42dfe3c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:19.126047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da41195-b4fc-413e-a5bc-0de42dfe3c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:19.127464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da41195-b4fc-413e-a5bc-0de42dfe3c75 None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.domain.id=default, user.id=8e3560d1fa07476590360b2627638a18) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:19.127978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da41195-b4fc-413e-a5bc-0de42dfe3c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:19.130548 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da41195-b4fc-413e-a5bc-0de42dfe3c75 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:19.154701 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Jul 21 12:00:18 2022] GET /identity/v3/role_assignments?user.id=8e3560d1fa07476590360b2627638a18&scope.domain.id=default&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 233 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:00:19.155671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254e9a9-5a65-4d7d-b364-89708d5a935f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:19.215337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c0048-af3a-475a-acf6-8975b8acbe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:19.216376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0048-af3a-475a-acf6-8975b8acbe95 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:19.216804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0048-af3a-475a-acf6-8975b8acbe95 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:19.217248 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0048-af3a-475a-acf6-8975b8acbe95 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:19.218555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c0048-af3a-475a-acf6-8975b8acbe95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:19.219058 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c0048-af3a-475a-acf6-8975b8acbe95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:19.221431 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c0048-af3a-475a-acf6-8975b8acbe95 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:19.253616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:00:22.393373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb52975-381a-4fe7-8b14-54acb4a76642 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:22.394451 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb52975-381a-4fe7-8b14-54acb4a76642 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:22.394934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb52975-381a-4fe7-8b14-54acb4a76642 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:22.396586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:22.404914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d872f-8e36-457c-bc78-a828dfd35ecd None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:22.405806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d872f-8e36-457c-bc78-a828dfd35ecd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:22.406269 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d872f-8e36-457c-bc78-a828dfd35ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:22.428097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-110d872f-8e36-457c-bc78-a828dfd35ecd None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:22.429594 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-110d872f-8e36-457c-bc78-a828dfd35ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:22.534584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:22.592063 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb52975-381a-4fe7-8b14-54acb4a76642 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:22.615866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a40f4-ba11-4654-9bf1-8a0799e7a6fe None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:22.616409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a40f4-ba11-4654-9bf1-8a0799e7a6fe None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:22.616839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a40f4-ba11-4654-9bf1-8a0799e7a6fe None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:22.618376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:00:22.627039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b3ca-f045-4874-8014-fddc50b0a78c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:22.627615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b3ca-f045-4874-8014-fddc50b0a78c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:22.628045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b3ca-f045-4874-8014-fddc50b0a78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:22.653974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5d88b3ca-f045-4874-8014-fddc50b0a78c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:22.656322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5d88b3ca-f045-4874-8014-fddc50b0a78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:22.777176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:22.846233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:22.848587 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb52975-381a-4fe7-8b14-54acb4a76642 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:22.899146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88b3ca-f045-4874-8014-fddc50b0a78c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:22.942264 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499be14-dd89-4af2-b66d-1281ed648622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:22.943603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499be14-dd89-4af2-b66d-1281ed648622 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:22.944104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499be14-dd89-4af2-b66d-1281ed648622 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:22.948272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499be14-dd89-4af2-b66d-1281ed648622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:22.968331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499be14-dd89-4af2-b66d-1281ed648622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:22.972907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499be14-dd89-4af2-b66d-1281ed648622 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:22.983207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-2499be14-dd89-4af2-b66d-1281ed648622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:00:23.008792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:23.010957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:23.012467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:00:23.012467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:00:23.012467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:00:23.012467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:00:23.017243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 13/26] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:00:23.020154 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af26460-1712-479e-b8da-974563f1a88a None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:23.020528 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af26460-1712-479e-b8da-974563f1a88a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:23.020799 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af26460-1712-479e-b8da-974563f1a88a None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:23.024381 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 14/27] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:23.027367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af26460-1712-479e-b8da-974563f1a88a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:23.119533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88b3ca-f045-4874-8014-fddc50b0a78c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:23.191521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4a80c-4f1c-4516-909d-aa6cbe735d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:23.192725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4a80c-4f1c-4516-909d-aa6cbe735d7f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:23.193201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4a80c-4f1c-4516-909d-aa6cbe735d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:23.194489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4a80c-4f1c-4516-909d-aa6cbe735d7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:23.209854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4a80c-4f1c-4516-909d-aa6cbe735d7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-9cc4a80c-4f1c-4516-909d-aa6cbe735d7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:23.219461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:23.220374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:23.221539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:23.221539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:23.221539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:23.221539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:23.221539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:23.221539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:23.221539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:23.221539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:23.221539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:23.221539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:23.221539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:00:23.221539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:00:23.221539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 14/28] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:00:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:00:23.222379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4050-4a6e-4b99-965f-8a8ea58e4cc1 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:23.222379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4050-4a6e-4b99-965f-8a8ea58e4cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:23.222713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4050-4a6e-4b99-965f-8a8ea58e4cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:23.224691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af26460-1712-479e-b8da-974563f1a88a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:23.240475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7a9c4050-4a6e-4b99-965f-8a8ea58e4cc1 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:23.241694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7a9c4050-4a6e-4b99-965f-8a8ea58e4cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:23.269056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce4dac-db57-4cde-b03e-65dd0964b96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:23.269820 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce4dac-db57-4cde-b03e-65dd0964b96e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:23.270105 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce4dac-db57-4cde-b03e-65dd0964b96e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:23.270379 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce4dac-db57-4cde-b03e-65dd0964b96e None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:23.271182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce4dac-db57-4cde-b03e-65dd0964b96e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:23.271487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce4dac-db57-4cde-b03e-65dd0964b96e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:23.274975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce4dac-db57-4cde-b03e-65dd0964b96e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:23.282785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:23.308607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 15/29] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:23.310494 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe858a-2e89-4f29-8f91-1858e3a1629d None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:23.311080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe858a-2e89-4f29-8f91-1858e3a1629d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:23.311573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe858a-2e89-4f29-8f91-1858e3a1629d None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:23.313227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:23.314293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe858a-2e89-4f29-8f91-1858e3a1629d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:23.375483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 15/31] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:23.376714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c4050-4a6e-4b99-965f-8a8ea58e4cc1 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:23.421682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:23.505920 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe858a-2e89-4f29-8f91-1858e3a1629d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:23.567163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eb3c2-7863-4f9c-b813-970a78783f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:23.568315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eb3c2-7863-4f9c-b813-970a78783f13 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:23.568851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eb3c2-7863-4f9c-b813-970a78783f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:23.569397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eb3c2-7863-4f9c-b813-970a78783f13 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:23.570495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6eb3c2-7863-4f9c-b813-970a78783f13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:23.571082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6eb3c2-7863-4f9c-b813-970a78783f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:23.572886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6eb3c2-7863-4f9c-b813-970a78783f13 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:23.585042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 17/32] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:23.587150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d23865-4219-400f-8f8a-e06bedce073e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:23.587746 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d23865-4219-400f-8f8a-e06bedce073e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:23.588519 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d23865-4219-400f-8f8a-e06bedce073e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:23.602948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c4050-4a6e-4b99-965f-8a8ea58e4cc1 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:23.610874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-08d23865-4219-400f-8f8a-e06bedce073e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:23.613040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-08d23865-4219-400f-8f8a-e06bedce073e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:23.661749 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc7a62-9ebb-413d-a804-6e3034b7c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:23.662705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc7a62-9ebb-413d-a804-6e3034b7c5e9 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:23.662997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc7a62-9ebb-413d-a804-6e3034b7c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:23.663287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc7a62-9ebb-413d-a804-6e3034b7c5e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:23.664346 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc7a62-9ebb-413d-a804-6e3034b7c5e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:23.665969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc7a62-9ebb-413d-a804-6e3034b7c5e9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:23.730898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 18/33] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:23.730898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d23865-4219-400f-8f8a-e06bedce073e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:23.798370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:23.881777 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d23865-4219-400f-8f8a-e06bedce073e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:23.892300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 16/34] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jul 21 12:00:23 2022] POST /identity/v3/projects => generated 301 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:00:23.894102 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc7a62-9ebb-413d-a804-6e3034b7c5e9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:23.942206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:23.964183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c8a69-49de-4639-9030-28580949a3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:23.966180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c8a69-49de-4639-9030-28580949a3d6 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:23.966962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c8a69-49de-4639-9030-28580949a3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:23.967623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c8a69-49de-4639-9030-28580949a3d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:23.969399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c8a69-49de-4639-9030-28580949a3d6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:23.972410 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c8a69-49de-4639-9030-28580949a3d6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:24.094729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc7a62-9ebb-413d-a804-6e3034b7c5e9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:24.140080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff4dee-694f-47ff-99e1-47807f53c52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:24.141013 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff4dee-694f-47ff-99e1-47807f53c52b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:24.141307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff4dee-694f-47ff-99e1-47807f53c52b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:24.141588 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff4dee-694f-47ff-99e1-47807f53c52b None admin] PATH_INFO: `/v3/users/8e3560d1fa07476590360b2627638a18` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:24.143391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff4dee-694f-47ff-99e1-47807f53c52b None admin] RBAC: Authorizing `identity:get_user(user_id=8e3560d1fa07476590360b2627638a18)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:24.145194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff4dee-694f-47ff-99e1-47807f53c52b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:24.147067 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 17/35] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:23 2022] GET /identity/v3/users/8e3560d1fa07476590360b2627638a18 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:24.148528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edc6f8-ecb2-41ce-8560-a9d14f2c54be None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:24.148799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edc6f8-ecb2-41ce-8560-a9d14f2c54be None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:24.149077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edc6f8-ecb2-41ce-8560-a9d14f2c54be None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:24.150640 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 18/36] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:24.151253 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edc6f8-ecb2-41ce-8560-a9d14f2c54be None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:24.208127 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 19/37] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jul 21 12:00:23 2022] POST /identity/v3/roles => generated 225 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:00:24.209963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286410d-3c4e-4c46-9ae2-bb9450da1431 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:24.210351 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286410d-3c4e-4c46-9ae2-bb9450da1431 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:24.210621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286410d-3c4e-4c46-9ae2-bb9450da1431 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:24.212437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 20/38] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:24.213144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286410d-3c4e-4c46-9ae2-bb9450da1431 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:24.289395 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:24.312505 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edc6f8-ecb2-41ce-8560-a9d14f2c54be None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:24.359381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bc11a-989e-40a9-85b4-a0f843952e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:24.360018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc11a-989e-40a9-85b4-a0f843952e19 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:24.360310 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc11a-989e-40a9-85b4-a0f843952e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:24.360591 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc11a-989e-40a9-85b4-a0f843952e19 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:24.361453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bc11a-989e-40a9-85b4-a0f843952e19 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:24.363246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bc11a-989e-40a9-85b4-a0f843952e19 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:24.386464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jul 21 12:00:24 2022] POST /identity/v3/roles => generated 219 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:00:24.397542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8f074-5680-42b3-8ffc-80ada6ae912e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:24.398692 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8f074-5680-42b3-8ffc-80ada6ae912e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:24.399545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8f074-5680-42b3-8ffc-80ada6ae912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:24.429165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-67e8f074-5680-42b3-8ffc-80ada6ae912e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:24.430987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-67e8f074-5680-42b3-8ffc-80ada6ae912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:24.545008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 20/40] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:24.547418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fafb6-4815-46de-960f-a5cd88f88915 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:24.547418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fafb6-4815-46de-960f-a5cd88f88915 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:24.547418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fafb6-4815-46de-960f-a5cd88f88915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:24.574022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-187fafb6-4815-46de-960f-a5cd88f88915 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:24.575338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-187fafb6-4815-46de-960f-a5cd88f88915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:24.608933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286410d-3c4e-4c46-9ae2-bb9450da1431 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:24.622025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:24.663704 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5799c77-017b-4d27-9270-2c2ab8edea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:24.664795 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5799c77-017b-4d27-9270-2c2ab8edea9b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:24.665087 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5799c77-017b-4d27-9270-2c2ab8edea9b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:24.665398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5799c77-017b-4d27-9270-2c2ab8edea9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:24.667357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5799c77-017b-4d27-9270-2c2ab8edea9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:24.669915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5799c77-017b-4d27-9270-2c2ab8edea9b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:24.677776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 21/41] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:00:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:24.678773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5799c77-017b-4d27-9270-2c2ab8edea9b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:24.708668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 21/42] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:24.709238 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fafb6-4815-46de-960f-a5cd88f88915 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:24.735462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:24.802196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5799c77-017b-4d27-9270-2c2ab8edea9b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:24.845561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10333b7e-dcc1-4dd6-841b-4eb3c3e01d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:24.845817 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fafb6-4815-46de-960f-a5cd88f88915 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:24.846491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10333b7e-dcc1-4dd6-841b-4eb3c3e01d60 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:24.847038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10333b7e-dcc1-4dd6-841b-4eb3c3e01d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:24.847543 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10333b7e-dcc1-4dd6-841b-4eb3c3e01d60 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:24.849031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10333b7e-dcc1-4dd6-841b-4eb3c3e01d60 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:24.851668 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10333b7e-dcc1-4dd6-841b-4eb3c3e01d60 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:24.882790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 22/43] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jul 21 12:00:24 2022] POST /identity/v3/roles => generated 223 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:00:24.882790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10333b7e-dcc1-4dd6-841b-4eb3c3e01d60 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:24.889588 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d107399-feb9-41ee-b579-402aa38bdf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:24.890598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d107399-feb9-41ee-b579-402aa38bdf48 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:24.890938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d107399-feb9-41ee-b579-402aa38bdf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:24.891226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d107399-feb9-41ee-b579-402aa38bdf48 None admin] PATH_INFO: `/v3/domains/default/users/8e3560d1fa07476590360b2627638a18/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:24.894487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d107399-feb9-41ee-b579-402aa38bdf48 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8e3560d1fa07476590360b2627638a18, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:24.896729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d107399-feb9-41ee-b579-402aa38bdf48 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:24.922053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 22/44] 10.222.0.15 () {58 vars in 1361 bytes} [Thu Jul 21 12:00:24 2022] PUT /identity/v3/domains/default/users/8e3560d1fa07476590360b2627638a18/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:00:24.944375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:25.048684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10333b7e-dcc1-4dd6-841b-4eb3c3e01d60 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:25.102486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0307b-55af-433a-baa4-b5c4b02b1d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:25.103789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0307b-55af-433a-baa4-b5c4b02b1d06 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:25.104274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0307b-55af-433a-baa4-b5c4b02b1d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:25.104743 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0307b-55af-433a-baa4-b5c4b02b1d06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:25.106247 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0307b-55af-433a-baa4-b5c4b02b1d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:25.107787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0307b-55af-433a-baa4-b5c4b02b1d06 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:25.109502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 23/45] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:00:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:25.115612 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d107399-feb9-41ee-b579-402aa38bdf48 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:25.189723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:25.227065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d107399-feb9-41ee-b579-402aa38bdf48 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:25.262743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ce9cf-96fe-4ace-8894-9c663eff3b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:25.263453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ce9cf-96fe-4ace-8894-9c663eff3b01 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:25.263737 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ce9cf-96fe-4ace-8894-9c663eff3b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:25.264020 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ce9cf-96fe-4ace-8894-9c663eff3b01 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:25.264797 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ce9cf-96fe-4ace-8894-9c663eff3b01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:25.266336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ce9cf-96fe-4ace-8894-9c663eff3b01 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:25.294630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 23/46] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jul 21 12:00:25 2022] POST /identity/v3/projects => generated 312 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:00:27.004946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b249-2a08-415f-a0f6-315b5d717bdf None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:27.005503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b249-2a08-415f-a0f6-315b5d717bdf None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:27.005503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b249-2a08-415f-a0f6-315b5d717bdf None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:27.006983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 24/47] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:27.013180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8bba7-25b2-4974-8082-15768d912c8d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:27.013713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8bba7-25b2-4974-8082-15768d912c8d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:27.013792 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8bba7-25b2-4974-8082-15768d912c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:27.032259 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-aaf8bba7-25b2-4974-8082-15768d912c8d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:27.033507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-aaf8bba7-25b2-4974-8082-15768d912c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:27.117864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:27.141497 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1b249-2a08-415f-a0f6-315b5d717bdf None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:27.257641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1b249-2a08-415f-a0f6-315b5d717bdf None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:27.260335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:27.295406 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d81ecf-8c45-4883-8dae-2754f3b08694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:27.296213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d81ecf-8c45-4883-8dae-2754f3b08694 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:27.296501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d81ecf-8c45-4883-8dae-2754f3b08694 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:27.296844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d81ecf-8c45-4883-8dae-2754f3b08694 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:27.310013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d81ecf-8c45-4883-8dae-2754f3b08694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-f1d81ecf-8c45-4883-8dae-2754f3b08694 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:27.320093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:27.321145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:27.322053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:27.322053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:27.322053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:27.322053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:27.322053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:27.322053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:27.322053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:27.322053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:27.322053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:27.322053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:27.322053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:00:27.322053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:00:27.322053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 25/49] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:00:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:27.329112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8bba7-25b2-4974-8082-15768d912c8d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:27.390311 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:27.400012 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eac83-4c20-42b5-b3cd-6a9b97c8c2fb None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:27.400305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eac83-4c20-42b5-b3cd-6a9b97c8c2fb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:27.400597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eac83-4c20-42b5-b3cd-6a9b97c8c2fb None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:27.402046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 26/50] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:27.408143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cbb2-c6e7-459c-920d-c2fd57566179 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:27.408436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cbb2-c6e7-459c-920d-c2fd57566179 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:27.408717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cbb2-c6e7-459c-920d-c2fd57566179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:27.427174 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-66e9cbb2-c6e7-459c-920d-c2fd57566179 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:27.428759 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-66e9cbb2-c6e7-459c-920d-c2fd57566179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:27.447637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8bba7-25b2-4974-8082-15768d912c8d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:27.484944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d172b31-fcc3-4bb8-839f-e1eea67b67c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:27.485636 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d172b31-fcc3-4bb8-839f-e1eea67b67c2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:27.485917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d172b31-fcc3-4bb8-839f-e1eea67b67c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:27.486191 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d172b31-fcc3-4bb8-839f-e1eea67b67c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:27.486989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d172b31-fcc3-4bb8-839f-e1eea67b67c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:27.487296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d172b31-fcc3-4bb8-839f-e1eea67b67c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:27.488725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d172b31-fcc3-4bb8-839f-e1eea67b67c2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:27.500481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 25/51] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:27.504517 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 27/52] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:00:27.507017 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d172b31-fcc3-4bb8-839f-e1eea67b67c2 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:27.528842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9cbb2-c6e7-459c-920d-c2fd57566179 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:27.639259 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:27.649197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9cbb2-c6e7-459c-920d-c2fd57566179 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:27.689920 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b110a0-ef06-4cf9-92bb-7fd0130dd1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:27.690751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b110a0-ef06-4cf9-92bb-7fd0130dd1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:27.691299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b110a0-ef06-4cf9-92bb-7fd0130dd1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:27.691403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b110a0-ef06-4cf9-92bb-7fd0130dd1e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:27.692555 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b110a0-ef06-4cf9-92bb-7fd0130dd1e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:27.694008 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b110a0-ef06-4cf9-92bb-7fd0130dd1e9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:27.695676 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 28/53] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:00:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:00:27.701463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b110a0-ef06-4cf9-92bb-7fd0130dd1e9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:27.730259 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d172b31-fcc3-4bb8-839f-e1eea67b67c2 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:27.740976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:27.766645 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371f06b-1649-4553-ae10-a30f7f5f6588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:27.767750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f06b-1649-4553-ae10-a30f7f5f6588 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:27.768032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f06b-1649-4553-ae10-a30f7f5f6588 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:27.768307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f06b-1649-4553-ae10-a30f7f5f6588 None admin] PATH_INFO: `/v3/users/8e3560d1fa07476590360b2627638a18` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:27.769596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371f06b-1649-4553-ae10-a30f7f5f6588 None admin] RBAC: Authorizing `identity:get_user(user_id=8e3560d1fa07476590360b2627638a18)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:27.771080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371f06b-1649-4553-ae10-a30f7f5f6588 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:27.772736 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 26/54] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:27 2022] GET /identity/v3/users/8e3560d1fa07476590360b2627638a18 => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:00:27.778194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371f06b-1649-4553-ae10-a30f7f5f6588 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:27.810269 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b110a0-ef06-4cf9-92bb-7fd0130dd1e9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:27.847348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce20d6-a349-4d18-8c2e-dfb9dbf6d48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:27.847914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce20d6-a349-4d18-8c2e-dfb9dbf6d48c None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:27.848218 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce20d6-a349-4d18-8c2e-dfb9dbf6d48c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:27.848608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce20d6-a349-4d18-8c2e-dfb9dbf6d48c None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:27.849292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce20d6-a349-4d18-8c2e-dfb9dbf6d48c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:27.850876 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce20d6-a349-4d18-8c2e-dfb9dbf6d48c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:27.880646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 29/55] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Jul 21 12:00:27 2022] POST /identity/v3/projects => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:00:27.881969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371f06b-1649-4553-ae10-a30f7f5f6588 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:27.922523 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbbce6-9d5e-4c5d-a3a8-23b98182d71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:27.923389 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbbce6-9d5e-4c5d-a3a8-23b98182d71c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:27.923672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbbce6-9d5e-4c5d-a3a8-23b98182d71c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:27.923952 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbbce6-9d5e-4c5d-a3a8-23b98182d71c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:27.925329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbbce6-9d5e-4c5d-a3a8-23b98182d71c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:27.926896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbbce6-9d5e-4c5d-a3a8-23b98182d71c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:27.928653 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 27/56] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:00:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:27.935202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce20d6-a349-4d18-8c2e-dfb9dbf6d48c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:27.954132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:28.064027 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce20d6-a349-4d18-8c2e-dfb9dbf6d48c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:28.105743 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b67067-666f-4b69-8721-a1c830ec8366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:28.106418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67067-666f-4b69-8721-a1c830ec8366 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:28.106727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67067-666f-4b69-8721-a1c830ec8366 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:28.107009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67067-666f-4b69-8721-a1c830ec8366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:28.107871 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b67067-666f-4b69-8721-a1c830ec8366 None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.domain.id=default, user.id=8e3560d1fa07476590360b2627638a18) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:28.108182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b67067-666f-4b69-8721-a1c830ec8366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:28.109650 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b67067-666f-4b69-8721-a1c830ec8366 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:28.116370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 30/57] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Jul 21 12:00:27 2022] GET /identity/v3/role_assignments?user.id=8e3560d1fa07476590360b2627638a18&scope.domain.id=default&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 530 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:29.927458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6eab2-30e5-4349-b754-e81225d11d33 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:29.928040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6eab2-30e5-4349-b754-e81225d11d33 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:29.928040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6eab2-30e5-4349-b754-e81225d11d33 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:29.929406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 28/58] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:29.934856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1a3de-e1ba-49ee-bb9e-b6e04bfb697c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:29.935289 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1a3de-e1ba-49ee-bb9e-b6e04bfb697c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:29.935394 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1a3de-e1ba-49ee-bb9e-b6e04bfb697c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:29.953548 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b5d1a3de-e1ba-49ee-bb9e-b6e04bfb697c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:29.955198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b5d1a3de-e1ba-49ee-bb9e-b6e04bfb697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:30.027261 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 31/59] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:30.051787 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6eab2-30e5-4349-b754-e81225d11d33 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:30.105675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:30.180254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6eab2-30e5-4349-b754-e81225d11d33 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:30.231777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f102578-be78-4178-88f4-db39051ad640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:30.232596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f102578-be78-4178-88f4-db39051ad640 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:30.232901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f102578-be78-4178-88f4-db39051ad640 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:30.233349 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f102578-be78-4178-88f4-db39051ad640 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:30.234874 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f102578-be78-4178-88f4-db39051ad640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:30.236462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f102578-be78-4178-88f4-db39051ad640 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:30.238423 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 29/60] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:00:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:30.244835 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1a3de-e1ba-49ee-bb9e-b6e04bfb697c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:30.257517 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:30.368140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1a3de-e1ba-49ee-bb9e-b6e04bfb697c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:30.403324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02d295-565f-4f8e-8a77-d0f3dba6eaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:30.404031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02d295-565f-4f8e-8a77-d0f3dba6eaa2 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:30.404320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02d295-565f-4f8e-8a77-d0f3dba6eaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:30.404577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02d295-565f-4f8e-8a77-d0f3dba6eaa2 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:30.405346 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02d295-565f-4f8e-8a77-d0f3dba6eaa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:30.406829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02d295-565f-4f8e-8a77-d0f3dba6eaa2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:30.433299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 32/61] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:00:30 2022] POST /identity/v3/users => generated 275 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:00:34.482620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199c87f-466a-481f-97a0-01a861923811 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:34.483423 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199c87f-466a-481f-97a0-01a861923811 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:34.483784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199c87f-466a-481f-97a0-01a861923811 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:34.486094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 30/62] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:34.506886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0e346-d52b-490a-b9f4-433124ae8685 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:34.507657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0e346-d52b-490a-b9f4-433124ae8685 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:34.507816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0e346-d52b-490a-b9f4-433124ae8685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:34.548485 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a7a0e346-d52b-490a-b9f4-433124ae8685 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:34.550619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a7a0e346-d52b-490a-b9f4-433124ae8685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:34.705953 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:34.726914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 33/63] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:34.761518 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead8fb3-fcc9-4f3f-852c-ba452c8e289b None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:34.762506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead8fb3-fcc9-4f3f-852c-ba452c8e289b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:34.763343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead8fb3-fcc9-4f3f-852c-ba452c8e289b None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:34.766310 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 31/64] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:34.770713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666cd8f-0f71-4859-bc37-26cd26383196 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:34.770713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666cd8f-0f71-4859-bc37-26cd26383196 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:34.770713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666cd8f-0f71-4859-bc37-26cd26383196 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:34.771119 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 34/65] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:34.773136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead8fb3-fcc9-4f3f-852c-ba452c8e289b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:34.776569 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40eac42-82bf-4c67-98aa-789ed49b1f3b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:34.776892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40eac42-82bf-4c67-98aa-789ed49b1f3b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:34.777144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40eac42-82bf-4c67-98aa-789ed49b1f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:34.797419 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b40eac42-82bf-4c67-98aa-789ed49b1f3b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:34.798822 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b40eac42-82bf-4c67-98aa-789ed49b1f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:34.921057 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 35/66] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:00:34.922911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a690b-58d5-4b89-a51a-207c63e0f784 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:34.923484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a690b-58d5-4b89-a51a-207c63e0f784 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:34.924487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a690b-58d5-4b89-a51a-207c63e0f784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:34.940624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead8fb3-fcc9-4f3f-852c-ba452c8e289b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:34.946196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9d7a690b-58d5-4b89-a51a-207c63e0f784 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:34.947489 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9d7a690b-58d5-4b89-a51a-207c63e0f784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:34.966325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:34.992902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25653e8f-f95e-4908-9315-e191f0812b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:34.994770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653e8f-f95e-4908-9315-e191f0812b61 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:34.995564 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653e8f-f95e-4908-9315-e191f0812b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:34.996318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653e8f-f95e-4908-9315-e191f0812b61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:35.019440 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25653e8f-f95e-4908-9315-e191f0812b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:35.031813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 36/67] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:35.032737 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a690b-58d5-4b89-a51a-207c63e0f784 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-25653e8f-f95e-4908-9315-e191f0812b61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:35.051531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:35.052671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:35.053700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:35.053700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:35.053700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:35.053700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:35.053700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:35.053700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:35.053700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:35.053700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:35.053700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:35.053700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:35.053700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:00:35.053700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:00:35.057130 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 32/68] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:35.059181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25653e8f-f95e-4908-9315-e191f0812b61 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:35.098285 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:35.167225 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a690b-58d5-4b89-a51a-207c63e0f784 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:35.208204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25653e8f-f95e-4908-9315-e191f0812b61 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:35.224173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d354d0e-9550-4081-ac32-fcda2b311c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:35.225767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d354d0e-9550-4081-ac32-fcda2b311c2d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:35.226398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d354d0e-9550-4081-ac32-fcda2b311c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:35.227021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d354d0e-9550-4081-ac32-fcda2b311c2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:35.245861 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7c84f-afe9-4579-8b4a-972334d53fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:35.246259 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d354d0e-9550-4081-ac32-fcda2b311c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:35.246606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c84f-afe9-4579-8b4a-972334d53fac None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:35.246943 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c84f-afe9-4579-8b4a-972334d53fac None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:35.247227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c84f-afe9-4579-8b4a-972334d53fac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-2d354d0e-9550-4081-ac32-fcda2b311c2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:35.257396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:35.258484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:35.259435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:35.259435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:35.259435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:35.259435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:35.259435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:35.259435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:35.259435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:35.259435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:35.259435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:35.259435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:35.259435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:00:35.259435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:00:35.260118 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7c84f-afe9-4579-8b4a-972334d53fac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:35.261708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 37/69] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:35.262796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d354d0e-9550-4081-ac32-fcda2b311c2d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-bcc7c84f-afe9-4579-8b4a-972334d53fac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:35.267163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:35.268158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:35.269477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:35.269477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:35.269477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:35.269477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:35.269477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:35.269477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:35.269477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:35.269477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:35.269477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:35.269477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:35.269477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:00:35.269477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:00:35.269477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 33/70] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:00:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:35.269477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7c84f-afe9-4579-8b4a-972334d53fac None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:35.333242 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:35.381676 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d354d0e-9550-4081-ac32-fcda2b311c2d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:35.398251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:35.424105 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd889e-146e-44b9-82c1-6de035791595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:35.424842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd889e-146e-44b9-82c1-6de035791595 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:35.425182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd889e-146e-44b9-82c1-6de035791595 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:35.425454 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd889e-146e-44b9-82c1-6de035791595 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:35.426237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd889e-146e-44b9-82c1-6de035791595 None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:35.426551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd889e-146e-44b9-82c1-6de035791595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:35.428012 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd889e-146e-44b9-82c1-6de035791595 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:35.434025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7c84f-afe9-4579-8b4a-972334d53fac None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:35.438827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 38/71] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:00:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:35.439057 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd889e-146e-44b9-82c1-6de035791595 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:35.488778 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ac0af-d6ac-4533-87cc-f846970eb2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:35.489472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ac0af-d6ac-4533-87cc-f846970eb2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:35.489760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ac0af-d6ac-4533-87cc-f846970eb2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:35.490042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ac0af-d6ac-4533-87cc-f846970eb2b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:35.490847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ac0af-d6ac-4533-87cc-f846970eb2b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:35.491161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ac0af-d6ac-4533-87cc-f846970eb2b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:35.492574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ac0af-d6ac-4533-87cc-f846970eb2b2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:35.501513 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 34/72] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:00:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:35.503083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a1e45-bb6d-4d6d-9de0-c742c04f012d None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:35.503376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a1e45-bb6d-4d6d-9de0-c742c04f012d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:35.503657 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a1e45-bb6d-4d6d-9de0-c742c04f012d None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:35.505087 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 35/73] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:35.505728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a1e45-bb6d-4d6d-9de0-c742c04f012d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:35.592574 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd889e-146e-44b9-82c1-6de035791595 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:35.612105 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:35.620956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a1e45-bb6d-4d6d-9de0-c742c04f012d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:35.631000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31862334-54e2-42ec-b2f1-ac2414f60003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:35.631724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31862334-54e2-42ec-b2f1-ac2414f60003 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:35.632006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31862334-54e2-42ec-b2f1-ac2414f60003 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:35.632282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31862334-54e2-42ec-b2f1-ac2414f60003 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:35.633059 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31862334-54e2-42ec-b2f1-ac2414f60003 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:35.633366 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31862334-54e2-42ec-b2f1-ac2414f60003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:35.634821 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31862334-54e2-42ec-b2f1-ac2414f60003 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:35.643893 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 39/74] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:35.645299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6bcf-921c-454c-9f82-df4b62ba6423 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:35.645595 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6bcf-921c-454c-9f82-df4b62ba6423 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:35.645875 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6bcf-921c-454c-9f82-df4b62ba6423 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:35.647185 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 40/75] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:35.647897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6bcf-921c-454c-9f82-df4b62ba6423 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:35.664263 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd732bf8-3707-41c2-ae4c-b4295ac7299c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:35.665162 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd732bf8-3707-41c2-ae4c-b4295ac7299c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:35.665450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd732bf8-3707-41c2-ae4c-b4295ac7299c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:35.665723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd732bf8-3707-41c2-ae4c-b4295ac7299c None admin] PATH_INFO: `/v3/users/657bc6f8a9e94103a48d2fc9f788ad38` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:35.682332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd732bf8-3707-41c2-ae4c-b4295ac7299c None admin] RBAC: Authorizing `identity:get_user(user_id=657bc6f8a9e94103a48d2fc9f788ad38)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:35.683838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd732bf8-3707-41c2-ae4c-b4295ac7299c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:35.685574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 36/76] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:35 2022] GET /identity/v3/users/657bc6f8a9e94103a48d2fc9f788ad38 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:35.686849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493cd39-4583-4575-a2ca-271f6fd15c1b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:35.687137 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493cd39-4583-4575-a2ca-271f6fd15c1b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:35.687424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493cd39-4583-4575-a2ca-271f6fd15c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:35.694408 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:35.710783 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1493cd39-4583-4575-a2ca-271f6fd15c1b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:35.712336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1493cd39-4583-4575-a2ca-271f6fd15c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:35.764948 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6bcf-921c-454c-9f82-df4b62ba6423 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:35.787152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 37/77] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:35.787925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493cd39-4583-4575-a2ca-271f6fd15c1b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:35.818395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17779b7-faf9-4706-bf06-9ec070290163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:35.819323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17779b7-faf9-4706-bf06-9ec070290163 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:35.819615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17779b7-faf9-4706-bf06-9ec070290163 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:35.819898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17779b7-faf9-4706-bf06-9ec070290163 None admin] PATH_INFO: `/v3/users/657bc6f8a9e94103a48d2fc9f788ad38` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:35.821152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17779b7-faf9-4706-bf06-9ec070290163 None admin] RBAC: Authorizing `identity:get_user(user_id=657bc6f8a9e94103a48d2fc9f788ad38)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:35.822603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17779b7-faf9-4706-bf06-9ec070290163 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:35.824337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 41/78] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:35 2022] GET /identity/v3/users/657bc6f8a9e94103a48d2fc9f788ad38 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:35.824337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f976143-0002-45bd-8ee0-325d040fd5c7 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:35.824337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f976143-0002-45bd-8ee0-325d040fd5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:35.824337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f976143-0002-45bd-8ee0-325d040fd5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:35.847146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1f976143-0002-45bd-8ee0-325d040fd5c7 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:35.848365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1f976143-0002-45bd-8ee0-325d040fd5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:35.886304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:35.906325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493cd39-4583-4575-a2ca-271f6fd15c1b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:35.917110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 42/79] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:35.918265 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f976143-0002-45bd-8ee0-325d040fd5c7 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:35.951797 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ac5bf-495b-4034-bf43-2ce09aee3ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:35.952695 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ac5bf-495b-4034-bf43-2ce09aee3ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:35.953038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ac5bf-495b-4034-bf43-2ce09aee3ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:35.953271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ac5bf-495b-4034-bf43-2ce09aee3ca0 None admin] PATH_INFO: `/v3/users/8e3560d1fa07476590360b2627638a18` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:35.954894 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ac5bf-495b-4034-bf43-2ce09aee3ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=8e3560d1fa07476590360b2627638a18)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:35.956479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ac5bf-495b-4034-bf43-2ce09aee3ca0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:35.958160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 38/80] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:35 2022] GET /identity/v3/users/8e3560d1fa07476590360b2627638a18 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:35.959010 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ac5bf-495b-4034-bf43-2ce09aee3ca0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:35.971945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:36.043140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f976143-0002-45bd-8ee0-325d040fd5c7 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:36.082145 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ac5bf-495b-4034-bf43-2ce09aee3ca0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:36.083139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4728f-e246-4b1c-a0c2-4ca62220fa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:36.083803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4728f-e246-4b1c-a0c2-4ca62220fa8b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:36.084098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4728f-e246-4b1c-a0c2-4ca62220fa8b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:36.084365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4728f-e246-4b1c-a0c2-4ca62220fa8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:36.119724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fd63e-e724-46ad-96a2-a43b083b98c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:36.120599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fd63e-e724-46ad-96a2-a43b083b98c3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:36.120877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fd63e-e724-46ad-96a2-a43b083b98c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:36.121120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fd63e-e724-46ad-96a2-a43b083b98c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:36.138009 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fd63e-e724-46ad-96a2-a43b083b98c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-274fd63e-e724-46ad-96a2-a43b083b98c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:36.153713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:36.154677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:36.155433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:36.155433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:36.155433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:36.155433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:36.155433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:36.155433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:36.155433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:36.155433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:36.155433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:36.155433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:36.155433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:00:36.155433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:00:36.156009 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 39/81] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:00:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:36.157084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fd63e-e724-46ad-96a2-a43b083b98c3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:36.168046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4728f-e246-4b1c-a0c2-4ca62220fa8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:36.169541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4728f-e246-4b1c-a0c2-4ca62220fa8b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:36.182117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:36.204514 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:36.283231 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 43/82] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:00:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:00:36.284116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4728f-e246-4b1c-a0c2-4ca62220fa8b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:36.293869 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fd63e-e724-46ad-96a2-a43b083b98c3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:36.330585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658fa41-8619-40e5-b450-d8eac84706d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:36.331359 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658fa41-8619-40e5-b450-d8eac84706d9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:36.331654 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658fa41-8619-40e5-b450-d8eac84706d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:36.331945 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658fa41-8619-40e5-b450-d8eac84706d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:36.399503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4728f-e246-4b1c-a0c2-4ca62220fa8b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:36.421956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658fa41-8619-40e5-b450-d8eac84706d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:36.423557 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658fa41-8619-40e5-b450-d8eac84706d9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:36.441006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:36.442869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a72e7-078e-4a59-acc6-d179df821a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:36.443593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a72e7-078e-4a59-acc6-d179df821a34 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:36.443877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a72e7-078e-4a59-acc6-d179df821a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:36.444153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a72e7-078e-4a59-acc6-d179df821a34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:36.445513 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a72e7-078e-4a59-acc6-d179df821a34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:36.447093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a72e7-078e-4a59-acc6-d179df821a34 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:36.448899 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 44/83] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:00:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:36.449747 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a72e7-078e-4a59-acc6-d179df821a34 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:36.457631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:36.556199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 40/84] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:00:36.557632 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658fa41-8619-40e5-b450-d8eac84706d9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:36.582884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a72e7-078e-4a59-acc6-d179df821a34 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:36.624982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda18a2-9034-45e1-81e7-d248fcacb058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:36.625763 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda18a2-9034-45e1-81e7-d248fcacb058 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:36.625914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda18a2-9034-45e1-81e7-d248fcacb058 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:36.626196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda18a2-9034-45e1-81e7-d248fcacb058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:36.712705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda18a2-9034-45e1-81e7-d248fcacb058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:36.714260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda18a2-9034-45e1-81e7-d248fcacb058 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:36.717521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:36.728733 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658fa41-8619-40e5-b450-d8eac84706d9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:36.746200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:36.771566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7306162-7a16-49dd-8339-31f4e7e60099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:36.772272 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7306162-7a16-49dd-8339-31f4e7e60099 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:36.772565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7306162-7a16-49dd-8339-31f4e7e60099 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:36.772847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7306162-7a16-49dd-8339-31f4e7e60099 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:36.773639 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7306162-7a16-49dd-8339-31f4e7e60099 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:36.773958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7306162-7a16-49dd-8339-31f4e7e60099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:36.775443 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7306162-7a16-49dd-8339-31f4e7e60099 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:36.785481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 41/85] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:00:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:36.792663 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7306162-7a16-49dd-8339-31f4e7e60099 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:36.863953 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 45/86] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:00:36.865102 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda18a2-9034-45e1-81e7-d248fcacb058 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:36.909300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7306162-7a16-49dd-8339-31f4e7e60099 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:36.949822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c180964-44b2-48f5-8490-faacd5319185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:36.951018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c180964-44b2-48f5-8490-faacd5319185 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:36.951407 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c180964-44b2-48f5-8490-faacd5319185 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:36.951821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c180964-44b2-48f5-8490-faacd5319185 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:36.953325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c180964-44b2-48f5-8490-faacd5319185 None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:36.955355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c180964-44b2-48f5-8490-faacd5319185 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:36.965601 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 42/87] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:36 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:36.965601 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c180964-44b2-48f5-8490-faacd5319185 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:36.993052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda18a2-9034-45e1-81e7-d248fcacb058 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:36.997212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:37.024288 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:37.041708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda11442-c7b2-4185-8bb3-e53328af7e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:37.042561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda11442-c7b2-4185-8bb3-e53328af7e25 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:37.043118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda11442-c7b2-4185-8bb3-e53328af7e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:37.043516 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda11442-c7b2-4185-8bb3-e53328af7e25 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:37.044673 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda11442-c7b2-4185-8bb3-e53328af7e25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:37.046546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda11442-c7b2-4185-8bb3-e53328af7e25 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:37.070498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 46/88] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:00:36 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:00:37.072047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda11442-c7b2-4185-8bb3-e53328af7e25 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:37.106985 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c180964-44b2-48f5-8490-faacd5319185 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:37.164007 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efb9b6-90b9-4454-9aa4-81c56e55b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:37.165389 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efb9b6-90b9-4454-9aa4-81c56e55b99d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:37.165808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efb9b6-90b9-4454-9aa4-81c56e55b99d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:37.166230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efb9b6-90b9-4454-9aa4-81c56e55b99d None admin] PATH_INFO: `/v3/projects/8c47bf06c10644ea84f163d5ea0c1257` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:37.168479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efb9b6-90b9-4454-9aa4-81c56e55b99d None admin] RBAC: Authorizing `identity:get_project(project_id=8c47bf06c10644ea84f163d5ea0c1257)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:37.171081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efb9b6-90b9-4454-9aa4-81c56e55b99d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:37.174210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 43/89] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:36 2022] GET /identity/v3/projects/8c47bf06c10644ea84f163d5ea0c1257 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:37.175712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efb9b6-90b9-4454-9aa4-81c56e55b99d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:37.247413 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda11442-c7b2-4185-8bb3-e53328af7e25 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:37.303968 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e4309-46a9-4f49-afd2-8f0da1ada48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:37.305395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e4309-46a9-4f49-afd2-8f0da1ada48a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:37.305836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e4309-46a9-4f49-afd2-8f0da1ada48a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:37.306318 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e4309-46a9-4f49-afd2-8f0da1ada48a None admin] PATH_INFO: `/v3/users/657bc6f8a9e94103a48d2fc9f788ad38` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:37.308593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e4309-46a9-4f49-afd2-8f0da1ada48a None admin] RBAC: Authorizing `identity:get_user(user_id=657bc6f8a9e94103a48d2fc9f788ad38)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:37.311153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e4309-46a9-4f49-afd2-8f0da1ada48a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:37.313976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 47/90] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:37 2022] GET /identity/v3/users/657bc6f8a9e94103a48d2fc9f788ad38 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:37.315363 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e4309-46a9-4f49-afd2-8f0da1ada48a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:37.367713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efb9b6-90b9-4454-9aa4-81c56e55b99d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:37.367960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:37.388106 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:37.431110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de91825-1add-483b-84c6-ed80d5449f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:37.432399 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91825-1add-483b-84c6-ed80d5449f51 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:37.433032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91825-1add-483b-84c6-ed80d5449f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:37.433726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91825-1add-483b-84c6-ed80d5449f51 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:37.436958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de91825-1add-483b-84c6-ed80d5449f51 None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:37.439627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de91825-1add-483b-84c6-ed80d5449f51 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:37.443067 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 44/91] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:37 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:37.446691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de91825-1add-483b-84c6-ed80d5449f51 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:37.516893 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e4309-46a9-4f49-afd2-8f0da1ada48a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:37.600264 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185cb29-4250-4fb3-b0c2-0e1a3d229815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:37.601362 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185cb29-4250-4fb3-b0c2-0e1a3d229815 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:37.601848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185cb29-4250-4fb3-b0c2-0e1a3d229815 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:37.602340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185cb29-4250-4fb3-b0c2-0e1a3d229815 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:37.604539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185cb29-4250-4fb3-b0c2-0e1a3d229815 None admin] RBAC: Adding query filter params (role.id=67ad028192f24536a65fa57450a563b9, scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793, user.id=657bc6f8a9e94103a48d2fc9f788ad38) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:37.605092 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185cb29-4250-4fb3-b0c2-0e1a3d229815 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:37.608635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185cb29-4250-4fb3-b0c2-0e1a3d229815 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:37.620808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 48/92] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:00:37 2022] GET /identity/v3/role_assignments?user.id=657bc6f8a9e94103a48d2fc9f788ad38&scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793&role.id=67ad028192f24536a65fa57450a563b9 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:37.623169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185cb29-4250-4fb3-b0c2-0e1a3d229815 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:37.686238 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de91825-1add-483b-84c6-ed80d5449f51 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:37.851337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185cb29-4250-4fb3-b0c2-0e1a3d229815 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:37.859301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:37.863983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d13b79-64e8-4f14-9514-4153d9c5428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:37.865146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13b79-64e8-4f14-9514-4153d9c5428c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:37.865628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13b79-64e8-4f14-9514-4153d9c5428c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:37.866108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13b79-64e8-4f14-9514-4153d9c5428c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:37.867758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d13b79-64e8-4f14-9514-4153d9c5428c None admin] RBAC: Adding query filter params (role.id=67ad028192f24536a65fa57450a563b9, scope.project.id=8c47bf06c10644ea84f163d5ea0c1257, user.id=657bc6f8a9e94103a48d2fc9f788ad38) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:37.868300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d13b79-64e8-4f14-9514-4153d9c5428c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:37.870934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d13b79-64e8-4f14-9514-4153d9c5428c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:37.900409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 45/93] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:00:37 2022] GET /identity/v3/role_assignments?user.id=657bc6f8a9e94103a48d2fc9f788ad38&scope.project.id=8c47bf06c10644ea84f163d5ea0c1257&role.id=67ad028192f24536a65fa57450a563b9 => generated 259 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:37.904795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d13b79-64e8-4f14-9514-4153d9c5428c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:37.976998 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc04d2-33d7-43da-b863-0da1caeeddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:37.978514 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc04d2-33d7-43da-b863-0da1caeeddda None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:37.979334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc04d2-33d7-43da-b863-0da1caeeddda None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:37.980056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc04d2-33d7-43da-b863-0da1caeeddda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:38.011755 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:38.117969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d13b79-64e8-4f14-9514-4153d9c5428c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:38.193501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41443d10-7c2a-4c14-b29c-dba59f43af94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:38.194649 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41443d10-7c2a-4c14-b29c-dba59f43af94 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:38.195183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41443d10-7c2a-4c14-b29c-dba59f43af94 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:38.195665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41443d10-7c2a-4c14-b29c-dba59f43af94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:38.197262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41443d10-7c2a-4c14-b29c-dba59f43af94 None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793, user.id=8e3560d1fa07476590360b2627638a18) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:38.197997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41443d10-7c2a-4c14-b29c-dba59f43af94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:38.205477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41443d10-7c2a-4c14-b29c-dba59f43af94 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:38.226729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 46/94] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:00:37 2022] GET /identity/v3/role_assignments?user.id=8e3560d1fa07476590360b2627638a18&scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 259 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:38.287460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc04d2-33d7-43da-b863-0da1caeeddda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:38.290290 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc04d2-33d7-43da-b863-0da1caeeddda None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:38.534717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:38.556451 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 49/95] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:00:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 935 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:00:38.564089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41443d10-7c2a-4c14-b29c-dba59f43af94 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:38.769492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41443d10-7c2a-4c14-b29c-dba59f43af94 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:38.782632 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:38.833977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3374e-464d-477b-a63d-775d47233274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:38.835408 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3374e-464d-477b-a63d-775d47233274 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:38.835909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3374e-464d-477b-a63d-775d47233274 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:38.836480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3374e-464d-477b-a63d-775d47233274 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:38.838705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3374e-464d-477b-a63d-775d47233274 None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:38.841380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3374e-464d-477b-a63d-775d47233274 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:38.844743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 47/96] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:38 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:38.854320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc04d2-33d7-43da-b863-0da1caeeddda None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:39.042606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc04d2-33d7-43da-b863-0da1caeeddda None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:39.124448 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541e90b-06cf-4176-a629-285473bef2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:39.125476 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e90b-06cf-4176-a629-285473bef2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:39.125957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e90b-06cf-4176-a629-285473bef2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:39.126429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e90b-06cf-4176-a629-285473bef2f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:39.128011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541e90b-06cf-4176-a629-285473bef2f5 None admin] RBAC: Adding query filter params (role.id=a6779b95437c46648185d3ce128f658b, scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793, user.id=657bc6f8a9e94103a48d2fc9f788ad38) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:39.128568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541e90b-06cf-4176-a629-285473bef2f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:39.131328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541e90b-06cf-4176-a629-285473bef2f5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:39.145490 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 50/97] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:00:38 2022] GET /identity/v3/role_assignments?user.id=657bc6f8a9e94103a48d2fc9f788ad38&scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793&role.id=a6779b95437c46648185d3ce128f658b => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:00:40.832987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899be2d6-b9fd-4be6-9b18-4e63f06a742b None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:40.834569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899be2d6-b9fd-4be6-9b18-4e63f06a742b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:40.835361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899be2d6-b9fd-4be6-9b18-4e63f06a742b None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:40.838721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 48/98] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:40.845585 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873cb08-ff0c-4f2a-a3c5-f1d351bc425c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:40.847179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873cb08-ff0c-4f2a-a3c5-f1d351bc425c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:40.847951 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873cb08-ff0c-4f2a-a3c5-f1d351bc425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:40.888588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9873cb08-ff0c-4f2a-a3c5-f1d351bc425c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:40.891077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9873cb08-ff0c-4f2a-a3c5-f1d351bc425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:41.011731 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:41.063025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 51/99] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:00:41.099536 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899be2d6-b9fd-4be6-9b18-4e63f06a742b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:41.337124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899be2d6-b9fd-4be6-9b18-4e63f06a742b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:41.420252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50565377-c4fc-46b6-a4c9-6930df872173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:41.422163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50565377-c4fc-46b6-a4c9-6930df872173 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:41.422981 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50565377-c4fc-46b6-a4c9-6930df872173 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:41.423761 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50565377-c4fc-46b6-a4c9-6930df872173 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:41.427556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50565377-c4fc-46b6-a4c9-6930df872173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:41.429094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50565377-c4fc-46b6-a4c9-6930df872173 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:41.430889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 49/100] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:00:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:00:41.439716 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873cb08-ff0c-4f2a-a3c5-f1d351bc425c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:41.620586 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ddb6-0a0d-4a7b-a916-b4b179cfc10b None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:41.623216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ddb6-0a0d-4a7b-a916-b4b179cfc10b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:41.624314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ddb6-0a0d-4a7b-a916-b4b179cfc10b None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:41.627329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 50/101] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:00:41.648884 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424c65e-73de-4b47-9316-d6452952d244 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:41.649806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424c65e-73de-4b47-9316-d6452952d244 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:41.650525 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424c65e-73de-4b47-9316-d6452952d244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:41.698044 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d424c65e-73de-4b47-9316-d6452952d244 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:41.706030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d424c65e-73de-4b47-9316-d6452952d244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:41.746854 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873cb08-ff0c-4f2a-a3c5-f1d351bc425c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:41.808880 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:41.862360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e941c9-c346-4b75-b72b-f75c87f9b7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:41.863748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e941c9-c346-4b75-b72b-f75c87f9b7fb None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:41.864331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e941c9-c346-4b75-b72b-f75c87f9b7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:41.864898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e941c9-c346-4b75-b72b-f75c87f9b7fb None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:41.866312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e941c9-c346-4b75-b72b-f75c87f9b7fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:41.869083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 51/102] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:00:41.869554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e941c9-c346-4b75-b72b-f75c87f9b7fb None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:41.944253 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424c65e-73de-4b47-9316-d6452952d244 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:41.953055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 52/103] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jul 21 12:00:41 2022] POST /identity/v3/projects => generated 302 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:00:42.114388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424c65e-73de-4b47-9316-d6452952d244 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:42.169370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612fda9-33a2-41cd-9754-4b01a82ad514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:42.170199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612fda9-33a2-41cd-9754-4b01a82ad514 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:42.170488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612fda9-33a2-41cd-9754-4b01a82ad514 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:42.170805 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612fda9-33a2-41cd-9754-4b01a82ad514 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:42.191864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612fda9-33a2-41cd-9754-4b01a82ad514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c612fda9-33a2-41cd-9754-4b01a82ad514 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:42.199779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:42.201240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:42.203627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:42.203627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:42.203627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:42.203627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:42.203627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:42.203627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:42.203627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:42.203627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:42.203627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:42.203627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:42.203627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:00:42.203627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:00:42.203627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 52/104] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:00:42.208838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e941c9-c346-4b75-b72b-f75c87f9b7fb None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:42.293325 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:42.424060 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e941c9-c346-4b75-b72b-f75c87f9b7fb None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:42.512743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e29c95-2eba-476d-881f-d699c945862c None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:42.513374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e29c95-2eba-476d-881f-d699c945862c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:42.513883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e29c95-2eba-476d-881f-d699c945862c None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:42.515783 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 53/105] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:42.521360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff25096-d712-4c83-8056-a3316f32b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:42.521360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff25096-d712-4c83-8056-a3316f32b61a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:42.521360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff25096-d712-4c83-8056-a3316f32b61a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:42.521360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff25096-d712-4c83-8056-a3316f32b61a None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:42.521751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff25096-d712-4c83-8056-a3316f32b61a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:42.521751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff25096-d712-4c83-8056-a3316f32b61a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:42.523381 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff25096-d712-4c83-8056-a3316f32b61a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:42.524009 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667bf72-deef-4413-bedb-65db387f2895 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:42.524516 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667bf72-deef-4413-bedb-65db387f2895 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:42.525006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667bf72-deef-4413-bedb-65db387f2895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:42.546826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 53/106] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:00:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:42.550778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff25096-d712-4c83-8056-a3316f32b61a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:42.582178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a667bf72-deef-4413-bedb-65db387f2895 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:42.585476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a667bf72-deef-4413-bedb-65db387f2895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:42.660032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:42.716374 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:42.721319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff25096-d712-4c83-8056-a3316f32b61a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:42.766455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 54/107] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:42.769268 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a3187-1791-4970-a97e-5317e13988ec None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:42.770747 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09841f-40ed-4533-af6f-69001697cbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:42.771267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09841f-40ed-4533-af6f-69001697cbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:42.771555 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09841f-40ed-4533-af6f-69001697cbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:42.771800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09841f-40ed-4533-af6f-69001697cbf5 None admin] PATH_INFO: `/v3/users/db5bb33e92fc4329889a74bfcad472f8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:42.774834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a3187-1791-4970-a97e-5317e13988ec None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:42.775189 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a3187-1791-4970-a97e-5317e13988ec None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:42.778089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 55/108] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:42.779169 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb38e28-6c5b-4e2f-aaa7-1659bb2d6dbc None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:42.779557 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb38e28-6c5b-4e2f-aaa7-1659bb2d6dbc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:42.780068 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb38e28-6c5b-4e2f-aaa7-1659bb2d6dbc None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:42.791542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 56/109] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:42 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:42.792890 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57172e-343a-4197-a809-c7db756b6367 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:42.793252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57172e-343a-4197-a809-c7db756b6367 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:42.793602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57172e-343a-4197-a809-c7db756b6367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:42.803881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09841f-40ed-4533-af6f-69001697cbf5 None admin] RBAC: Authorizing `identity:get_user(user_id=db5bb33e92fc4329889a74bfcad472f8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:42.805507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09841f-40ed-4533-af6f-69001697cbf5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:42.807478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 54/110] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:42 2022] GET /identity/v3/users/db5bb33e92fc4329889a74bfcad472f8 => generated 289 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:42.815355 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c4dc1-6595-4355-85e0-a4cb161d4864 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:42.815867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c4dc1-6595-4355-85e0-a4cb161d4864 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:42.816158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c4dc1-6595-4355-85e0-a4cb161d4864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:42.825511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-cf57172e-343a-4197-a809-c7db756b6367 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:42.826887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-cf57172e-343a-4197-a809-c7db756b6367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:42.842065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fa4c4dc1-6595-4355-85e0-a4cb161d4864 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:42.843387 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fa4c4dc1-6595-4355-85e0-a4cb161d4864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:42.917049 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 57/111] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:42.918681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57172e-343a-4197-a809-c7db756b6367 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:42.949895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 55/112] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:42.955892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c4dc1-6595-4355-85e0-a4cb161d4864 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:43.056666 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:43.068773 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57172e-343a-4197-a809-c7db756b6367 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:43.117241 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:43.119475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99222a9-02eb-4a1c-8162-5e049c5ee496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:43.120184 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99222a9-02eb-4a1c-8162-5e049c5ee496 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:43.120476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99222a9-02eb-4a1c-8162-5e049c5ee496 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:43.120832 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99222a9-02eb-4a1c-8162-5e049c5ee496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:43.140930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c4dc1-6595-4355-85e0-a4cb161d4864 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:43.202571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc844e4-3c38-4a2f-b675-8a521f5dc31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:43.204246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc844e4-3c38-4a2f-b675-8a521f5dc31e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:43.204754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc844e4-3c38-4a2f-b675-8a521f5dc31e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:43.205286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc844e4-3c38-4a2f-b675-8a521f5dc31e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:43.218534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc844e4-3c38-4a2f-b675-8a521f5dc31e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-fcc844e4-3c38-4a2f-b675-8a521f5dc31e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:43.226571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:43.227509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:43.228267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:43.228267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:43.228267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:43.228267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:43.228267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:43.228267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:43.228267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:43.228267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:43.228267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:43.228267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:43.228267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:00:43.228267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:00:43.228832 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99222a9-02eb-4a1c-8162-5e049c5ee496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:43.228900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 56/113] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:00:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:43.228900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc844e4-3c38-4a2f-b675-8a521f5dc31e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:43.230388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99222a9-02eb-4a1c-8162-5e049c5ee496 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:43.334838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:43.345910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc844e4-3c38-4a2f-b675-8a521f5dc31e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:43.351507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 58/114] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:00:43.351507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99222a9-02eb-4a1c-8162-5e049c5ee496 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:43.391461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41598d12-ed3f-4c0e-a1a5-a0b4b9d8f2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:43.392353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41598d12-ed3f-4c0e-a1a5-a0b4b9d8f2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:43.392613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41598d12-ed3f-4c0e-a1a5-a0b4b9d8f2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:43.392895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41598d12-ed3f-4c0e-a1a5-a0b4b9d8f2b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:43.406073 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41598d12-ed3f-4c0e-a1a5-a0b4b9d8f2b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-41598d12-ed3f-4c0e-a1a5-a0b4b9d8f2b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:43.414503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:43.415467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:43.416224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:43.416224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:43.416224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:43.416224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:43.416224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:43.416224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:43.416224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:43.416224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:43.416224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:43.416224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:43.416224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:00:43.416224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:00:43.416224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 57/115] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:00:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:43.417452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de218e-1966-4844-9f65-c08c8b11f133 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:43.417452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de218e-1966-4844-9f65-c08c8b11f133 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:43.417742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de218e-1966-4844-9f65-c08c8b11f133 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:43.422743 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 58/116] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:43.422743 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de218e-1966-4844-9f65-c08c8b11f133 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:43.433393 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:43.487160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99222a9-02eb-4a1c-8162-5e049c5ee496 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:43.532799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808b31f-65c5-484d-95d5-e822b4067335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:43.534120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b31f-65c5-484d-95d5-e822b4067335 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:43.534555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b31f-65c5-484d-95d5-e822b4067335 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:43.535064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b31f-65c5-484d-95d5-e822b4067335 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:43.544715 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de218e-1966-4844-9f65-c08c8b11f133 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:43.550855 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808b31f-65c5-484d-95d5-e822b4067335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-2808b31f-65c5-484d-95d5-e822b4067335 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:43.559938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:43.561449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:43.562944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:43.562944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:43.562944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:43.562944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:43.562944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:43.562944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:43.562944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:43.562944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:43.562944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:43.562944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:43.562944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:00:43.562944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:00:43.562944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 59/117] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:43.562944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808b31f-65c5-484d-95d5-e822b4067335 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:43.609796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec514804-fd7e-4a79-82e7-036911c1abc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:43.611208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514804-fd7e-4a79-82e7-036911c1abc5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:43.611663 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514804-fd7e-4a79-82e7-036911c1abc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:43.612758 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514804-fd7e-4a79-82e7-036911c1abc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:43.614679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec514804-fd7e-4a79-82e7-036911c1abc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:43.615235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec514804-fd7e-4a79-82e7-036911c1abc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:43.618839 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec514804-fd7e-4a79-82e7-036911c1abc5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:43.639703 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 59/118] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:43.641506 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec514804-fd7e-4a79-82e7-036911c1abc5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:43.667857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:43.747669 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808b31f-65c5-484d-95d5-e822b4067335 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:43.755549 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:43.799535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34149d95-2a98-43a9-bc67-ebe922ccc769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:43.801068 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34149d95-2a98-43a9-bc67-ebe922ccc769 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:43.801463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34149d95-2a98-43a9-bc67-ebe922ccc769 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:43.801928 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34149d95-2a98-43a9-bc67-ebe922ccc769 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:43.803999 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34149d95-2a98-43a9-bc67-ebe922ccc769 None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:43.806420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34149d95-2a98-43a9-bc67-ebe922ccc769 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:43.817135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 60/119] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:43 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:43.817135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b247f6-2ba6-4501-9370-5c29af0fa3be None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:43.817135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b247f6-2ba6-4501-9370-5c29af0fa3be None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:43.817654 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec514804-fd7e-4a79-82e7-036911c1abc5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:43.817825 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b247f6-2ba6-4501-9370-5c29af0fa3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:43.841622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a5b247f6-2ba6-4501-9370-5c29af0fa3be None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:43.843522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a5b247f6-2ba6-4501-9370-5c29af0fa3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:43.880324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52140277-04c9-4cc5-bf21-854ef2f4c073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:43.881021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52140277-04c9-4cc5-bf21-854ef2f4c073 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:43.881478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52140277-04c9-4cc5-bf21-854ef2f4c073 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:43.881927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52140277-04c9-4cc5-bf21-854ef2f4c073 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:43.882889 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52140277-04c9-4cc5-bf21-854ef2f4c073 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:43.883402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52140277-04c9-4cc5-bf21-854ef2f4c073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:43.885616 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52140277-04c9-4cc5-bf21-854ef2f4c073 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:43.901165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 60/120] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:00:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:43.902761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52140277-04c9-4cc5-bf21-854ef2f4c073 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:43.959758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 61/121] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:43.961074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b247f6-2ba6-4501-9370-5c29af0fa3be None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:44.030257 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:44.074092 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52140277-04c9-4cc5-bf21-854ef2f4c073 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:44.098555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b247f6-2ba6-4501-9370-5c29af0fa3be None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:44.114458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:44.122550 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317bb19-6081-4b41-ab8d-de7066a98cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:44.123439 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317bb19-6081-4b41-ab8d-de7066a98cbd None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:44.123848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317bb19-6081-4b41-ab8d-de7066a98cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:44.124837 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317bb19-6081-4b41-ab8d-de7066a98cbd None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:44.125531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317bb19-6081-4b41-ab8d-de7066a98cbd None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:44.125969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317bb19-6081-4b41-ab8d-de7066a98cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:44.127897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317bb19-6081-4b41-ab8d-de7066a98cbd None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:44.140370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 61/122] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:00:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:44.141409 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317bb19-6081-4b41-ab8d-de7066a98cbd None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:44.146948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0fb66-365f-4546-a11d-44106c2f1eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:44.147869 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0fb66-365f-4546-a11d-44106c2f1eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:44.148156 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0fb66-365f-4546-a11d-44106c2f1eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:44.148434 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0fb66-365f-4546-a11d-44106c2f1eb9 None admin] PATH_INFO: `/v3/users/8e3560d1fa07476590360b2627638a18` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:44.149770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0fb66-365f-4546-a11d-44106c2f1eb9 None admin] RBAC: Authorizing `identity:get_user(user_id=8e3560d1fa07476590360b2627638a18)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:44.151317 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0fb66-365f-4546-a11d-44106c2f1eb9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:44.153140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 62/123] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:43 2022] GET /identity/v3/users/8e3560d1fa07476590360b2627638a18 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:44.154040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0fb66-365f-4546-a11d-44106c2f1eb9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:44.321257 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317bb19-6081-4b41-ab8d-de7066a98cbd None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:44.336072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0fb66-365f-4546-a11d-44106c2f1eb9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:44.369905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3508b40-0c4e-4cab-96a7-8cc84dbe3da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:44.370983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508b40-0c4e-4cab-96a7-8cc84dbe3da8 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:44.371458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508b40-0c4e-4cab-96a7-8cc84dbe3da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:44.371809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:44.371967 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508b40-0c4e-4cab-96a7-8cc84dbe3da8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:44.373113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3508b40-0c4e-4cab-96a7-8cc84dbe3da8 None admin] RBAC: Adding query filter params (role.id=cc0b77c0514d4c6294c8d884a4fea9db, scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793, user.id=db5bb33e92fc4329889a74bfcad472f8) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:44.373559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3508b40-0c4e-4cab-96a7-8cc84dbe3da8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:44.375283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3508b40-0c4e-4cab-96a7-8cc84dbe3da8 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:44.384506 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 62/124] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:00:44 2022] GET /identity/v3/role_assignments?user.id=db5bb33e92fc4329889a74bfcad472f8&scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793&role.id=cc0b77c0514d4c6294c8d884a4fea9db => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:44.386210 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3508b40-0c4e-4cab-96a7-8cc84dbe3da8 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:44.418719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f054e6-9247-47bb-94a2-f61bff48f6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:44.421118 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f054e6-9247-47bb-94a2-f61bff48f6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:44.421968 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f054e6-9247-47bb-94a2-f61bff48f6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:44.422721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f054e6-9247-47bb-94a2-f61bff48f6e1 None admin] PATH_INFO: `/v3/users/657bc6f8a9e94103a48d2fc9f788ad38` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:44.425863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f054e6-9247-47bb-94a2-f61bff48f6e1 None admin] RBAC: Authorizing `identity:get_user(user_id=657bc6f8a9e94103a48d2fc9f788ad38)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:44.429292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f054e6-9247-47bb-94a2-f61bff48f6e1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:44.433227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 63/125] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:44 2022] GET /identity/v3/users/657bc6f8a9e94103a48d2fc9f788ad38 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:44.435237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f054e6-9247-47bb-94a2-f61bff48f6e1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:44.519296 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:44.609897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3508b40-0c4e-4cab-96a7-8cc84dbe3da8 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:44.679858 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f054e6-9247-47bb-94a2-f61bff48f6e1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:44.684334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437e3d2-514d-43d3-a0bf-2430d838e304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:44.687504 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437e3d2-514d-43d3-a0bf-2430d838e304 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:44.688155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437e3d2-514d-43d3-a0bf-2430d838e304 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:44.688757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437e3d2-514d-43d3-a0bf-2430d838e304 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:44.712278 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437e3d2-514d-43d3-a0bf-2430d838e304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-2437e3d2-514d-43d3-a0bf-2430d838e304 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:44.731852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:44.733817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:44.735599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:44.735599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:44.735599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:44.735599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:44.735599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:44.735599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:44.735599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:44.735599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:44.735599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:44.735599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:44.735599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:00:44.735599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:00:44.738244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 63/126] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:44.741184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437e3d2-514d-43d3-a0bf-2430d838e304 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:44.753396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017a979-63d9-4fa5-bf40-2daea029c68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:44.755467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017a979-63d9-4fa5-bf40-2daea029c68c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:44.756269 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017a979-63d9-4fa5-bf40-2daea029c68c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:44.757006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017a979-63d9-4fa5-bf40-2daea029c68c None admin] PATH_INFO: `/v3/users/657bc6f8a9e94103a48d2fc9f788ad38` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:44.759699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017a979-63d9-4fa5-bf40-2daea029c68c None admin] RBAC: Authorizing `identity:get_user(user_id=657bc6f8a9e94103a48d2fc9f788ad38)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:44.762957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017a979-63d9-4fa5-bf40-2daea029c68c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:44.766608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 64/127] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:44 2022] GET /identity/v3/users/657bc6f8a9e94103a48d2fc9f788ad38 => generated 275 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:44.768803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017a979-63d9-4fa5-bf40-2daea029c68c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:44.883066 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:44.941180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437e3d2-514d-43d3-a0bf-2430d838e304 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:44.967084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017a979-63d9-4fa5-bf40-2daea029c68c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:44.973403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:45.005239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3d9ea-c46b-4e7f-83a5-661a310b3299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:45.007002 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3d9ea-c46b-4e7f-83a5-661a310b3299 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:45.007651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3d9ea-c46b-4e7f-83a5-661a310b3299 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:45.008288 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3d9ea-c46b-4e7f-83a5-661a310b3299 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:45.010614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3d9ea-c46b-4e7f-83a5-661a310b3299 None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:45.013665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3d9ea-c46b-4e7f-83a5-661a310b3299 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:45.017158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 64/128] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:44 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:45.019514 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3d9ea-c46b-4e7f-83a5-661a310b3299 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:45.034923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e18d74-378a-4f69-9fe5-ac8721c1f335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:45.035838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e18d74-378a-4f69-9fe5-ac8721c1f335 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:45.036128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e18d74-378a-4f69-9fe5-ac8721c1f335 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:45.036404 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e18d74-378a-4f69-9fe5-ac8721c1f335 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:45.037700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e18d74-378a-4f69-9fe5-ac8721c1f335 None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:45.039218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e18d74-378a-4f69-9fe5-ac8721c1f335 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:45.041002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 65/129] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:44 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:45.041824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e18d74-378a-4f69-9fe5-ac8721c1f335 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:45.161103 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3d9ea-c46b-4e7f-83a5-661a310b3299 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:45.164630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e18d74-378a-4f69-9fe5-ac8721c1f335 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:45.194360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:45.204649 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062ffd9-ae77-4f5e-abdc-d2c6512b3867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:45.205351 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062ffd9-ae77-4f5e-abdc-d2c6512b3867 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:45.205672 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062ffd9-ae77-4f5e-abdc-d2c6512b3867 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:45.205982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062ffd9-ae77-4f5e-abdc-d2c6512b3867 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:45.206922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062ffd9-ae77-4f5e-abdc-d2c6512b3867 None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:45.207128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062ffd9-ae77-4f5e-abdc-d2c6512b3867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:45.208556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062ffd9-ae77-4f5e-abdc-d2c6512b3867 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:45.213165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befddc4-397b-42e5-9293-0a11ff80867f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:45.214338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befddc4-397b-42e5-9293-0a11ff80867f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:45.214837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befddc4-397b-42e5-9293-0a11ff80867f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:45.215309 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befddc4-397b-42e5-9293-0a11ff80867f None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:45.217000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befddc4-397b-42e5-9293-0a11ff80867f None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:45.218793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befddc4-397b-42e5-9293-0a11ff80867f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:45.219761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 65/130] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:00:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:45.221254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 66/131] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:45 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:45.222859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41846e-d86e-4831-a104-4f8cea56df8b None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:45.223284 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41846e-d86e-4831-a104-4f8cea56df8b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:45.223682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41846e-d86e-4831-a104-4f8cea56df8b None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:45.225738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 67/132] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:45.226525 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41846e-d86e-4831-a104-4f8cea56df8b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:45.229862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062ffd9-ae77-4f5e-abdc-d2c6512b3867 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:45.326752 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:45.390054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41846e-d86e-4831-a104-4f8cea56df8b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:45.405123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062ffd9-ae77-4f5e-abdc-d2c6512b3867 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:45.451935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d225a7-03c3-46f8-9305-da0c214a85b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:45.454179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d225a7-03c3-46f8-9305-da0c214a85b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:45.454690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d225a7-03c3-46f8-9305-da0c214a85b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:45.455155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d225a7-03c3-46f8-9305-da0c214a85b4 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793/users/657bc6f8a9e94103a48d2fc9f788ad38/roles/a6779b95437c46648185d3ce128f658b` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:45.458357 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d225a7-03c3-46f8-9305-da0c214a85b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b45dfbbda8f46df9f9ad99a6691e793, user_id=657bc6f8a9e94103a48d2fc9f788ad38, role_id=a6779b95437c46648185d3ce128f658b)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:45.460645 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d225a7-03c3-46f8-9305-da0c214a85b4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:45.463510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c8b18-a393-4905-a00c-4ed0139400da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:45.464861 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c8b18-a393-4905-a00c-4ed0139400da None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:45.465310 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c8b18-a393-4905-a00c-4ed0139400da None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:45.465769 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c8b18-a393-4905-a00c-4ed0139400da None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793/users/8e3560d1fa07476590360b2627638a18/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:45.468612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c8b18-a393-4905-a00c-4ed0139400da None admin] RBAC: Authorizing `identity:create_grant(project_id=1b45dfbbda8f46df9f9ad99a6691e793, user_id=8e3560d1fa07476590360b2627638a18, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:45.470434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c8b18-a393-4905-a00c-4ed0139400da None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:45.484020 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 68/133] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:00:45 2022] PUT /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793/users/657bc6f8a9e94103a48d2fc9f788ad38/roles/a6779b95437c46648185d3ce128f658b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:00:45.494416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 66/134] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:00:45 2022] PUT /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793/users/8e3560d1fa07476590360b2627638a18/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:00:45.495897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c8b18-a393-4905-a00c-4ed0139400da None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:45.496432 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d225a7-03c3-46f8-9305-da0c214a85b4 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:45.700917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:45.705882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c8b18-a393-4905-a00c-4ed0139400da None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:45.724748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:45.773118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50ae42-e7f8-4b68-8f78-16b1652289c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:45.774555 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50ae42-e7f8-4b68-8f78-16b1652289c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:45.775040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50ae42-e7f8-4b68-8f78-16b1652289c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:45.775487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50ae42-e7f8-4b68-8f78-16b1652289c1 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793/users/657bc6f8a9e94103a48d2fc9f788ad38/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:45.778918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50ae42-e7f8-4b68-8f78-16b1652289c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b45dfbbda8f46df9f9ad99a6691e793, user_id=657bc6f8a9e94103a48d2fc9f788ad38, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:45.781569 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50ae42-e7f8-4b68-8f78-16b1652289c1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:45.820632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 67/135] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:00:45 2022] PUT /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793/users/657bc6f8a9e94103a48d2fc9f788ad38/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:00:45.821174 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37040-ab92-4035-8519-a517889a67e4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:45.821673 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37040-ab92-4035-8519-a517889a67e4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:45.822170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37040-ab92-4035-8519-a517889a67e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:45.866244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-62a37040-ab92-4035-8519-a517889a67e4 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:45.867825 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d225a7-03c3-46f8-9305-da0c214a85b4 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:45.868334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-62a37040-ab92-4035-8519-a517889a67e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:45.936902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a4498-cb3f-4676-beb1-44448e80b2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:45.938431 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a4498-cb3f-4676-beb1-44448e80b2cf None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:45.938981 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a4498-cb3f-4676-beb1-44448e80b2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:45.939438 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a4498-cb3f-4676-beb1-44448e80b2cf None admin] PATH_INFO: `/v3/users/657bc6f8a9e94103a48d2fc9f788ad38` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:45.941881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a4498-cb3f-4676-beb1-44448e80b2cf None admin] RBAC: Authorizing `identity:get_user(user_id=657bc6f8a9e94103a48d2fc9f788ad38)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:45.944681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a4498-cb3f-4676-beb1-44448e80b2cf None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:45.948256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 69/136] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:45 2022] GET /identity/v3/users/657bc6f8a9e94103a48d2fc9f788ad38 => generated 275 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:45.956714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a4498-cb3f-4676-beb1-44448e80b2cf None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:45.996475 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 68/137] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:46.059122 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37040-ab92-4035-8519-a517889a67e4 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:46.153072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a4498-cb3f-4676-beb1-44448e80b2cf None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:46.217094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c589dd-fc88-4ba3-887b-302da91f7843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:46.218424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c589dd-fc88-4ba3-887b-302da91f7843 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:46.218924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c589dd-fc88-4ba3-887b-302da91f7843 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:46.219475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c589dd-fc88-4ba3-887b-302da91f7843 None admin] PATH_INFO: `/v3/projects/8c47bf06c10644ea84f163d5ea0c1257` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:46.221813 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c589dd-fc88-4ba3-887b-302da91f7843 None admin] RBAC: Authorizing `identity:get_project(project_id=8c47bf06c10644ea84f163d5ea0c1257)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:46.224616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c589dd-fc88-4ba3-887b-302da91f7843 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:46.228140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 70/138] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:45 2022] GET /identity/v3/projects/8c47bf06c10644ea84f163d5ea0c1257 => generated 312 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:46.231324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:46.236544 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c589dd-fc88-4ba3-887b-302da91f7843 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:46.397765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:46.409140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37040-ab92-4035-8519-a517889a67e4 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:46.444175 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c589dd-fc88-4ba3-887b-302da91f7843 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:46.500880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91959ba2-12c5-4e18-9acc-34325ea7dd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:46.502202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91959ba2-12c5-4e18-9acc-34325ea7dd04 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:46.502779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91959ba2-12c5-4e18-9acc-34325ea7dd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:46.503263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91959ba2-12c5-4e18-9acc-34325ea7dd04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:46.507984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91959ba2-12c5-4e18-9acc-34325ea7dd04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:46.510754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91959ba2-12c5-4e18-9acc-34325ea7dd04 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:46.513977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 69/139] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:00:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:00:46.528379 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91959ba2-12c5-4e18-9acc-34325ea7dd04 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:46.552900 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701cb94-575d-4d26-a255-8e123eab1187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:46.553888 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701cb94-575d-4d26-a255-8e123eab1187 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:46.554231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701cb94-575d-4d26-a255-8e123eab1187 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:46.554563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701cb94-575d-4d26-a255-8e123eab1187 None admin] PATH_INFO: `/v3/projects/8c47bf06c10644ea84f163d5ea0c1257/users/657bc6f8a9e94103a48d2fc9f788ad38/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:46.556794 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701cb94-575d-4d26-a255-8e123eab1187 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c47bf06c10644ea84f163d5ea0c1257, user_id=657bc6f8a9e94103a48d2fc9f788ad38, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:46.558301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701cb94-575d-4d26-a255-8e123eab1187 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:46.616306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 71/140] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:00:46 2022] PUT /identity/v3/projects/8c47bf06c10644ea84f163d5ea0c1257/users/657bc6f8a9e94103a48d2fc9f788ad38/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:00:46.834597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91959ba2-12c5-4e18-9acc-34325ea7dd04 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:46.920531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c926c-e8e1-49cb-a99c-4d42f184f928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:46.921693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c926c-e8e1-49cb-a99c-4d42f184f928 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:46.922181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c926c-e8e1-49cb-a99c-4d42f184f928 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:46.922686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c926c-e8e1-49cb-a99c-4d42f184f928 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:46.924062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c926c-e8e1-49cb-a99c-4d42f184f928 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:46.926952 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c926c-e8e1-49cb-a99c-4d42f184f928 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:46.975844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 70/141] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:00:46 2022] POST /identity/v3/users => generated 283 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:00:48.196845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68dd10-7ead-415f-85bf-d31591a20bbc None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:48.197667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68dd10-7ead-415f-85bf-d31591a20bbc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:48.198053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68dd10-7ead-415f-85bf-d31591a20bbc None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:48.200396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 72/142] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:48.210313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842cff4-a60e-4142-8213-6c06cc7af786 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:48.211086 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842cff4-a60e-4142-8213-6c06cc7af786 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:48.211412 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842cff4-a60e-4142-8213-6c06cc7af786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:48.245990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9842cff4-a60e-4142-8213-6c06cc7af786 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:48.247970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9842cff4-a60e-4142-8213-6c06cc7af786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:48.287883 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:48.412581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 71/143] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:48.477636 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68dd10-7ead-415f-85bf-d31591a20bbc None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:48.585926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:48.702552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68dd10-7ead-415f-85bf-d31591a20bbc None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:48.767047 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf43050-c560-4598-9e4a-5cb6d67bf14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:48.769263 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf43050-c560-4598-9e4a-5cb6d67bf14a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:48.769263 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf43050-c560-4598-9e4a-5cb6d67bf14a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:48.769566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf43050-c560-4598-9e4a-5cb6d67bf14a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:48.791659 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf43050-c560-4598-9e4a-5cb6d67bf14a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-2bf43050-c560-4598-9e4a-5cb6d67bf14a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:48.810012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:48.811672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:48.813991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:48.813991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:48.813991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:48.813991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:48.813991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:48.813991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:48.813991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:48.813991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:48.813991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:48.813991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:48.813991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:00:48.813991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:00:48.813991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 73/144] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:48.821649 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842cff4-a60e-4142-8213-6c06cc7af786 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:49.023793 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842cff4-a60e-4142-8213-6c06cc7af786 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:49.096587 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f385277-436c-4c85-a8c3-6786e2a3cf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:49.097710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f385277-436c-4c85-a8c3-6786e2a3cf64 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:49.098192 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f385277-436c-4c85-a8c3-6786e2a3cf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:49.098672 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f385277-436c-4c85-a8c3-6786e2a3cf64 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:49.100065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f385277-436c-4c85-a8c3-6786e2a3cf64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:49.100604 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f385277-436c-4c85-a8c3-6786e2a3cf64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:49.103189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f385277-436c-4c85-a8c3-6786e2a3cf64 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:49.119979 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 72/145] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:00:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:49.128316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf43050-c560-4598-9e4a-5cb6d67bf14a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:49.361476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf43050-c560-4598-9e4a-5cb6d67bf14a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:49.377961 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:49.442583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808a862-5422-4401-bb94-afca074edb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:49.447021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808a862-5422-4401-bb94-afca074edb9e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:49.447021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808a862-5422-4401-bb94-afca074edb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:49.447021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808a862-5422-4401-bb94-afca074edb9e None admin] PATH_INFO: `/v3/users/db5bb33e92fc4329889a74bfcad472f8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:49.456295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808a862-5422-4401-bb94-afca074edb9e None admin] RBAC: Authorizing `identity:get_user(user_id=db5bb33e92fc4329889a74bfcad472f8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:49.456295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808a862-5422-4401-bb94-afca074edb9e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:49.458803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 74/146] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:49 2022] GET /identity/v3/users/db5bb33e92fc4329889a74bfcad472f8 => generated 289 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:49.467837 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f385277-436c-4c85-a8c3-6786e2a3cf64 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:49.528556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:49.724148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f385277-436c-4c85-a8c3-6786e2a3cf64 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:49.800020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f6042-88ad-4e30-9f10-b7d6884db236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:49.801572 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f6042-88ad-4e30-9f10-b7d6884db236 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:49.802077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f6042-88ad-4e30-9f10-b7d6884db236 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:49.802557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f6042-88ad-4e30-9f10-b7d6884db236 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:49.804997 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f6042-88ad-4e30-9f10-b7d6884db236 None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:49.807847 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f6042-88ad-4e30-9f10-b7d6884db236 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:49.812150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 73/147] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:49 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:49.821125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808a862-5422-4401-bb94-afca074edb9e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:50.083544 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808a862-5422-4401-bb94-afca074edb9e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:50.168093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f1f65-3e9d-4cd3-8448-e0c8a3e6d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:50.169779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f1f65-3e9d-4cd3-8448-e0c8a3e6d193 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:50.170282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f1f65-3e9d-4cd3-8448-e0c8a3e6d193 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:50.170816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f1f65-3e9d-4cd3-8448-e0c8a3e6d193 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793/users/db5bb33e92fc4329889a74bfcad472f8/roles/cc0b77c0514d4c6294c8d884a4fea9db` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:50.174957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f1f65-3e9d-4cd3-8448-e0c8a3e6d193 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b45dfbbda8f46df9f9ad99a6691e793, user_id=db5bb33e92fc4329889a74bfcad472f8, role_id=cc0b77c0514d4c6294c8d884a4fea9db)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:50.177294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f1f65-3e9d-4cd3-8448-e0c8a3e6d193 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:50.209976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 75/148] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:00:49 2022] PUT /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793/users/db5bb33e92fc4329889a74bfcad472f8/roles/cc0b77c0514d4c6294c8d884a4fea9db => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:00:50.538152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f031f6-723b-4424-80e5-6dc89d79f31c None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:50.538913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f031f6-723b-4424-80e5-6dc89d79f31c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:50.539229 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f031f6-723b-4424-80e5-6dc89d79f31c None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:50.542291 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 74/149] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:50.551477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398fee1-80c3-4ddc-8af0-1d2920b14c58 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:50.552241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398fee1-80c3-4ddc-8af0-1d2920b14c58 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:50.552556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398fee1-80c3-4ddc-8af0-1d2920b14c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:50.595669 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6398fee1-80c3-4ddc-8af0-1d2920b14c58 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:50.597954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6398fee1-80c3-4ddc-8af0-1d2920b14c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:50.654055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:50.758383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 76/150] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:50.866906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f031f6-723b-4424-80e5-6dc89d79f31c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:50.998088 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cac1a-647f-4083-9cab-297092449c3c None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:50.999132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cac1a-647f-4083-9cab-297092449c3c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:50.999855 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cac1a-647f-4083-9cab-297092449c3c None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:51.002936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 77/151] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:00:51.035787 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6a622-1e13-4f0f-a3b5-7e33c5a476eb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:51.036748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6a622-1e13-4f0f-a3b5-7e33c5a476eb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:51.037490 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6a622-1e13-4f0f-a3b5-7e33c5a476eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:51.069919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:51.108504 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ded6a622-1e13-4f0f-a3b5-7e33c5a476eb None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:51.111001 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ded6a622-1e13-4f0f-a3b5-7e33c5a476eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:51.125238 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f031f6-723b-4424-80e5-6dc89d79f31c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:51.217348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011021e-5619-45f5-905c-6e53098c10c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:51.218733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011021e-5619-45f5-905c-6e53098c10c6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:51.219212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011021e-5619-45f5-905c-6e53098c10c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:51.219709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011021e-5619-45f5-905c-6e53098c10c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:51.248197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011021e-5619-45f5-905c-6e53098c10c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e011021e-5619-45f5-905c-6e53098c10c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:51.271974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:51.273631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:51.275742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:51.275742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:51.275742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:51.275742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:51.275742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:51.275742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:51.275742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:51.275742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:51.275742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:51.275742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:51.275742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:00:51.275742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:00:51.275742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 75/152] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:00:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:51.299510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011021e-5619-45f5-905c-6e53098c10c6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:51.318408 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 78/153] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 21 12:00:51.481869 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6a622-1e13-4f0f-a3b5-7e33c5a476eb None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:51.550307 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011021e-5619-45f5-905c-6e53098c10c6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:51.629298 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63a771-fffd-4100-8eeb-742c914c1edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:51.630376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63a771-fffd-4100-8eeb-742c914c1edb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:51.630868 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63a771-fffd-4100-8eeb-742c914c1edb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:51.631337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63a771-fffd-4100-8eeb-742c914c1edb None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:51.632381 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63a771-fffd-4100-8eeb-742c914c1edb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:51.632898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63a771-fffd-4100-8eeb-742c914c1edb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:51.635294 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63a771-fffd-4100-8eeb-742c914c1edb None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:51.655036 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 76/154] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:00:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:00:51.667152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63a771-fffd-4100-8eeb-742c914c1edb None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:51.684589 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:51.748544 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:51.771123 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6a622-1e13-4f0f-a3b5-7e33c5a476eb None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:51.889389 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cec3c-6274-46e9-b2da-e9029ef40f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:51.893078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cec3c-6274-46e9-b2da-e9029ef40f96 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:51.895388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cec3c-6274-46e9-b2da-e9029ef40f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:51.896183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cec3c-6274-46e9-b2da-e9029ef40f96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:51.945842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cec3c-6274-46e9-b2da-e9029ef40f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-cb6cec3c-6274-46e9-b2da-e9029ef40f96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:51.965501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:51.967369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:51.968964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:51.968964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:51.968964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:51.968964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:51.968964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:51.968964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:51.968964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:51.968964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:51.968964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:51.968964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:51.968964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:00:51.968964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:00:51.977794 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 79/155] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:00:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 497 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:00:51.985340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07850375-39ca-4edb-9358-06e0c40f3cda None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:51.987748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07850375-39ca-4edb-9358-06e0c40f3cda None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:51.988164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07850375-39ca-4edb-9358-06e0c40f3cda None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:51.990221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 80/156] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:51.990591 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07850375-39ca-4edb-9358-06e0c40f3cda None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:52.045041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63a771-fffd-4100-8eeb-742c914c1edb None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:52.178290 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b6d63-c110-470c-821d-b61e75dcad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:52.180358 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b6d63-c110-470c-821d-b61e75dcad0a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:52.181140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b6d63-c110-470c-821d-b61e75dcad0a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:52.187508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b6d63-c110-470c-821d-b61e75dcad0a None admin] PATH_INFO: `/v3/users/657bc6f8a9e94103a48d2fc9f788ad38` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:52.190292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b6d63-c110-470c-821d-b61e75dcad0a None admin] RBAC: Authorizing `identity:get_user(user_id=657bc6f8a9e94103a48d2fc9f788ad38)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:52.193307 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b6d63-c110-470c-821d-b61e75dcad0a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:52.202852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 77/157] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:51 2022] GET /identity/v3/users/657bc6f8a9e94103a48d2fc9f788ad38 => generated 275 bytes in 536 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:00:52.206221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9ad19-5cdf-4091-8194-4f77ce23f014 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:52.207075 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9ad19-5cdf-4091-8194-4f77ce23f014 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:52.207802 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9ad19-5cdf-4091-8194-4f77ce23f014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:52.254624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-07b9ad19-5cdf-4091-8194-4f77ce23f014 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:52.257157 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-07b9ad19-5cdf-4091-8194-4f77ce23f014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:52.306593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07850375-39ca-4edb-9358-06e0c40f3cda None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:52.424743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1618fe-5a99-4ca0-a4ba-5a5f43fac3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:52.427089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1618fe-5a99-4ca0-a4ba-5a5f43fac3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:52.429596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1618fe-5a99-4ca0-a4ba-5a5f43fac3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:52.430620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1618fe-5a99-4ca0-a4ba-5a5f43fac3e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:52.434674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1618fe-5a99-4ca0-a4ba-5a5f43fac3e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:52.437184 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1618fe-5a99-4ca0-a4ba-5a5f43fac3e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:52.440289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1618fe-5a99-4ca0-a4ba-5a5f43fac3e0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:52.488540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 81/158] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:52.490598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1618fe-5a99-4ca0-a4ba-5a5f43fac3e0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:52.514283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 78/159] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:52.515261 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9ad19-5cdf-4091-8194-4f77ce23f014 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:52.518073 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:52.531079 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:52.704114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1618fe-5a99-4ca0-a4ba-5a5f43fac3e0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:52.749817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9ad19-5cdf-4091-8194-4f77ce23f014 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:52.815707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242b88f-e1d7-4191-b2c6-f66dee092fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:52.817775 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242b88f-e1d7-4191-b2c6-f66dee092fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:52.818556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242b88f-e1d7-4191-b2c6-f66dee092fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:52.819324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242b88f-e1d7-4191-b2c6-f66dee092fc9 None admin] PATH_INFO: `/v3/users/8e3560d1fa07476590360b2627638a18` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:52.821912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242b88f-e1d7-4191-b2c6-f66dee092fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=8e3560d1fa07476590360b2627638a18)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:52.825440 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242b88f-e1d7-4191-b2c6-f66dee092fc9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:52.830076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 79/160] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:52 2022] GET /identity/v3/users/8e3560d1fa07476590360b2627638a18 => generated 247 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:52.832337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242b88f-e1d7-4191-b2c6-f66dee092fc9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:52.838510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c354e-389c-4ca7-8189-394967cabca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:52.839316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c354e-389c-4ca7-8189-394967cabca9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:52.839490 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c354e-389c-4ca7-8189-394967cabca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:52.839904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c354e-389c-4ca7-8189-394967cabca9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:53.000245 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c354e-389c-4ca7-8189-394967cabca9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:53.001694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c354e-389c-4ca7-8189-394967cabca9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:53.011696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:53.027481 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242b88f-e1d7-4191-b2c6-f66dee092fc9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:53.051167 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:53.099334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd296291-e9bf-40cf-8825-019d0756e561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:53.101081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd296291-e9bf-40cf-8825-019d0756e561 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:53.101708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd296291-e9bf-40cf-8825-019d0756e561 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:53.102272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd296291-e9bf-40cf-8825-019d0756e561 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:53.123629 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd296291-e9bf-40cf-8825-019d0756e561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-dd296291-e9bf-40cf-8825-019d0756e561 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:53.145469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:53.146449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:53.147273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:53.147273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:53.147273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:53.147273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:53.147273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:53.147273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:53.147273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:53.147273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:53.147273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:53.147273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:53.147273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:00:53.147273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:00:53.147858 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 80/161] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:53.162064 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf4cec-1d62-4919-8415-d5b88951bb33 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:53.162559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf4cec-1d62-4919-8415-d5b88951bb33 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:53.163074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf4cec-1d62-4919-8415-d5b88951bb33 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:53.165815 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 81/162] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:53 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:53.173412 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a6157-f74b-4e9f-9742-d5ba38f8ea15 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:53.173974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a6157-f74b-4e9f-9742-d5ba38f8ea15 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:53.174480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a6157-f74b-4e9f-9742-d5ba38f8ea15 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:53.195918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 82/163] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:53 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:53.197716 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a6157-f74b-4e9f-9742-d5ba38f8ea15 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:53.236543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 82/164] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:00:53.237803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c354e-389c-4ca7-8189-394967cabca9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:53.374471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a6157-f74b-4e9f-9742-d5ba38f8ea15 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:53.412207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:53.419813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c05602-9447-4319-940d-e0fc01881994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:53.421327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c05602-9447-4319-940d-e0fc01881994 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:53.421625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c05602-9447-4319-940d-e0fc01881994 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:53.422853 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c05602-9447-4319-940d-e0fc01881994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:53.452378 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c354e-389c-4ca7-8189-394967cabca9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:53.484533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:53.507878 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14584d8-84cc-46e3-b315-20fe7147d49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:53.508606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14584d8-84cc-46e3-b315-20fe7147d49c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:53.508889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14584d8-84cc-46e3-b315-20fe7147d49c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:53.509166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14584d8-84cc-46e3-b315-20fe7147d49c None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:53.509948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14584d8-84cc-46e3-b315-20fe7147d49c None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:53.510293 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14584d8-84cc-46e3-b315-20fe7147d49c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:53.511725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14584d8-84cc-46e3-b315-20fe7147d49c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:53.536999 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 83/165] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:00:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:53.541529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7322890-c5b1-43a5-b503-5ab76077b76d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:53.542684 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7322890-c5b1-43a5-b503-5ab76077b76d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:53.544083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7322890-c5b1-43a5-b503-5ab76077b76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:53.554625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c05602-9447-4319-940d-e0fc01881994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:53.556176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c05602-9447-4319-940d-e0fc01881994 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:53.576671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f7322890-c5b1-43a5-b503-5ab76077b76d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:53.578021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f7322890-c5b1-43a5-b503-5ab76077b76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:53.700188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 84/166] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:53.701891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d98190-78a7-435c-83d7-8ba018562c24 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:53.702205 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d98190-78a7-435c-83d7-8ba018562c24 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:53.702471 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d98190-78a7-435c-83d7-8ba018562c24 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:53.704837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 85/167] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:53.711700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b88d8b-7709-479d-8794-74d61e70ed4d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:53.711700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b88d8b-7709-479d-8794-74d61e70ed4d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:53.711700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b88d8b-7709-479d-8794-74d61e70ed4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:53.726755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 83/168] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:00:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:00:53.727735 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c05602-9447-4319-940d-e0fc01881994 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:53.744324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-29b88d8b-7709-479d-8794-74d61e70ed4d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:53.745534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-29b88d8b-7709-479d-8794-74d61e70ed4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:53.789043 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:53.870712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 86/169] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:53.870712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b88d8b-7709-479d-8794-74d61e70ed4d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:53.892986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c05602-9447-4319-940d-e0fc01881994 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:53.936099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:53.956819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abdfda-199f-4a56-b8ee-6bb1d3284443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:53.958129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abdfda-199f-4a56-b8ee-6bb1d3284443 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:53.958584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abdfda-199f-4a56-b8ee-6bb1d3284443 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:53.959049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abdfda-199f-4a56-b8ee-6bb1d3284443 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:53.960793 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abdfda-199f-4a56-b8ee-6bb1d3284443 None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:53.963304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abdfda-199f-4a56-b8ee-6bb1d3284443 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:53.966143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 84/170] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:53 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:53.968068 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647584-c6f3-45a9-9fe9-ffe66be1d492 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:53.968638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647584-c6f3-45a9-9fe9-ffe66be1d492 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:53.968916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647584-c6f3-45a9-9fe9-ffe66be1d492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:53.986586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ff647584-c6f3-45a9-9fe9-ffe66be1d492 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:53.987831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ff647584-c6f3-45a9-9fe9-ffe66be1d492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:54.038294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b88d8b-7709-479d-8794-74d61e70ed4d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:54.057301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 85/171] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:54.070900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff647584-c6f3-45a9-9fe9-ffe66be1d492 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:54.090880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:54.100240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38623a-a991-46ef-ab1c-5073be3ac0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:54.101709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38623a-a991-46ef-ab1c-5073be3ac0cf None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:54.102212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38623a-a991-46ef-ab1c-5073be3ac0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:54.102677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38623a-a991-46ef-ab1c-5073be3ac0cf None admin] PATH_INFO: `/v3/users/657bc6f8a9e94103a48d2fc9f788ad38` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:54.104881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38623a-a991-46ef-ab1c-5073be3ac0cf None admin] RBAC: Authorizing `identity:get_user(user_id=657bc6f8a9e94103a48d2fc9f788ad38)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:54.107721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38623a-a991-46ef-ab1c-5073be3ac0cf None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:54.116339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 87/172] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:53 2022] GET /identity/v3/users/657bc6f8a9e94103a48d2fc9f788ad38 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:54.116339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38623a-a991-46ef-ab1c-5073be3ac0cf None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:54.184569 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff647584-c6f3-45a9-9fe9-ffe66be1d492 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:54.223001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528639f-b144-4fef-860b-f40b82fa44d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:54.223684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528639f-b144-4fef-860b-f40b82fa44d5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:54.223964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528639f-b144-4fef-860b-f40b82fa44d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:54.224239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528639f-b144-4fef-860b-f40b82fa44d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:54.231827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38623a-a991-46ef-ab1c-5073be3ac0cf None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:54.235534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528639f-b144-4fef-860b-f40b82fa44d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:54.240514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-c528639f-b144-4fef-860b-f40b82fa44d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:54.243414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:54.245384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:54.247720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:54.247720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:54.247720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:54.247720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:54.247720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:54.247720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:54.247720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:54.247720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:54.247720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:54.247720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:54.247720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:00:54.247720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:00:54.247720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 86/173] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:54.247720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9fb86-69cf-4b08-b8e8-c0e56ef1765e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:54.250065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9fb86-69cf-4b08-b8e8-c0e56ef1765e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:54.250065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9fb86-69cf-4b08-b8e8-c0e56ef1765e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:54.250065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 87/174] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:54.253062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9fb86-69cf-4b08-b8e8-c0e56ef1765e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:54.279058 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dfdf0-6340-453d-867c-8e79dab35804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:54.280123 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dfdf0-6340-453d-867c-8e79dab35804 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:54.280522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dfdf0-6340-453d-867c-8e79dab35804 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:54.280935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dfdf0-6340-453d-867c-8e79dab35804 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:54.282370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0dfdf0-6340-453d-867c-8e79dab35804 None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:54.284427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0dfdf0-6340-453d-867c-8e79dab35804 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:54.294672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 88/175] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:54 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:54.294672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927556e-e1b8-4207-a237-d6900c5e451d None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:54.294672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927556e-e1b8-4207-a237-d6900c5e451d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:54.294672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927556e-e1b8-4207-a237-d6900c5e451d None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:54.294672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 89/176] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:54.294672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927556e-e1b8-4207-a237-d6900c5e451d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:54.355238 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:54.369038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9fb86-69cf-4b08-b8e8-c0e56ef1765e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:54.404486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d130041-d434-4f6a-be1b-0072ba43296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:54.405349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d130041-d434-4f6a-be1b-0072ba43296e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:54.405630 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d130041-d434-4f6a-be1b-0072ba43296e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:54.405892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d130041-d434-4f6a-be1b-0072ba43296e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:54.417189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d130041-d434-4f6a-be1b-0072ba43296e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-5d130041-d434-4f6a-be1b-0072ba43296e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:54.425117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:54.426260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:54.428139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:54.428139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:54.428139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:54.428139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:54.428139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:54.428139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:54.428139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:54.428139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:54.428139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:54.428139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:54.428139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:00:54.428139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:00:54.428139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 88/177] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:00:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:54.431923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d130041-d434-4f6a-be1b-0072ba43296e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:54.458707 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927556e-e1b8-4207-a237-d6900c5e451d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:54.503905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f27f51-f2d1-4aed-bbe9-42baa7eea7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:54.504490 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f27f51-f2d1-4aed-bbe9-42baa7eea7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:54.504764 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f27f51-f2d1-4aed-bbe9-42baa7eea7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:54.505036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f27f51-f2d1-4aed-bbe9-42baa7eea7e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:54.505888 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f27f51-f2d1-4aed-bbe9-42baa7eea7e4 None admin] RBAC: Adding query filter params (role.id=a6779b95437c46648185d3ce128f658b, scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793, user.id=657bc6f8a9e94103a48d2fc9f788ad38) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:54.506199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f27f51-f2d1-4aed-bbe9-42baa7eea7e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:54.507704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f27f51-f2d1-4aed-bbe9-42baa7eea7e4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:54.514888 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 90/178] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:00:54 2022] GET /identity/v3/role_assignments?user.id=657bc6f8a9e94103a48d2fc9f788ad38&scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793&role.id=a6779b95437c46648185d3ce128f658b => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:54.516463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f27f51-f2d1-4aed-bbe9-42baa7eea7e4 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:54.585410 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d130041-d434-4f6a-be1b-0072ba43296e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:54.587100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:54.649740 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7347e-84ef-459a-a19a-8d6dc7de144a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:54.651163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7347e-84ef-459a-a19a-8d6dc7de144a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:54.651651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7347e-84ef-459a-a19a-8d6dc7de144a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:54.652133 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7347e-84ef-459a-a19a-8d6dc7de144a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:54.654477 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7347e-84ef-459a-a19a-8d6dc7de144a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:54.657369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7347e-84ef-459a-a19a-8d6dc7de144a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:54.660785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 89/179] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:00:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:54.662138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7347e-84ef-459a-a19a-8d6dc7de144a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:54.699130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:54.703499 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f27f51-f2d1-4aed-bbe9-42baa7eea7e4 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:54.759899 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d634404-96b0-46f5-a4e6-1eb0a01e97d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:54.761799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634404-96b0-46f5-a4e6-1eb0a01e97d2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:54.761799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634404-96b0-46f5-a4e6-1eb0a01e97d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:54.762020 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634404-96b0-46f5-a4e6-1eb0a01e97d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:54.825593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7347e-84ef-459a-a19a-8d6dc7de144a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:54.869535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d634404-96b0-46f5-a4e6-1eb0a01e97d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:54.871089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d634404-96b0-46f5-a4e6-1eb0a01e97d2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:54.879696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176c43b-d02e-4ff6-a126-22dc4834d436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:54.880858 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176c43b-d02e-4ff6-a126-22dc4834d436 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:54.881337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176c43b-d02e-4ff6-a126-22dc4834d436 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:54.881825 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176c43b-d02e-4ff6-a126-22dc4834d436 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:54.883275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176c43b-d02e-4ff6-a126-22dc4834d436 None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:54.883816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176c43b-d02e-4ff6-a126-22dc4834d436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:54.886375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176c43b-d02e-4ff6-a126-22dc4834d436 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:54.899681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 90/180] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:00:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:54.901402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f4dfd-f0d3-43d3-9ba8-da393efe2f13 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:54.901809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f4dfd-f0d3-43d3-9ba8-da393efe2f13 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:54.902186 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f4dfd-f0d3-43d3-9ba8-da393efe2f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:54.914142 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:54.929951 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-166f4dfd-f0d3-43d3-9ba8-da393efe2f13 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:54.932056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-166f4dfd-f0d3-43d3-9ba8-da393efe2f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:54.988520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 91/181] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:00:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:00:54.989409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d634404-96b0-46f5-a4e6-1eb0a01e97d2 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:55.034841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 91/182] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:55.034841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ae087-bf0a-4748-8fe1-447f59fd32b2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:55.034841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ae087-bf0a-4748-8fe1-447f59fd32b2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:55.034841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ae087-bf0a-4748-8fe1-447f59fd32b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:55.051793 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a70ae087-bf0a-4748-8fe1-447f59fd32b2 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:55.052988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a70ae087-bf0a-4748-8fe1-447f59fd32b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:55.055422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:55.126595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d634404-96b0-46f5-a4e6-1eb0a01e97d2 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:55.127729 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 92/183] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:55.128614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ae087-bf0a-4748-8fe1-447f59fd32b2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:55.178340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a79d46-524d-4d44-8e73-02d0811faa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:55.179235 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a79d46-524d-4d44-8e73-02d0811faa70 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:55.179523 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a79d46-524d-4d44-8e73-02d0811faa70 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:55.179801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a79d46-524d-4d44-8e73-02d0811faa70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:55.180669 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a79d46-524d-4d44-8e73-02d0811faa70 None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793, user.id=8e3560d1fa07476590360b2627638a18) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:55.180983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a79d46-524d-4d44-8e73-02d0811faa70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:55.182511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a79d46-524d-4d44-8e73-02d0811faa70 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:55.189216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 92/184] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:00:54 2022] GET /identity/v3/role_assignments?user.id=8e3560d1fa07476590360b2627638a18&scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:55.190129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a79d46-524d-4d44-8e73-02d0811faa70 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:55.193297 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:55.311807 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ae087-bf0a-4748-8fe1-447f59fd32b2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:55.346946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a79d46-524d-4d44-8e73-02d0811faa70 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:55.380813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63b704-1e7c-4d59-a022-5e6c73890a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:55.381865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63b704-1e7c-4d59-a022-5e6c73890a0f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:55.381865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63b704-1e7c-4d59-a022-5e6c73890a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:55.382051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63b704-1e7c-4d59-a022-5e6c73890a0f None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:55.382905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63b704-1e7c-4d59-a022-5e6c73890a0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:55.383220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63b704-1e7c-4d59-a022-5e6c73890a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:55.384691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63b704-1e7c-4d59-a022-5e6c73890a0f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:55.391645 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:55.395854 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 93/185] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:55.397539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63b704-1e7c-4d59-a022-5e6c73890a0f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:55.413271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b29a81-2115-4e41-811e-2996f2a4606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:55.414332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b29a81-2115-4e41-811e-2996f2a4606d None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:55.414852 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b29a81-2115-4e41-811e-2996f2a4606d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:55.415996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b29a81-2115-4e41-811e-2996f2a4606d None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:55.416999 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b29a81-2115-4e41-811e-2996f2a4606d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:55.418537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b29a81-2115-4e41-811e-2996f2a4606d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:55.462896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 93/186] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:00:55 2022] POST /identity/v3/users => generated 297 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:00:55.463829 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b29a81-2115-4e41-811e-2996f2a4606d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:55.556261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:55.614225 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b29a81-2115-4e41-811e-2996f2a4606d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:55.622426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63b704-1e7c-4d59-a022-5e6c73890a0f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:55.666783 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f8bc2-761b-45bf-8fcc-a05881ec320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:55.668651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f8bc2-761b-45bf-8fcc-a05881ec320b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:55.669463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f8bc2-761b-45bf-8fcc-a05881ec320b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:55.670183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f8bc2-761b-45bf-8fcc-a05881ec320b None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:55.672900 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f8bc2-761b-45bf-8fcc-a05881ec320b None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:55.677469 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f8bc2-761b-45bf-8fcc-a05881ec320b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:55.679128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 94/187] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:55 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:55.680655 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f8bc2-761b-45bf-8fcc-a05881ec320b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:55.693523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16916a7a-b464-4d0e-a6a7-3802b246b227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:55.694621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16916a7a-b464-4d0e-a6a7-3802b246b227 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:55.695060 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16916a7a-b464-4d0e-a6a7-3802b246b227 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:55.695449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16916a7a-b464-4d0e-a6a7-3802b246b227 None admin] PATH_INFO: `/v3/users/657bc6f8a9e94103a48d2fc9f788ad38` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:55.697660 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16916a7a-b464-4d0e-a6a7-3802b246b227 None admin] RBAC: Authorizing `identity:get_user(user_id=657bc6f8a9e94103a48d2fc9f788ad38)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:55.699534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16916a7a-b464-4d0e-a6a7-3802b246b227 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:55.702550 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 94/188] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:55 2022] GET /identity/v3/users/657bc6f8a9e94103a48d2fc9f788ad38 => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:55.706964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16916a7a-b464-4d0e-a6a7-3802b246b227 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:55.824667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:55.850646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f8bc2-761b-45bf-8fcc-a05881ec320b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:55.892707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16916a7a-b464-4d0e-a6a7-3802b246b227 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:55.901562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:55.915330 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5fd4e-ed20-4a05-8af6-032d88a9e3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:55.917103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5fd4e-ed20-4a05-8af6-032d88a9e3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:55.917613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5fd4e-ed20-4a05-8af6-032d88a9e3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:55.918242 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5fd4e-ed20-4a05-8af6-032d88a9e3d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:55.933051 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5fd4e-ed20-4a05-8af6-032d88a9e3d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-65d5fd4e-ed20-4a05-8af6-032d88a9e3d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:55.944033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:55.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:55.945752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:55.945752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:55.945752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:55.945752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:55.945752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:55.945752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:55.945752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:55.945752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:55.945752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:55.945752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:55.945752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:00:55.945752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:00:55.949200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 95/189] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:00:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:55.950492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5fd4e-ed20-4a05-8af6-032d88a9e3d1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:55.968407 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd57830-e317-4927-8f89-c1d8f32a14f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:55.969754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd57830-e317-4927-8f89-c1d8f32a14f0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:55.970237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd57830-e317-4927-8f89-c1d8f32a14f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:55.970808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd57830-e317-4927-8f89-c1d8f32a14f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:55.996401 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd57830-e317-4927-8f89-c1d8f32a14f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ccd57830-e317-4927-8f89-c1d8f32a14f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:56.016621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:56.017873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:56.018687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:56.018687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:56.018687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:56.018687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:56.018687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:56.018687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:56.018687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:56.018687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:56.018687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:56.018687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:56.018687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:00:56.018687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:00:56.019791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 95/190] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:56.021844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd57830-e317-4927-8f89-c1d8f32a14f0 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:56.167089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5fd4e-ed20-4a05-8af6-032d88a9e3d1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:56.233251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544268fd-0f38-48f3-be1e-f81f6063ed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:56.234971 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544268fd-0f38-48f3-be1e-f81f6063ed39 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:56.235450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544268fd-0f38-48f3-be1e-f81f6063ed39 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:56.235935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544268fd-0f38-48f3-be1e-f81f6063ed39 None admin] PATH_INFO: `/v3/users/ef9685ea41104ef48f0c03c1654dc76e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:56.245600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd57830-e317-4927-8f89-c1d8f32a14f0 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:56.261765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544268fd-0f38-48f3-be1e-f81f6063ed39 None admin] RBAC: Authorizing `identity:get_user(user_id=ef9685ea41104ef48f0c03c1654dc76e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:56.264460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544268fd-0f38-48f3-be1e-f81f6063ed39 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:56.268047 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 96/191] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:55 2022] GET /identity/v3/users/ef9685ea41104ef48f0c03c1654dc76e => generated 283 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:56.269414 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544268fd-0f38-48f3-be1e-f81f6063ed39 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:56.309601 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:56.325053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd061fe5-227d-4a06-8fe1-9f3203be175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:56.326148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd061fe5-227d-4a06-8fe1-9f3203be175a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:56.326606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd061fe5-227d-4a06-8fe1-9f3203be175a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:56.327110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd061fe5-227d-4a06-8fe1-9f3203be175a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:56.329236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd061fe5-227d-4a06-8fe1-9f3203be175a None admin] RBAC: Adding query filter params (role.id=67ad028192f24536a65fa57450a563b9, scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793, user.id=657bc6f8a9e94103a48d2fc9f788ad38) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:56.330263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd061fe5-227d-4a06-8fe1-9f3203be175a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:56.333138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd061fe5-227d-4a06-8fe1-9f3203be175a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:56.349127 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 96/192] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:00:56 2022] GET /identity/v3/role_assignments?user.id=657bc6f8a9e94103a48d2fc9f788ad38&scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793&role.id=67ad028192f24536a65fa57450a563b9 => generated 608 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:56.350025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd061fe5-227d-4a06-8fe1-9f3203be175a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:56.369905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:56.539834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544268fd-0f38-48f3-be1e-f81f6063ed39 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:56.554891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd061fe5-227d-4a06-8fe1-9f3203be175a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:56.626384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be8280-0cb3-4b08-bcf2-6ceec5d2f32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:56.627676 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be8280-0cb3-4b08-bcf2-6ceec5d2f32c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:56.628170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be8280-0cb3-4b08-bcf2-6ceec5d2f32c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:56.628636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be8280-0cb3-4b08-bcf2-6ceec5d2f32c None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:56.630122 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be8280-0cb3-4b08-bcf2-6ceec5d2f32c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:56.630700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be8280-0cb3-4b08-bcf2-6ceec5d2f32c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:56.633628 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be8280-0cb3-4b08-bcf2-6ceec5d2f32c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:56.645202 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa0e65-62d9-4e58-954e-43e16a07668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:56.646315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa0e65-62d9-4e58-954e-43e16a07668d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:56.646820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa0e65-62d9-4e58-954e-43e16a07668d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:56.647289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa0e65-62d9-4e58-954e-43e16a07668d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:56.651465 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 97/193] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:00:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:56.653061 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be8280-0cb3-4b08-bcf2-6ceec5d2f32c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:56.769232 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:56.788366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa0e65-62d9-4e58-954e-43e16a07668d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:56.789968 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa0e65-62d9-4e58-954e-43e16a07668d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:56.842115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:56.855635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be8280-0cb3-4b08-bcf2-6ceec5d2f32c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:56.928576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e370bd-edec-4071-a8b2-2c825921be23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:56.929670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e370bd-edec-4071-a8b2-2c825921be23 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:56.930035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e370bd-edec-4071-a8b2-2c825921be23 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:56.930615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e370bd-edec-4071-a8b2-2c825921be23 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:56.931943 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e370bd-edec-4071-a8b2-2c825921be23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:56.932475 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e370bd-edec-4071-a8b2-2c825921be23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:56.935421 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e370bd-edec-4071-a8b2-2c825921be23 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:56.951684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 98/194] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:00:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:56.953543 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e370bd-edec-4071-a8b2-2c825921be23 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:56.969054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 97/195] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:00:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:00:56.970539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa0e65-62d9-4e58-954e-43e16a07668d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:57.139328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e370bd-edec-4071-a8b2-2c825921be23 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:57.165121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa0e65-62d9-4e58-954e-43e16a07668d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:57.170206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:57.203836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7273-14ca-4abd-9c63-f7e171123ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:57.204836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7273-14ca-4abd-9c63-f7e171123ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:57.205326 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7273-14ca-4abd-9c63-f7e171123ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:57.205742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7273-14ca-4abd-9c63-f7e171123ef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:57.237353 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874d72a-88ef-431c-a49e-9c2401ff4843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:57.241217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874d72a-88ef-431c-a49e-9c2401ff4843 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:57.241828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874d72a-88ef-431c-a49e-9c2401ff4843 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:57.242502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874d72a-88ef-431c-a49e-9c2401ff4843 None admin] PATH_INFO: `/v3/users/ef9685ea41104ef48f0c03c1654dc76e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:57.245623 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874d72a-88ef-431c-a49e-9c2401ff4843 None admin] RBAC: Authorizing `identity:get_user(user_id=ef9685ea41104ef48f0c03c1654dc76e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:57.248537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874d72a-88ef-431c-a49e-9c2401ff4843 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:57.252291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 98/196] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:56 2022] GET /identity/v3/users/ef9685ea41104ef48f0c03c1654dc76e => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:57.253586 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874d72a-88ef-431c-a49e-9c2401ff4843 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:57.282870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:57.328694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c7273-14ca-4abd-9c63-f7e171123ef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:57.330282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c7273-14ca-4abd-9c63-f7e171123ef8 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:57.451780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 99/197] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:00:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:00:57.452214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7273-14ca-4abd-9c63-f7e171123ef8 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:57.462712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874d72a-88ef-431c-a49e-9c2401ff4843 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:57.478697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:57.530545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89a59c-a265-40ac-8dfc-2a581025dd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:57.532163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a59c-a265-40ac-8dfc-2a581025dd42 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:57.532703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a59c-a265-40ac-8dfc-2a581025dd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:57.533384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a59c-a265-40ac-8dfc-2a581025dd42 None admin] PATH_INFO: `/v3/users/db5bb33e92fc4329889a74bfcad472f8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:57.536052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89a59c-a265-40ac-8dfc-2a581025dd42 None admin] RBAC: Authorizing `identity:get_user(user_id=db5bb33e92fc4329889a74bfcad472f8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:57.539043 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89a59c-a265-40ac-8dfc-2a581025dd42 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:57.543426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 99/198] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:57 2022] GET /identity/v3/users/db5bb33e92fc4329889a74bfcad472f8 => generated 289 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:57.545347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89a59c-a265-40ac-8dfc-2a581025dd42 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:57.565107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7273-14ca-4abd-9c63-f7e171123ef8 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:57.603029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df30f1c-fe2c-4446-a6d4-27bcdcf88de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:57.603964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df30f1c-fe2c-4446-a6d4-27bcdcf88de3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:57.604252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df30f1c-fe2c-4446-a6d4-27bcdcf88de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:57.604529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df30f1c-fe2c-4446-a6d4-27bcdcf88de3 None admin] PATH_INFO: `/v3/projects/8c47bf06c10644ea84f163d5ea0c1257` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:57.605807 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df30f1c-fe2c-4446-a6d4-27bcdcf88de3 None admin] RBAC: Authorizing `identity:get_project(project_id=8c47bf06c10644ea84f163d5ea0c1257)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:57.607314 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df30f1c-fe2c-4446-a6d4-27bcdcf88de3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:57.609342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 100/199] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:57 2022] GET /identity/v3/projects/8c47bf06c10644ea84f163d5ea0c1257 => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:57.609900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df30f1c-fe2c-4446-a6d4-27bcdcf88de3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:57.674347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:57.700745 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:57.703616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89a59c-a265-40ac-8dfc-2a581025dd42 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:57.718940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df30f1c-fe2c-4446-a6d4-27bcdcf88de3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:57.748111 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c1871-2386-4d09-9985-41c9f2799dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:57.748788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c1871-2386-4d09-9985-41c9f2799dfa None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:57.749069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c1871-2386-4d09-9985-41c9f2799dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:57.749338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c1871-2386-4d09-9985-41c9f2799dfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:57.757182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3d39a-6ddb-4752-89ad-c7aeb5e90527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:57.758361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3d39a-6ddb-4752-89ad-c7aeb5e90527 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:57.758828 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3d39a-6ddb-4752-89ad-c7aeb5e90527 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:57.759930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3d39a-6ddb-4752-89ad-c7aeb5e90527 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:57.761463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3d39a-6ddb-4752-89ad-c7aeb5e90527 None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:57.764187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3d39a-6ddb-4752-89ad-c7aeb5e90527 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:57.767782 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 101/200] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:57 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:57.768897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3d39a-6ddb-4752-89ad-c7aeb5e90527 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:57.846834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c1871-2386-4d09-9985-41c9f2799dfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:57.849339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c1871-2386-4d09-9985-41c9f2799dfa None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:57.904026 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3d39a-6ddb-4752-89ad-c7aeb5e90527 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:57.950185 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaf155-1f10-4564-9db0-171bb9edb3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:57.950913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf155-1f10-4564-9db0-171bb9edb3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:57.951151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf155-1f10-4564-9db0-171bb9edb3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:57.951428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf155-1f10-4564-9db0-171bb9edb3b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:57.955767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:57.978541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:57.987714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 100/201] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:00:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:00:57.989183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c1871-2386-4d09-9985-41c9f2799dfa None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:58.039172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaf155-1f10-4564-9db0-171bb9edb3b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:58.040683 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaf155-1f10-4564-9db0-171bb9edb3b2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:58.112532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c1871-2386-4d09-9985-41c9f2799dfa None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:58.149398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe4cff-b184-4c32-b0a1-cf8e10ca2c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:58.150067 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe4cff-b184-4c32-b0a1-cf8e10ca2c72 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:58.150347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe4cff-b184-4c32-b0a1-cf8e10ca2c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:58.150620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe4cff-b184-4c32-b0a1-cf8e10ca2c72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:58.151532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe4cff-b184-4c32-b0a1-cf8e10ca2c72 None admin] RBAC: Adding query filter params (role.id=67ad028192f24536a65fa57450a563b9, scope.project.id=8c47bf06c10644ea84f163d5ea0c1257, user.id=657bc6f8a9e94103a48d2fc9f788ad38) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:58.151841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe4cff-b184-4c32-b0a1-cf8e10ca2c72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:58.153327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe4cff-b184-4c32-b0a1-cf8e10ca2c72 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:58.160139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 101/202] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:00:57 2022] GET /identity/v3/role_assignments?user.id=657bc6f8a9e94103a48d2fc9f788ad38&scope.project.id=8c47bf06c10644ea84f163d5ea0c1257&role.id=67ad028192f24536a65fa57450a563b9 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:58.167713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe4cff-b184-4c32-b0a1-cf8e10ca2c72 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:58.178393 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 102/203] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:00:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:00:58.179534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaf155-1f10-4564-9db0-171bb9edb3b2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:58.250940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:58.284531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:58.316943 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaf155-1f10-4564-9db0-171bb9edb3b2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:58.361979 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6c122-80c2-4d06-99e6-f6ef3929a433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:58.364155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6c122-80c2-4d06-99e6-f6ef3929a433 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:58.364606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6c122-80c2-4d06-99e6-f6ef3929a433 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:58.365023 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6c122-80c2-4d06-99e6-f6ef3929a433 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:58.366540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6c122-80c2-4d06-99e6-f6ef3929a433 None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:58.368926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6c122-80c2-4d06-99e6-f6ef3929a433 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:58.371139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 103/204] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:58 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:58.372167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6c122-80c2-4d06-99e6-f6ef3929a433 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:58.433804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe4cff-b184-4c32-b0a1-cf8e10ca2c72 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:58.506351 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6c122-80c2-4d06-99e6-f6ef3929a433 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:58.510587 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c60a3-c767-4ced-b671-d4ee1ae4afdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:58.510587 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c60a3-c767-4ced-b671-d4ee1ae4afdf None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:58.510931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c60a3-c767-4ced-b671-d4ee1ae4afdf None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:58.511136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c60a3-c767-4ced-b671-d4ee1ae4afdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:58.512011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c60a3-c767-4ced-b671-d4ee1ae4afdf None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8, user.id=ef9685ea41104ef48f0c03c1654dc76e) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:58.512325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c60a3-c767-4ced-b671-d4ee1ae4afdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:58.514140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c60a3-c767-4ced-b671-d4ee1ae4afdf None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:58.521942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 102/205] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:00:58 2022] GET /identity/v3/role_assignments?user.id=ef9685ea41104ef48f0c03c1654dc76e&scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 259 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:58.526688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c60a3-c767-4ced-b671-d4ee1ae4afdf None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:58.554882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:58.590641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6f2d4-31a2-4a3b-a005-d481f8dfb950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:58.592014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6f2d4-31a2-4a3b-a005-d481f8dfb950 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:58.592521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6f2d4-31a2-4a3b-a005-d481f8dfb950 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:58.593003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6f2d4-31a2-4a3b-a005-d481f8dfb950 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:58.594621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6f2d4-31a2-4a3b-a005-d481f8dfb950 None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:58.596527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6f2d4-31a2-4a3b-a005-d481f8dfb950 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:58.602035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 104/206] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:00:58 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:58.603954 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d86a98-bd45-43d9-b804-e870632704a8 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:58.604446 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d86a98-bd45-43d9-b804-e870632704a8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:58.604920 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d86a98-bd45-43d9-b804-e870632704a8 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:58.607042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 105/207] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:58.608274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d86a98-bd45-43d9-b804-e870632704a8 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:58.736771 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c60a3-c767-4ced-b671-d4ee1ae4afdf None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:58.748251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:58.779304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553d83d-3308-4fc1-8e63-1ab1596bfd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:58.780434 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553d83d-3308-4fc1-8e63-1ab1596bfd72 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:58.780977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553d83d-3308-4fc1-8e63-1ab1596bfd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:58.781442 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553d83d-3308-4fc1-8e63-1ab1596bfd72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:58.782497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553d83d-3308-4fc1-8e63-1ab1596bfd72 None admin] RBAC: Adding query filter params (role.id=a6779b95437c46648185d3ce128f658b, scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8, user.id=ef9685ea41104ef48f0c03c1654dc76e) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:58.783315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553d83d-3308-4fc1-8e63-1ab1596bfd72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:58.785025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553d83d-3308-4fc1-8e63-1ab1596bfd72 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:58.791895 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 103/208] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:00:58 2022] GET /identity/v3/role_assignments?user.id=ef9685ea41104ef48f0c03c1654dc76e&scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8&role.id=a6779b95437c46648185d3ce128f658b => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:58.793873 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdca5-0f18-4465-851e-0a9e67d4b29a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:58.794432 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdca5-0f18-4465-851e-0a9e67d4b29a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:58.795048 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdca5-0f18-4465-851e-0a9e67d4b29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:58.797531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d86a98-bd45-43d9-b804-e870632704a8 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:58.815417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-657fdca5-0f18-4465-851e-0a9e67d4b29a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:58.817064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-657fdca5-0f18-4465-851e-0a9e67d4b29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:58.864673 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eb278-3234-46f9-a7fe-ddc2835754b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:58.866160 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eb278-3234-46f9-a7fe-ddc2835754b5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:58.866933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eb278-3234-46f9-a7fe-ddc2835754b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:58.867546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eb278-3234-46f9-a7fe-ddc2835754b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:58.869196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22eb278-3234-46f9-a7fe-ddc2835754b5 None admin] RBAC: Adding query filter params (role.id=cc0b77c0514d4c6294c8d884a4fea9db, scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793, user.id=db5bb33e92fc4329889a74bfcad472f8) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:58.869916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22eb278-3234-46f9-a7fe-ddc2835754b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:58.872753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22eb278-3234-46f9-a7fe-ddc2835754b5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:58.884559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 106/209] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:00:58 2022] GET /identity/v3/role_assignments?user.id=db5bb33e92fc4329889a74bfcad472f8&scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793&role.id=cc0b77c0514d4c6294c8d884a4fea9db => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:58.935545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 104/210] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:00:58.997126 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eb278-3234-46f9-a7fe-ddc2835754b5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:59.115069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:59.182067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eb278-3234-46f9-a7fe-ddc2835754b5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:59.226429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532c4d6-c249-4efd-bcd3-dfeecc25e58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:59.227293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532c4d6-c249-4efd-bcd3-dfeecc25e58a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:59.227576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532c4d6-c249-4efd-bcd3-dfeecc25e58a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:59.227855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532c4d6-c249-4efd-bcd3-dfeecc25e58a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:59.234583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58957944-61b9-40df-8c03-2d32f9a42e06 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:59.235132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58957944-61b9-40df-8c03-2d32f9a42e06 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:59.235566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58957944-61b9-40df-8c03-2d32f9a42e06 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:59.238153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 105/211] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:00:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:00:59.246547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82648572-dab7-4cba-868c-336e677892ae None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:59.247473 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82648572-dab7-4cba-868c-336e677892ae None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:59.248159 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82648572-dab7-4cba-868c-336e677892ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:59.249924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532c4d6-c249-4efd-bcd3-dfeecc25e58a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-9532c4d6-c249-4efd-bcd3-dfeecc25e58a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:00:59.259986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:00:59.261621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:00:59.263151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:00:59.263151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:00:59.263151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:00:59.263151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:00:59.263151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:00:59.263151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:00:59.263151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:00:59.263151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:00:59.263151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:00:59.263151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:00:59.263151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:00:59.263151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:00:59.263151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 107/212] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:00:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:00:59.272417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532c4d6-c249-4efd-bcd3-dfeecc25e58a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:59.297269 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-82648572-dab7-4cba-868c-336e677892ae None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:00:59.298481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-82648572-dab7-4cba-868c-336e677892ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:00:59.383141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 106/213] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:00:59.403910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532c4d6-c249-4efd-bcd3-dfeecc25e58a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:59.418835 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:59.422242 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82648572-dab7-4cba-868c-336e677892ae None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:59.447623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debe912-7e60-45d4-96ae-557ddc5d358c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:59.448330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debe912-7e60-45d4-96ae-557ddc5d358c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:59.448613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debe912-7e60-45d4-96ae-557ddc5d358c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:59.448888 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debe912-7e60-45d4-96ae-557ddc5d358c None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:59.449676 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debe912-7e60-45d4-96ae-557ddc5d358c None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:00:59.449983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debe912-7e60-45d4-96ae-557ddc5d358c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:59.451479 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debe912-7e60-45d4-96ae-557ddc5d358c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:59.462770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 108/214] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:00:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:00:59.468531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debe912-7e60-45d4-96ae-557ddc5d358c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:59.504177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:59.580818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debe912-7e60-45d4-96ae-557ddc5d358c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:59.594314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82648572-dab7-4cba-868c-336e677892ae None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:59.623475 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29b687-b666-4f32-ae22-ee168ffa55cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:59.624380 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b687-b666-4f32-ae22-ee168ffa55cc None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:59.624659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b687-b666-4f32-ae22-ee168ffa55cc None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:59.624936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b687-b666-4f32-ae22-ee168ffa55cc None admin] PATH_INFO: `/v3/users/2314242c8606451e87f5ac6d4fd3e9ca` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:59.636577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8853b-52bf-4c4b-8b07-3fe726a70c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:59.637012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8853b-52bf-4c4b-8b07-3fe726a70c2e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:59.637331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8853b-52bf-4c4b-8b07-3fe726a70c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:59.637674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8853b-52bf-4c4b-8b07-3fe726a70c2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:59.638975 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8853b-52bf-4c4b-8b07-3fe726a70c2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:59.639989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29b687-b666-4f32-ae22-ee168ffa55cc None admin] RBAC: Authorizing `identity:get_user(user_id=2314242c8606451e87f5ac6d4fd3e9ca)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:59.640637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8853b-52bf-4c4b-8b07-3fe726a70c2e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:59.641471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29b687-b666-4f32-ae22-ee168ffa55cc None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:59.642646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 107/215] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:00:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:59.643740 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 109/216] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:00:59 2022] GET /identity/v3/users/2314242c8606451e87f5ac6d4fd3e9ca => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:00:59.650202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29b687-b666-4f32-ae22-ee168ffa55cc None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:59.650743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8853b-52bf-4c4b-8b07-3fe726a70c2e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:00:59.687684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:59.806851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29b687-b666-4f32-ae22-ee168ffa55cc None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:59.856149 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:00:59.862356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8853b-52bf-4c4b-8b07-3fe726a70c2e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:00:59.874046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ec9a4-e408-4b74-b5ad-086abdd26e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:59.875156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ec9a4-e408-4b74-b5ad-086abdd26e1b None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:59.875628 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ec9a4-e408-4b74-b5ad-086abdd26e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:59.876090 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ec9a4-e408-4b74-b5ad-086abdd26e1b None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:00:59.877420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ec9a4-e408-4b74-b5ad-086abdd26e1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:00:59.879815 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ec9a4-e408-4b74-b5ad-086abdd26e1b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:00:59.922825 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 110/217] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:00:59 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:00:59.928793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e59943-65b5-4b68-a7ed-06c34f2964f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:00:59.929828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e59943-65b5-4b68-a7ed-06c34f2964f5 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:00:59.930291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e59943-65b5-4b68-a7ed-06c34f2964f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:00:59.930787 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e59943-65b5-4b68-a7ed-06c34f2964f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:00.063993 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e59943-65b5-4b68-a7ed-06c34f2964f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:00.067088 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e59943-65b5-4b68-a7ed-06c34f2964f5 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:00.190405 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:00.195102 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 108/218] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:00:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:00.204510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ec9a4-e408-4b74-b5ad-086abdd26e1b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:00.318749 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:00.335701 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ec9a4-e408-4b74-b5ad-086abdd26e1b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:00.382173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93666eb2-9bcc-46ea-aee0-41dd1224b695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:00.383663 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93666eb2-9bcc-46ea-aee0-41dd1224b695 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:00.383954 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93666eb2-9bcc-46ea-aee0-41dd1224b695 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:00.384219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93666eb2-9bcc-46ea-aee0-41dd1224b695 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:00.385579 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93666eb2-9bcc-46ea-aee0-41dd1224b695 None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:00.387458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93666eb2-9bcc-46ea-aee0-41dd1224b695 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:00.389485 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 111/219] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:00 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:00.395559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e59943-65b5-4b68-a7ed-06c34f2964f5 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:00.523847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e59943-65b5-4b68-a7ed-06c34f2964f5 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:00.574237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ed4f8-59e1-4692-8ca1-8ffb6eeb2169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:00.574988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed4f8-59e1-4692-8ca1-8ffb6eeb2169 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:00.575272 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed4f8-59e1-4692-8ca1-8ffb6eeb2169 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:00.575552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed4f8-59e1-4692-8ca1-8ffb6eeb2169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:00.576445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ed4f8-59e1-4692-8ca1-8ffb6eeb2169 None admin] RBAC: Adding query filter params (role.id=67ad028192f24536a65fa57450a563b9, scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8, user.id=2314242c8606451e87f5ac6d4fd3e9ca) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:00.576757 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ed4f8-59e1-4692-8ca1-8ffb6eeb2169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:00.578986 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ed4f8-59e1-4692-8ca1-8ffb6eeb2169 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:00.586748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 109/220] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:01:00 2022] GET /identity/v3/role_assignments?user.id=2314242c8606451e87f5ac6d4fd3e9ca&scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8&role.id=67ad028192f24536a65fa57450a563b9 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:01.031541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5042-aae5-4850-9e22-90565f3345f2 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:01.031819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5042-aae5-4850-9e22-90565f3345f2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:01.032091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5042-aae5-4850-9e22-90565f3345f2 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:01.033587 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 112/221] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:01:01.040515 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a1dec-d6c4-48fd-8b9b-00377d097ea1 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:01.040850 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a1dec-d6c4-48fd-8b9b-00377d097ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:01.041078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a1dec-d6c4-48fd-8b9b-00377d097ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:01.067951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-cb2a1dec-d6c4-48fd-8b9b-00377d097ea1 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:01.069188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-cb2a1dec-d6c4-48fd-8b9b-00377d097ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:01.154184 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:01.172460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 110/222] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:01.206463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5042-aae5-4850-9e22-90565f3345f2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:01.370743 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5042-aae5-4850-9e22-90565f3345f2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:01.418801 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46279a-7b67-4dbf-bdd6-59c35a104c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:01.419629 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46279a-7b67-4dbf-bdd6-59c35a104c19 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:01.419908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46279a-7b67-4dbf-bdd6-59c35a104c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:01.420182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46279a-7b67-4dbf-bdd6-59c35a104c19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:01.455595 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46279a-7b67-4dbf-bdd6-59c35a104c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-7a46279a-7b67-4dbf-bdd6-59c35a104c19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:01.463473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:01.465201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:01.466823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:01.466823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:01.466823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:01.466823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:01.466823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:01.466823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:01.466823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:01.466823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:01.466823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:01.466823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:01.466823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:01:01.466823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:01.466823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 113/223] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:01:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:01.474934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a1dec-d6c4-48fd-8b9b-00377d097ea1 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:01.714160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a1dec-d6c4-48fd-8b9b-00377d097ea1 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:01.798124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798a989-deb2-4b17-8a67-aaa80769d533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:01.799890 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798a989-deb2-4b17-8a67-aaa80769d533 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:01.800870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798a989-deb2-4b17-8a67-aaa80769d533 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:01.801573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798a989-deb2-4b17-8a67-aaa80769d533 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:01.803331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798a989-deb2-4b17-8a67-aaa80769d533 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:01.804209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798a989-deb2-4b17-8a67-aaa80769d533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:01.807217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798a989-deb2-4b17-8a67-aaa80769d533 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:01.828945 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 111/224] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:01.831029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1178-2eb5-44b0-96fc-db0de1f72d52 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:01.831177 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1178-2eb5-44b0-96fc-db0de1f72d52 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:01.831530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1178-2eb5-44b0-96fc-db0de1f72d52 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:01.833069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 114/225] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:01.835264 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798a989-deb2-4b17-8a67-aaa80769d533 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:01.838600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad9532-b76b-414e-bb59-a7e0e674c84c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:01.838909 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad9532-b76b-414e-bb59-a7e0e674c84c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:01.839184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad9532-b76b-414e-bb59-a7e0e674c84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:01.883865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d7ad9532-b76b-414e-bb59-a7e0e674c84c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:01.885848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d7ad9532-b76b-414e-bb59-a7e0e674c84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:01.929853 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:01.988548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:02.051504 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 115/226] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:02.089822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798a989-deb2-4b17-8a67-aaa80769d533 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:02.096972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad9532-b76b-414e-bb59-a7e0e674c84c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:02.159805 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0aa9f-c329-4608-b77f-c1e56ace024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:02.160723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0aa9f-c329-4608-b77f-c1e56ace024d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:02.161007 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0aa9f-c329-4608-b77f-c1e56ace024d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:02.161287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0aa9f-c329-4608-b77f-c1e56ace024d None admin] PATH_INFO: `/v3/users/ef9685ea41104ef48f0c03c1654dc76e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:02.163547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0aa9f-c329-4608-b77f-c1e56ace024d None admin] RBAC: Authorizing `identity:get_user(user_id=ef9685ea41104ef48f0c03c1654dc76e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:02.165057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0aa9f-c329-4608-b77f-c1e56ace024d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:02.167073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 112/227] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:01 2022] GET /identity/v3/users/ef9685ea41104ef48f0c03c1654dc76e => generated 283 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:02.184268 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0aa9f-c329-4608-b77f-c1e56ace024d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:02.312050 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad9532-b76b-414e-bb59-a7e0e674c84c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:02.357629 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda644e7-4b50-445c-a8dd-de4216f081a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:02.359093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda644e7-4b50-445c-a8dd-de4216f081a4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:02.359576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda644e7-4b50-445c-a8dd-de4216f081a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:02.360039 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda644e7-4b50-445c-a8dd-de4216f081a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:02.383555 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda644e7-4b50-445c-a8dd-de4216f081a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-dda644e7-4b50-445c-a8dd-de4216f081a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:02.393977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:02.394939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:02.395722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:02.395722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:02.395722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:02.395722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:02.395722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:02.395722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:02.395722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:02.395722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:02.395722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:02.395722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:02.395722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:02.395722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:02.407581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 116/228] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:01:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:02.413963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda644e7-4b50-445c-a8dd-de4216f081a4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:02.431352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0aa9f-c329-4608-b77f-c1e56ace024d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:02.433773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:02.472031 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:02.494698 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fabd31-9cfb-4f97-ab85-0191806d283e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:02.495663 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fabd31-9cfb-4f97-ab85-0191806d283e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:02.496013 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fabd31-9cfb-4f97-ab85-0191806d283e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:02.496146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fabd31-9cfb-4f97-ab85-0191806d283e None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:02.500987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fabd31-9cfb-4f97-ab85-0191806d283e None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:02.502539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fabd31-9cfb-4f97-ab85-0191806d283e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:02.510218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 113/229] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:02 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:02.516823 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fabd31-9cfb-4f97-ab85-0191806d283e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:02.655584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda644e7-4b50-445c-a8dd-de4216f081a4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:02.737175 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fabd31-9cfb-4f97-ab85-0191806d283e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:02.740436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1089eb-3aad-43f8-b4b2-221258e03318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:02.741207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1089eb-3aad-43f8-b4b2-221258e03318 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:02.741492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1089eb-3aad-43f8-b4b2-221258e03318 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:02.741770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1089eb-3aad-43f8-b4b2-221258e03318 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:02.742698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1089eb-3aad-43f8-b4b2-221258e03318 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:02.743198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1089eb-3aad-43f8-b4b2-221258e03318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:02.744636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1089eb-3aad-43f8-b4b2-221258e03318 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:02.763193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 117/230] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:02.769440 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1089eb-3aad-43f8-b4b2-221258e03318 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:02.831871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f261cb6-bfe8-4b24-a946-adb7bfcd7a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:02.832860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f261cb6-bfe8-4b24-a946-adb7bfcd7a90 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:02.833144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f261cb6-bfe8-4b24-a946-adb7bfcd7a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:02.833406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f261cb6-bfe8-4b24-a946-adb7bfcd7a90 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8/users/ef9685ea41104ef48f0c03c1654dc76e/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:02.837342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f261cb6-bfe8-4b24-a946-adb7bfcd7a90 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8968618a5b8461fbd567cb7fdbd05b8, user_id=ef9685ea41104ef48f0c03c1654dc76e, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:02.838955 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f261cb6-bfe8-4b24-a946-adb7bfcd7a90 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:02.862686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 114/231] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:01:02 2022] PUT /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8/users/ef9685ea41104ef48f0c03c1654dc76e/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:01:02.884983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:02.928319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1089eb-3aad-43f8-b4b2-221258e03318 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:02.972009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef296d-95f2-4419-8740-f28d56698cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:02.973378 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef296d-95f2-4419-8740-f28d56698cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:02.973898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef296d-95f2-4419-8740-f28d56698cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:02.974427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef296d-95f2-4419-8740-f28d56698cd1 None admin] PATH_INFO: `/v3/users/ef9685ea41104ef48f0c03c1654dc76e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:02.977038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef296d-95f2-4419-8740-f28d56698cd1 None admin] RBAC: Authorizing `identity:get_user(user_id=ef9685ea41104ef48f0c03c1654dc76e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:02.978391 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef296d-95f2-4419-8740-f28d56698cd1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:02.980226 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 118/232] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:02 2022] GET /identity/v3/users/ef9685ea41104ef48f0c03c1654dc76e => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:02.988205 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f261cb6-bfe8-4b24-a946-adb7bfcd7a90 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:03.071241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:03.135359 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f261cb6-bfe8-4b24-a946-adb7bfcd7a90 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:03.184436 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5cfae-4aa2-4bfd-85ca-c6d15790f03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:03.185239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5cfae-4aa2-4bfd-85ca-c6d15790f03a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:03.185557 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5cfae-4aa2-4bfd-85ca-c6d15790f03a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:03.185833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5cfae-4aa2-4bfd-85ca-c6d15790f03a None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:03.188377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5cfae-4aa2-4bfd-85ca-c6d15790f03a None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:03.189918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5cfae-4aa2-4bfd-85ca-c6d15790f03a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:03.191901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 115/233] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:02 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:03.194838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd9d44-b81e-4569-b754-059dd2272952 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:03.195141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd9d44-b81e-4569-b754-059dd2272952 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:03.195391 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd9d44-b81e-4569-b754-059dd2272952 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:03.196811 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 119/234] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:03.202335 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5cfae-4aa2-4bfd-85ca-c6d15790f03a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:03.222066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df939b4-1ce1-4615-b405-b2e5b3cc1359 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:03.222491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df939b4-1ce1-4615-b405-b2e5b3cc1359 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:03.222692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df939b4-1ce1-4615-b405-b2e5b3cc1359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:03.246168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0df939b4-1ce1-4615-b405-b2e5b3cc1359 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:03.247799 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0df939b4-1ce1-4615-b405-b2e5b3cc1359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:03.349631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 120/235] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:03.396244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df939b4-1ce1-4615-b405-b2e5b3cc1359 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:03.411037 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5cfae-4aa2-4bfd-85ca-c6d15790f03a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:03.480243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:03.527239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbb9e5-cd52-42ce-ba01-2391ea5a89f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:03.529984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbb9e5-cd52-42ce-ba01-2391ea5a89f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:03.533425 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbb9e5-cd52-42ce-ba01-2391ea5a89f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:03.534283 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbb9e5-cd52-42ce-ba01-2391ea5a89f0 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8/users/ef9685ea41104ef48f0c03c1654dc76e/roles/a6779b95437c46648185d3ce128f658b` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:03.545200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbb9e5-cd52-42ce-ba01-2391ea5a89f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8968618a5b8461fbd567cb7fdbd05b8, user_id=ef9685ea41104ef48f0c03c1654dc76e, role_id=a6779b95437c46648185d3ce128f658b)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:03.548410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbb9e5-cd52-42ce-ba01-2391ea5a89f0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:03.589474 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 116/236] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:01:03 2022] PUT /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8/users/ef9685ea41104ef48f0c03c1654dc76e/roles/a6779b95437c46648185d3ce128f658b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:01:03.594743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61392475-8943-432e-88d5-536a046b54fc None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:03.594989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:03.595108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61392475-8943-432e-88d5-536a046b54fc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:03.595108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61392475-8943-432e-88d5-536a046b54fc None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:03.595108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 117/237] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:03.600838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40739ac-bc5e-471b-b061-fb9ebb24d4a9 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:03.601151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40739ac-bc5e-471b-b061-fb9ebb24d4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:03.601460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40739ac-bc5e-471b-b061-fb9ebb24d4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:03.622312 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a40739ac-bc5e-471b-b061-fb9ebb24d4a9 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:03.627072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a40739ac-bc5e-471b-b061-fb9ebb24d4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:03.684688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df939b4-1ce1-4615-b405-b2e5b3cc1359 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:03.717223 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 118/238] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:03.721197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18420e-6555-4cfb-9674-3644b7fffc38 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:03.726804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18420e-6555-4cfb-9674-3644b7fffc38 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:03.726804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18420e-6555-4cfb-9674-3644b7fffc38 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:03.732125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 119/239] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:03 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:03.744050 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a88e3-e66c-44a4-82b7-0b9948fab025 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:03.744677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a88e3-e66c-44a4-82b7-0b9948fab025 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:03.745282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a88e3-e66c-44a4-82b7-0b9948fab025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:03.759423 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd46ef-bd7b-46d0-a58f-18276f0edc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:03.760257 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd46ef-bd7b-46d0-a58f-18276f0edc8c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:03.760537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd46ef-bd7b-46d0-a58f-18276f0edc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:03.760807 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd46ef-bd7b-46d0-a58f-18276f0edc8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:03.776065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd46ef-bd7b-46d0-a58f-18276f0edc8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:03.776965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c18a88e3-e66c-44a4-82b7-0b9948fab025 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:03.779107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c18a88e3-e66c-44a4-82b7-0b9948fab025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-6cdd46ef-bd7b-46d0-a58f-18276f0edc8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:03.784505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:03.786364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:03.788010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:03.788010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:03.788010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:03.788010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:03.788010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:03.788010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:03.788010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:03.788010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:03.788010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:03.788010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:03.788010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:03.788010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:03.788010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 121/240] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:01:03.789176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd46ef-bd7b-46d0-a58f-18276f0edc8c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:03.926647 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 120/241] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:03.927807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a88e3-e66c-44a4-82b7-0b9948fab025 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:03.938588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd46ef-bd7b-46d0-a58f-18276f0edc8c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:04.000907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:04.007337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78399f60-0f7b-436e-b4fd-d7e05ad9b292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:04.008364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78399f60-0f7b-436e-b4fd-d7e05ad9b292 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:04.008691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78399f60-0f7b-436e-b4fd-d7e05ad9b292 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:04.009014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78399f60-0f7b-436e-b4fd-d7e05ad9b292 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:04.022334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:04.025610 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78399f60-0f7b-436e-b4fd-d7e05ad9b292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-78399f60-0f7b-436e-b4fd-d7e05ad9b292 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:04.041614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:04.044143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:04.047099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:04.047099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:04.047099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:04.047099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:04.047099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:04.047099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:04.047099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:04.047099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:04.047099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:04.047099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:04.047099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:01:04.047099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:04.047099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 122/242] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:04.054697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78399f60-0f7b-436e-b4fd-d7e05ad9b292 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:04.138530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a88e3-e66c-44a4-82b7-0b9948fab025 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:04.181268 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78399f60-0f7b-436e-b4fd-d7e05ad9b292 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:04.201961 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca4500-6276-4b07-bc53-b68ad2ed573a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:04.203660 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca4500-6276-4b07-bc53-b68ad2ed573a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:04.204278 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca4500-6276-4b07-bc53-b68ad2ed573a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:04.204917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca4500-6276-4b07-bc53-b68ad2ed573a None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:04.206465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca4500-6276-4b07-bc53-b68ad2ed573a None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:04.207152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca4500-6276-4b07-bc53-b68ad2ed573a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:04.209833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca4500-6276-4b07-bc53-b68ad2ed573a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:04.225291 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245515bf-f9ef-4e60-8740-d050d663bcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:04.225956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 121/243] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:04.226129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245515bf-f9ef-4e60-8740-d050d663bcea None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:04.226442 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245515bf-f9ef-4e60-8740-d050d663bcea None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:04.226752 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245515bf-f9ef-4e60-8740-d050d663bcea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:04.228012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca4500-6276-4b07-bc53-b68ad2ed573a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:04.228178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245515bf-f9ef-4e60-8740-d050d663bcea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:04.229746 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245515bf-f9ef-4e60-8740-d050d663bcea None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:04.231512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 123/244] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:04.237113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245515bf-f9ef-4e60-8740-d050d663bcea None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:04.295284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:04.344571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245515bf-f9ef-4e60-8740-d050d663bcea None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:04.382212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86be84-2291-4db2-bfe4-1ff3f82317eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:04.383389 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86be84-2291-4db2-bfe4-1ff3f82317eb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:04.383649 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86be84-2291-4db2-bfe4-1ff3f82317eb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:04.383909 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86be84-2291-4db2-bfe4-1ff3f82317eb None admin] PATH_INFO: `/v3/users/2314242c8606451e87f5ac6d4fd3e9ca` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:04.385149 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86be84-2291-4db2-bfe4-1ff3f82317eb None admin] RBAC: Authorizing `identity:get_user(user_id=2314242c8606451e87f5ac6d4fd3e9ca)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:04.386638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86be84-2291-4db2-bfe4-1ff3f82317eb None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:04.388853 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 124/245] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:04 2022] GET /identity/v3/users/2314242c8606451e87f5ac6d4fd3e9ca => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:04.389669 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86be84-2291-4db2-bfe4-1ff3f82317eb None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:04.417140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca4500-6276-4b07-bc53-b68ad2ed573a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:04.420915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:04.477579 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655995b3-2d98-452a-95db-35527e3fda44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:04.478486 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655995b3-2d98-452a-95db-35527e3fda44 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:04.478884 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655995b3-2d98-452a-95db-35527e3fda44 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:04.479251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655995b3-2d98-452a-95db-35527e3fda44 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:04.480141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655995b3-2d98-452a-95db-35527e3fda44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:04.480824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655995b3-2d98-452a-95db-35527e3fda44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:04.482039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655995b3-2d98-452a-95db-35527e3fda44 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:04.497189 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 122/246] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:04.498391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655995b3-2d98-452a-95db-35527e3fda44 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:04.573361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86be84-2291-4db2-bfe4-1ff3f82317eb None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:04.624107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655995b3-2d98-452a-95db-35527e3fda44 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:04.626126 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:04.650112 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9548df6-7b24-4b2c-85b6-b8e2c0ddf2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:04.651774 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9548df6-7b24-4b2c-85b6-b8e2c0ddf2ee None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:04.652513 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9548df6-7b24-4b2c-85b6-b8e2c0ddf2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:04.653189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9548df6-7b24-4b2c-85b6-b8e2c0ddf2ee None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:04.654816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9548df6-7b24-4b2c-85b6-b8e2c0ddf2ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:04.657827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9548df6-7b24-4b2c-85b6-b8e2c0ddf2ee None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:04.667175 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e66f-3d52-4f78-b590-2cb2322474a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:04.668307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e66f-3d52-4f78-b590-2cb2322474a7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:04.668687 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e66f-3d52-4f78-b590-2cb2322474a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:04.669057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e66f-3d52-4f78-b590-2cb2322474a7 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:04.670512 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4e66f-3d52-4f78-b590-2cb2322474a7 None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:04.672146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4e66f-3d52-4f78-b590-2cb2322474a7 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:04.674305 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 123/247] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:04 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:04.675757 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e66f-3d52-4f78-b590-2cb2322474a7 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:04.695558 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 125/248] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:01:04 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:01:04.697450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9548df6-7b24-4b2c-85b6-b8e2c0ddf2ee None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:04.751214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:04.931958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e66f-3d52-4f78-b590-2cb2322474a7 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:04.962311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9548df6-7b24-4b2c-85b6-b8e2c0ddf2ee None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:04.990869 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b8ed0-46e7-4dc2-871d-66f19e32c21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:04.992629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b8ed0-46e7-4dc2-871d-66f19e32c21c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:04.993354 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b8ed0-46e7-4dc2-871d-66f19e32c21c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:04.994027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b8ed0-46e7-4dc2-871d-66f19e32c21c None admin] PATH_INFO: `/v3/users/34d2d17f9cb848d0bd925b9d8bbb5287` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:05.000945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909fa4b-d671-44d9-847e-0e4628c35520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:05.000945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909fa4b-d671-44d9-847e-0e4628c35520 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:05.001301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909fa4b-d671-44d9-847e-0e4628c35520 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:05.001685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909fa4b-d671-44d9-847e-0e4628c35520 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8/users/2314242c8606451e87f5ac6d4fd3e9ca/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:05.004784 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909fa4b-d671-44d9-847e-0e4628c35520 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8968618a5b8461fbd567cb7fdbd05b8, user_id=2314242c8606451e87f5ac6d4fd3e9ca, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:05.006348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909fa4b-d671-44d9-847e-0e4628c35520 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:05.027461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 126/249] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:01:04 2022] PUT /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8/users/2314242c8606451e87f5ac6d4fd3e9ca/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:01:05.028246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b8ed0-46e7-4dc2-871d-66f19e32c21c None admin] RBAC: Authorizing `identity:get_user(user_id=34d2d17f9cb848d0bd925b9d8bbb5287)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:05.029738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b8ed0-46e7-4dc2-871d-66f19e32c21c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:05.031946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 124/250] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:04 2022] GET /identity/v3/users/34d2d17f9cb848d0bd925b9d8bbb5287 => generated 297 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:05.037818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909fa4b-d671-44d9-847e-0e4628c35520 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:05.103227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:05.179835 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909fa4b-d671-44d9-847e-0e4628c35520 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:05.225950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c7352-917e-43d2-be11-c80ac1cdfc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:05.226553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c7352-917e-43d2-be11-c80ac1cdfc3c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:05.226874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c7352-917e-43d2-be11-c80ac1cdfc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:05.227627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c7352-917e-43d2-be11-c80ac1cdfc3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:05.385113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c7352-917e-43d2-be11-c80ac1cdfc3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:05.388126 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c7352-917e-43d2-be11-c80ac1cdfc3c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:05.476862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:05.596301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 127/251] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 12:01:05.604165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b8ed0-46e7-4dc2-871d-66f19e32c21c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:05.761057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:05.776727 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b8ed0-46e7-4dc2-871d-66f19e32c21c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:05.825330 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611e552-0707-408f-a1f7-ff33fa9adad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:05.826233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611e552-0707-408f-a1f7-ff33fa9adad0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:05.826520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611e552-0707-408f-a1f7-ff33fa9adad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:05.831003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611e552-0707-408f-a1f7-ff33fa9adad0 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:05.832652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611e552-0707-408f-a1f7-ff33fa9adad0 None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:05.834173 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611e552-0707-408f-a1f7-ff33fa9adad0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:05.836403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 125/252] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:05 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:05.844552 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c7352-917e-43d2-be11-c80ac1cdfc3c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:06.066857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c7352-917e-43d2-be11-c80ac1cdfc3c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:06.131505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a35c5-5759-44a4-a51b-2e0856703eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:06.132616 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a35c5-5759-44a4-a51b-2e0856703eda None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:06.133101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a35c5-5759-44a4-a51b-2e0856703eda None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:06.133566 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a35c5-5759-44a4-a51b-2e0856703eda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:06.135215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a35c5-5759-44a4-a51b-2e0856703eda None admin] RBAC: Adding query filter params (role.id=cc0b77c0514d4c6294c8d884a4fea9db, scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8, user.id=34d2d17f9cb848d0bd925b9d8bbb5287) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:06.135783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a35c5-5759-44a4-a51b-2e0856703eda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:06.138562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a35c5-5759-44a4-a51b-2e0856703eda None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:06.149662 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 128/253] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:01:05 2022] GET /identity/v3/role_assignments?user.id=34d2d17f9cb848d0bd925b9d8bbb5287&scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8&role.id=cc0b77c0514d4c6294c8d884a4fea9db => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:06.252197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228aa36-4d8a-45fa-bff2-51c4ab036364 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:06.252578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228aa36-4d8a-45fa-bff2-51c4ab036364 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:06.252846 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228aa36-4d8a-45fa-bff2-51c4ab036364 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:06.255145 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 126/254] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:06.268471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d0e35-0cea-4bf4-9714-7a6330d8b52c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:06.268910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d0e35-0cea-4bf4-9714-7a6330d8b52c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:06.269614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d0e35-0cea-4bf4-9714-7a6330d8b52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:06.280969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:06.306750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0c3d0e35-0cea-4bf4-9714-7a6330d8b52c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:06.308877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0c3d0e35-0cea-4bf4-9714-7a6330d8b52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:06.453988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 129/255] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:06.482631 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228aa36-4d8a-45fa-bff2-51c4ab036364 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:06.599622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228aa36-4d8a-45fa-bff2-51c4ab036364 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:06.638058 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac0e35-0201-40d5-8e21-7acf52389a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:06.638910 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0e35-0201-40d5-8e21-7acf52389a49 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:06.639195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0e35-0201-40d5-8e21-7acf52389a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:06.639471 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0e35-0201-40d5-8e21-7acf52389a49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:06.650972 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac0e35-0201-40d5-8e21-7acf52389a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-80ac0e35-0201-40d5-8e21-7acf52389a49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:06.659124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:06.660071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:06.660847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:06.660847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:06.660847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:06.660847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:06.660847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:06.660847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:06.660847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:06.660847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:06.660847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:06.660847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:06.660847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:01:06.660847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:06.665482 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 127/256] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:01:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:06.667016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d0e35-0cea-4bf4-9714-7a6330d8b52c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:06.799618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d0e35-0cea-4bf4-9714-7a6330d8b52c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:06.838770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:06.844188 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6272a-aa9d-431f-838e-4567903b23d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:06.844888 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6272a-aa9d-431f-838e-4567903b23d3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:06.845213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6272a-aa9d-431f-838e-4567903b23d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:06.845486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6272a-aa9d-431f-838e-4567903b23d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:06.846271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6272a-aa9d-431f-838e-4567903b23d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:06.846584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6272a-aa9d-431f-838e-4567903b23d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:06.852383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6272a-aa9d-431f-838e-4567903b23d3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:06.862887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 130/257] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:06.868704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac0e35-0201-40d5-8e21-7acf52389a49 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:06.899064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:07.005992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac0e35-0201-40d5-8e21-7acf52389a49 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:07.053966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78384b5d-63ae-4a8b-97b4-aead18fca2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:07.054828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384b5d-63ae-4a8b-97b4-aead18fca2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:07.055115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384b5d-63ae-4a8b-97b4-aead18fca2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:07.055394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384b5d-63ae-4a8b-97b4-aead18fca2d8 None admin] PATH_INFO: `/v3/users/ef9685ea41104ef48f0c03c1654dc76e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:07.056697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78384b5d-63ae-4a8b-97b4-aead18fca2d8 None admin] RBAC: Authorizing `identity:get_user(user_id=ef9685ea41104ef48f0c03c1654dc76e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:07.058173 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78384b5d-63ae-4a8b-97b4-aead18fca2d8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:07.064623 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 128/258] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:06 2022] GET /identity/v3/users/ef9685ea41104ef48f0c03c1654dc76e => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:07.072203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6272a-aa9d-431f-838e-4567903b23d3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:07.126943 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ac2bd-0ebb-4637-8250-13fa9a822ea0 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:07.127278 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ac2bd-0ebb-4637-8250-13fa9a822ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:07.127507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ac2bd-0ebb-4637-8250-13fa9a822ea0 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:07.128928 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 129/259] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:01:07.139656 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237707a-b8a1-4c53-8c55-c1f19cc07296 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:07.140334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237707a-b8a1-4c53-8c55-c1f19cc07296 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:07.140801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237707a-b8a1-4c53-8c55-c1f19cc07296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:07.167737 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9237707a-b8a1-4c53-8c55-c1f19cc07296 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:07.169304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9237707a-b8a1-4c53-8c55-c1f19cc07296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:07.238622 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6272a-aa9d-431f-838e-4567903b23d3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:07.306793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 130/260] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:07.309392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0c144-5c51-4a86-ad4d-24575768630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:07.310188 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0c144-5c51-4a86-ad4d-24575768630c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:07.310541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0c144-5c51-4a86-ad4d-24575768630c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:07.310971 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0c144-5c51-4a86-ad4d-24575768630c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:07.397610 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237707a-b8a1-4c53-8c55-c1f19cc07296 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:07.410446 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0c144-5c51-4a86-ad4d-24575768630c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:07.412120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0c144-5c51-4a86-ad4d-24575768630c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:07.418795 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:07.434691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:07.540201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237707a-b8a1-4c53-8c55-c1f19cc07296 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:07.587396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098930a-f329-4dfd-bfd8-465a8b547b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:07.588150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098930a-f329-4dfd-bfd8-465a8b547b52 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:07.588434 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098930a-f329-4dfd-bfd8-465a8b547b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:07.589742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098930a-f329-4dfd-bfd8-465a8b547b52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:07.610409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098930a-f329-4dfd-bfd8-465a8b547b52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-a098930a-f329-4dfd-bfd8-465a8b547b52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:07.623152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:07.624096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:07.624954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:07.624954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:07.624954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:07.624954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:07.624954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:07.624954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:07.624954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:07.624954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:07.624954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:07.624954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:07.624954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:07.624954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:07.625701 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 131/261] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:01:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:01:07.629509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 131/262] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 12:01:07.634476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098930a-f329-4dfd-bfd8-465a8b547b52 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:07.640829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0c144-5c51-4a86-ad4d-24575768630c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:07.785458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:07.822886 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098930a-f329-4dfd-bfd8-465a8b547b52 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:07.850404 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:07.882686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0c144-5c51-4a86-ad4d-24575768630c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:07.891467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c4770-be62-413c-b9bd-5f262c478cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:07.892875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c4770-be62-413c-b9bd-5f262c478cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:07.893333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c4770-be62-413c-b9bd-5f262c478cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:07.893776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c4770-be62-413c-b9bd-5f262c478cc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:07.894799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c4770-be62-413c-b9bd-5f262c478cc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:07.895287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c4770-be62-413c-b9bd-5f262c478cc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:07.896890 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c4770-be62-413c-b9bd-5f262c478cc9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:07.906479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 132/263] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:07.916200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c4770-be62-413c-b9bd-5f262c478cc9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:07.965996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572e23d-c0cc-443f-a688-2c38fd186a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:07.966999 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572e23d-c0cc-443f-a688-2c38fd186a2b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:07.967320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572e23d-c0cc-443f-a688-2c38fd186a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:07.967609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572e23d-c0cc-443f-a688-2c38fd186a2b None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:07.968866 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572e23d-c0cc-443f-a688-2c38fd186a2b None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:07.970445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572e23d-c0cc-443f-a688-2c38fd186a2b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:07.980721 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 132/264] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:07 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:07.986935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572e23d-c0cc-443f-a688-2c38fd186a2b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:08.084284 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c4770-be62-413c-b9bd-5f262c478cc9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:08.182318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54b923-68c1-40cb-9655-ce3740db364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:08.184215 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54b923-68c1-40cb-9655-ce3740db364e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:08.184721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54b923-68c1-40cb-9655-ce3740db364e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:08.185217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54b923-68c1-40cb-9655-ce3740db364e None admin] PATH_INFO: `/v3/users/ef9685ea41104ef48f0c03c1654dc76e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:08.187778 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54b923-68c1-40cb-9655-ce3740db364e None admin] RBAC: Authorizing `identity:get_user(user_id=ef9685ea41104ef48f0c03c1654dc76e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:08.190543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54b923-68c1-40cb-9655-ce3740db364e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:08.201951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 133/265] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:07 2022] GET /identity/v3/users/ef9685ea41104ef48f0c03c1654dc76e => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:08.212834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54b923-68c1-40cb-9655-ce3740db364e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:08.239709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:08.287498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572e23d-c0cc-443f-a688-2c38fd186a2b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:08.380543 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e0957-0597-4475-9f64-51c29652f3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:08.381279 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e0957-0597-4475-9f64-51c29652f3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:08.381620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e0957-0597-4475-9f64-51c29652f3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:08.381904 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e0957-0597-4475-9f64-51c29652f3c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:08.382854 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e0957-0597-4475-9f64-51c29652f3c5 None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8, user.id=ef9685ea41104ef48f0c03c1654dc76e) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:08.383172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e0957-0597-4475-9f64-51c29652f3c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:08.384658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e0957-0597-4475-9f64-51c29652f3c5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:08.390479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54b923-68c1-40cb-9655-ce3740db364e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:08.401171 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 133/266] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:01:07 2022] GET /identity/v3/role_assignments?user.id=ef9685ea41104ef48f0c03c1654dc76e&scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 608 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:08.454963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe3335-5ed2-4135-96f2-729d1354e59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:08.455882 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe3335-5ed2-4135-96f2-729d1354e59b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:08.456168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe3335-5ed2-4135-96f2-729d1354e59b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:08.456446 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe3335-5ed2-4135-96f2-729d1354e59b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:08.534260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c7592-3c7a-4d87-a166-bf8cc257658e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:08.534794 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c7592-3c7a-4d87-a166-bf8cc257658e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:08.535246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c7592-3c7a-4d87-a166-bf8cc257658e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:08.538216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 134/267] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:08.545810 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe3335-5ed2-4135-96f2-729d1354e59b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:08.547416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe3335-5ed2-4135-96f2-729d1354e59b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:08.547801 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5130d8d-033a-4206-8590-1f41e3ab59a2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:08.548387 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5130d8d-033a-4206-8590-1f41e3ab59a2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:08.548847 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5130d8d-033a-4206-8590-1f41e3ab59a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:08.557254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:08.599695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a5130d8d-033a-4206-8590-1f41e3ab59a2 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:08.601868 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a5130d8d-033a-4206-8590-1f41e3ab59a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:08.679349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:08.749119 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 135/268] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:08.753633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266365b6-e993-4689-9703-099c26c8ef1d None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:08.753924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266365b6-e993-4689-9703-099c26c8ef1d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:08.754266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266365b6-e993-4689-9703-099c26c8ef1d None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:08.756703 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 136/269] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:08.761453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b46359-f744-4d57-bd13-91b32471ef07 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:08.761868 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b46359-f744-4d57-bd13-91b32471ef07 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:08.762249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b46359-f744-4d57-bd13-91b32471ef07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:08.773035 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 134/270] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 12:01:08.778693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe3335-5ed2-4135-96f2-729d1354e59b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:08.791401 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-63b46359-f744-4d57-bd13-91b32471ef07 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:08.792738 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-63b46359-f744-4d57-bd13-91b32471ef07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:08.904067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 137/271] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:08.905045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b46359-f744-4d57-bd13-91b32471ef07 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:09.004906 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe3335-5ed2-4135-96f2-729d1354e59b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:09.022803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:09.025553 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:09.062091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b46359-f744-4d57-bd13-91b32471ef07 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:09.066711 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048e1a1-c8cc-4ea5-bc75-a18e01fe21c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:09.068048 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048e1a1-c8cc-4ea5-bc75-a18e01fe21c8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:09.068558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048e1a1-c8cc-4ea5-bc75-a18e01fe21c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:09.069060 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048e1a1-c8cc-4ea5-bc75-a18e01fe21c8 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:09.070716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048e1a1-c8cc-4ea5-bc75-a18e01fe21c8 None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:09.072462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048e1a1-c8cc-4ea5-bc75-a18e01fe21c8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:09.074564 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 135/272] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:08 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:09.075668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048e1a1-c8cc-4ea5-bc75-a18e01fe21c8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:09.150013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f8a9e-de44-4747-92fc-b70c4b2e91de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:09.151070 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f8a9e-de44-4747-92fc-b70c4b2e91de None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:09.151433 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f8a9e-de44-4747-92fc-b70c4b2e91de None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:09.151713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f8a9e-de44-4747-92fc-b70c4b2e91de None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:09.153066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f8a9e-de44-4747-92fc-b70c4b2e91de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:09.154583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f8a9e-de44-4747-92fc-b70c4b2e91de None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:09.156392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 138/273] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:09.161537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f8a9e-de44-4747-92fc-b70c4b2e91de None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:09.199750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048e1a1-c8cc-4ea5-bc75-a18e01fe21c8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:09.248598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9001c43-4297-41f4-930f-86d285380e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:09.250362 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9001c43-4297-41f4-930f-86d285380e6d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:09.251105 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9001c43-4297-41f4-930f-86d285380e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:09.251658 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9001c43-4297-41f4-930f-86d285380e6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:09.270151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9001c43-4297-41f4-930f-86d285380e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f9001c43-4297-41f4-930f-86d285380e6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:09.278555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:09.279723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:09.280503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:09.280503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:09.280503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:09.280503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:09.280503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:09.280503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:09.280503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:09.280503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:09.280503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:09.280503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:09.280503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:09.280503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:09.285134 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 136/274] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:09.286472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa4b04-0841-4edb-958e-c3ce6bdd74c9 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:09.286791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa4b04-0841-4edb-958e-c3ce6bdd74c9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:09.287098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa4b04-0841-4edb-958e-c3ce6bdd74c9 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:09.288507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 137/275] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:09.293442 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa4b04-0841-4edb-958e-c3ce6bdd74c9 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:09.312412 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f8a9e-de44-4747-92fc-b70c4b2e91de None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:09.344634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:09.356713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da791a7-6df9-4bc0-a563-db4ae18c1658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:09.358159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da791a7-6df9-4bc0-a563-db4ae18c1658 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:09.358759 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da791a7-6df9-4bc0-a563-db4ae18c1658 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:09.359199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da791a7-6df9-4bc0-a563-db4ae18c1658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:09.360385 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da791a7-6df9-4bc0-a563-db4ae18c1658 None admin] RBAC: Adding query filter params (role.id=a6779b95437c46648185d3ce128f658b, scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8, user.id=ef9685ea41104ef48f0c03c1654dc76e) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:09.360903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da791a7-6df9-4bc0-a563-db4ae18c1658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:09.363239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da791a7-6df9-4bc0-a563-db4ae18c1658 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:09.371964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 139/276] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:01:09 2022] GET /identity/v3/role_assignments?user.id=ef9685ea41104ef48f0c03c1654dc76e&scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8&role.id=a6779b95437c46648185d3ce128f658b => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:09.373731 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da791a7-6df9-4bc0-a563-db4ae18c1658 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:09.401366 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:09.461337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa4b04-0841-4edb-958e-c3ce6bdd74c9 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:09.502326 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95db82-10f7-4100-a047-8643d80a6d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:09.503081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95db82-10f7-4100-a047-8643d80a6d1d None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:09.503371 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95db82-10f7-4100-a047-8643d80a6d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:09.503654 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95db82-10f7-4100-a047-8643d80a6d1d None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:09.504409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95db82-10f7-4100-a047-8643d80a6d1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:09.506099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95db82-10f7-4100-a047-8643d80a6d1d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:09.532907 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 138/277] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:01:09 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:01:09.540505 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a47d-929a-4d4e-9fe0-0df28dcbf745 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:09.540781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a47d-929a-4d4e-9fe0-0df28dcbf745 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:09.541122 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a47d-929a-4d4e-9fe0-0df28dcbf745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:09.575000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6887a47d-929a-4d4e-9fe0-0df28dcbf745 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:09.575506 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da791a7-6df9-4bc0-a563-db4ae18c1658 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:09.576362 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6887a47d-929a-4d4e-9fe0-0df28dcbf745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:09.646598 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5381d6c-c0e2-4067-9ceb-93f761b33c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:09.647895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381d6c-c0e2-4067-9ceb-93f761b33c24 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:09.648378 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381d6c-c0e2-4067-9ceb-93f761b33c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:09.648854 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381d6c-c0e2-4067-9ceb-93f761b33c24 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:09.650388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5381d6c-c0e2-4067-9ceb-93f761b33c24 None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:09.650987 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5381d6c-c0e2-4067-9ceb-93f761b33c24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:09.653825 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5381d6c-c0e2-4067-9ceb-93f761b33c24 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:09.671375 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 139/278] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:09.671588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 140/279] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:09.672595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fd6c1-d202-4679-8be1-36d80356f474 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:09.672887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fd6c1-d202-4679-8be1-36d80356f474 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:09.673226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fd6c1-d202-4679-8be1-36d80356f474 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:09.675031 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 140/280] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:09.682037 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fd6c1-d202-4679-8be1-36d80356f474 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:09.683728 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4893c17-32d6-4f14-84fc-18447edddefe None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:09.684394 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4893c17-32d6-4f14-84fc-18447edddefe None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:09.684726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4893c17-32d6-4f14-84fc-18447edddefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:09.706585 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c4893c17-32d6-4f14-84fc-18447edddefe None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:09.707903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c4893c17-32d6-4f14-84fc-18447edddefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:09.724608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:09.808323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 141/281] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:09.809880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4893c17-32d6-4f14-84fc-18447edddefe None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:09.833697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:09.870085 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fd6c1-d202-4679-8be1-36d80356f474 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:09.923314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290a6df-2e5f-4105-bdee-bcd7c281f790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:09.924617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290a6df-2e5f-4105-bdee-bcd7c281f790 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:09.925112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290a6df-2e5f-4105-bdee-bcd7c281f790 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:09.925592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290a6df-2e5f-4105-bdee-bcd7c281f790 None admin] PATH_INFO: `/v3/users/2314242c8606451e87f5ac6d4fd3e9ca` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:09.927727 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290a6df-2e5f-4105-bdee-bcd7c281f790 None admin] RBAC: Authorizing `identity:get_user(user_id=2314242c8606451e87f5ac6d4fd3e9ca)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:09.930752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290a6df-2e5f-4105-bdee-bcd7c281f790 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:09.933045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 141/282] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:09 2022] GET /identity/v3/users/2314242c8606451e87f5ac6d4fd3e9ca => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:09.933941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290a6df-2e5f-4105-bdee-bcd7c281f790 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:09.979857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4893c17-32d6-4f14-84fc-18447edddefe None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:10.043503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4c5de-5afe-49f3-a05d-86871834f3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:10.044675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4c5de-5afe-49f3-a05d-86871834f3cd None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:10.045146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4c5de-5afe-49f3-a05d-86871834f3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:10.045593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4c5de-5afe-49f3-a05d-86871834f3cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:10.048277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:10.062900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4c5de-5afe-49f3-a05d-86871834f3cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:10.065689 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290a6df-2e5f-4105-bdee-bcd7c281f790 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-25d4c5de-5afe-49f3-a05d-86871834f3cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:10.072988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:10.073985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:10.074845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:10.074845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:10.074845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:10.074845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:10.074845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:10.074845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:10.074845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:10.074845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:10.074845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:10.074845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:10.074845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:10.074845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:10.078564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 142/283] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:10.080197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4c5de-5afe-49f3-a05d-86871834f3cd None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:10.123020 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1b72f-1995-4550-9f35-e5370e07e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:10.123948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1b72f-1995-4550-9f35-e5370e07e25d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:10.124291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1b72f-1995-4550-9f35-e5370e07e25d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:10.124685 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1b72f-1995-4550-9f35-e5370e07e25d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:10.144384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1b72f-1995-4550-9f35-e5370e07e25d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f3e1b72f-1995-4550-9f35-e5370e07e25d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:10.159138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:10.160109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:10.160904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:10.160904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:10.160904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:10.160904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:10.160904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:10.160904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:10.160904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:10.160904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:10.160904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:10.160904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:10.160904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:01:10.160904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:10.161512 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 142/284] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:10.167788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1b72f-1995-4550-9f35-e5370e07e25d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:10.181391 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:10.241787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4c5de-5afe-49f3-a05d-86871834f3cd None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:10.308186 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6ec14-530e-4e8b-84ae-10445fb0736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:10.309726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6ec14-530e-4e8b-84ae-10445fb0736f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:10.310191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6ec14-530e-4e8b-84ae-10445fb0736f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:10.310610 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6ec14-530e-4e8b-84ae-10445fb0736f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:10.320450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1b72f-1995-4550-9f35-e5370e07e25d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:10.374350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad54acb-ce27-4326-a819-df0daab633bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:10.375367 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54acb-ce27-4326-a819-df0daab633bf None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:10.375815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54acb-ce27-4326-a819-df0daab633bf None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:10.376331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54acb-ce27-4326-a819-df0daab633bf None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:10.378100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad54acb-ce27-4326-a819-df0daab633bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:10.378629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad54acb-ce27-4326-a819-df0daab633bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:10.380277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad54acb-ce27-4326-a819-df0daab633bf None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:10.393751 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 143/285] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:10.395253 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad54acb-ce27-4326-a819-df0daab633bf None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:10.413285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:10.430957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6ec14-530e-4e8b-84ae-10445fb0736f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:10.433569 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6ec14-530e-4e8b-84ae-10445fb0736f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:10.547019 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:10.568783 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad54acb-ce27-4326-a819-df0daab633bf None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:10.608394 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 143/286] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:10.614869 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea93c42-a41f-4fc8-b4ac-d7b99ad3cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:10.615780 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea93c42-a41f-4fc8-b4ac-d7b99ad3cb7d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:10.616114 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6ec14-530e-4e8b-84ae-10445fb0736f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:10.616258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea93c42-a41f-4fc8-b4ac-d7b99ad3cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:10.616641 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea93c42-a41f-4fc8-b4ac-d7b99ad3cb7d None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:10.617545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea93c42-a41f-4fc8-b4ac-d7b99ad3cb7d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:10.618013 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea93c42-a41f-4fc8-b4ac-d7b99ad3cb7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:10.619588 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea93c42-a41f-4fc8-b4ac-d7b99ad3cb7d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:10.632430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 144/287] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:10.636298 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea93c42-a41f-4fc8-b4ac-d7b99ad3cb7d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:10.732622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:10.774416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea93c42-a41f-4fc8-b4ac-d7b99ad3cb7d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:10.816801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d7eca-9f43-4b58-93ab-26548ec52bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:10.817134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6ec14-530e-4e8b-84ae-10445fb0736f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:10.817722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7eca-9f43-4b58-93ab-26548ec52bcd None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:10.818008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7eca-9f43-4b58-93ab-26548ec52bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:10.818278 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7eca-9f43-4b58-93ab-26548ec52bcd None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:10.819590 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d7eca-9f43-4b58-93ab-26548ec52bcd None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:10.821397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d7eca-9f43-4b58-93ab-26548ec52bcd None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:10.824695 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 145/288] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:10 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:10.825378 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d7eca-9f43-4b58-93ab-26548ec52bcd None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:10.896748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558acc4-375d-455e-a803-57f4204ae36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:10.898506 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558acc4-375d-455e-a803-57f4204ae36c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:10.899133 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558acc4-375d-455e-a803-57f4204ae36c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:10.899677 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558acc4-375d-455e-a803-57f4204ae36c None admin] PATH_INFO: `/v3/users/bad1c36f642b4c59ba8062513d6145e5` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:10.930603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558acc4-375d-455e-a803-57f4204ae36c None admin] RBAC: Authorizing `identity:get_user(user_id=bad1c36f642b4c59ba8062513d6145e5)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:10.934101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558acc4-375d-455e-a803-57f4204ae36c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:10.938053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 144/289] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:10 2022] GET /identity/v3/users/bad1c36f642b4c59ba8062513d6145e5 => generated 293 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:10.939817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558acc4-375d-455e-a803-57f4204ae36c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:10.964836 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d7eca-9f43-4b58-93ab-26548ec52bcd None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:11.000317 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:11.006167 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1393f2-1f96-464d-8215-cef47bcaa775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:11.007121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1393f2-1f96-464d-8215-cef47bcaa775 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:11.007522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1393f2-1f96-464d-8215-cef47bcaa775 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:11.007879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1393f2-1f96-464d-8215-cef47bcaa775 None admin] PATH_INFO: `/v3/users/34d2d17f9cb848d0bd925b9d8bbb5287` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:11.009882 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1393f2-1f96-464d-8215-cef47bcaa775 None admin] RBAC: Authorizing `identity:get_user(user_id=34d2d17f9cb848d0bd925b9d8bbb5287)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:11.011395 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1393f2-1f96-464d-8215-cef47bcaa775 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:11.013339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 146/290] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:10 2022] GET /identity/v3/users/34d2d17f9cb848d0bd925b9d8bbb5287 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:11.014166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1393f2-1f96-464d-8215-cef47bcaa775 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:11.027547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:11.131403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1393f2-1f96-464d-8215-cef47bcaa775 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:11.153661 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558acc4-375d-455e-a803-57f4204ae36c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:11.168236 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d03fc-73b7-4cbd-aa24-bd043dbd4ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:11.169036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d03fc-73b7-4cbd-aa24-bd043dbd4ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:11.169327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d03fc-73b7-4cbd-aa24-bd043dbd4ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:11.169588 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d03fc-73b7-4cbd-aa24-bd043dbd4ae1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:11.170459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d03fc-73b7-4cbd-aa24-bd043dbd4ae1 None admin] RBAC: Adding query filter params (role.id=67ad028192f24536a65fa57450a563b9, user.id=bad1c36f642b4c59ba8062513d6145e5, scope.system=all) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:11.170805 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d03fc-73b7-4cbd-aa24-bd043dbd4ae1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:11.172369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d03fc-73b7-4cbd-aa24-bd043dbd4ae1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:11.178734 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 147/291] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Jul 21 12:01:11 2022] GET /identity/v3/role_assignments?user.id=bad1c36f642b4c59ba8062513d6145e5&scope.system=all&role.id=67ad028192f24536a65fa57450a563b9 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:11.179897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d03fc-73b7-4cbd-aa24-bd043dbd4ae1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:11.218984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347da425-5c26-47c8-a679-fd2d2758f89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:11.220372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347da425-5c26-47c8-a679-fd2d2758f89c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:11.221021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347da425-5c26-47c8-a679-fd2d2758f89c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:11.221667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347da425-5c26-47c8-a679-fd2d2758f89c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:11.223448 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347da425-5c26-47c8-a679-fd2d2758f89c None admin] RBAC: Adding query filter params (role.id=67ad028192f24536a65fa57450a563b9, scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8, user.id=2314242c8606451e87f5ac6d4fd3e9ca) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:11.224013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347da425-5c26-47c8-a679-fd2d2758f89c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:11.226705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347da425-5c26-47c8-a679-fd2d2758f89c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:11.240097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 145/292] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:01:10 2022] GET /identity/v3/role_assignments?user.id=2314242c8606451e87f5ac6d4fd3e9ca&scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8&role.id=67ad028192f24536a65fa57450a563b9 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:11.264242 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:11.303004 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d03fc-73b7-4cbd-aa24-bd043dbd4ae1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:11.345051 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df57be3-267f-4dbd-924a-6802ffdb6e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:11.345958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df57be3-267f-4dbd-924a-6802ffdb6e99 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:11.346244 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df57be3-267f-4dbd-924a-6802ffdb6e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:11.346528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df57be3-267f-4dbd-924a-6802ffdb6e99 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:11.347907 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df57be3-267f-4dbd-924a-6802ffdb6e99 None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:11.349398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df57be3-267f-4dbd-924a-6802ffdb6e99 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:11.351889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 148/293] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:11 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:11.363628 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347da425-5c26-47c8-a679-fd2d2758f89c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:11.561966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:11.578398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347da425-5c26-47c8-a679-fd2d2758f89c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:11.644055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedddecc-3fab-4423-a6ef-19a7634d0b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:11.645870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedddecc-3fab-4423-a6ef-19a7634d0b42 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:11.646365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedddecc-3fab-4423-a6ef-19a7634d0b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:11.646892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedddecc-3fab-4423-a6ef-19a7634d0b42 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8/users/34d2d17f9cb848d0bd925b9d8bbb5287/roles/cc0b77c0514d4c6294c8d884a4fea9db` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:11.650352 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedddecc-3fab-4423-a6ef-19a7634d0b42 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8968618a5b8461fbd567cb7fdbd05b8, user_id=34d2d17f9cb848d0bd925b9d8bbb5287, role_id=cc0b77c0514d4c6294c8d884a4fea9db)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:11.653127 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedddecc-3fab-4423-a6ef-19a7634d0b42 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:11.677789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 146/294] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:01:11 2022] PUT /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8/users/34d2d17f9cb848d0bd925b9d8bbb5287/roles/cc0b77c0514d4c6294c8d884a4fea9db => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:01:12.016684 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf981-6b39-49f5-9a0e-2065b506b3eb None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:12.016959 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4974d31-b058-4449-8633-7469688f3e50 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:12.017373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4974d31-b058-4449-8633-7469688f3e50 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:12.017373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4974d31-b058-4449-8633-7469688f3e50 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:12.018388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf981-6b39-49f5-9a0e-2065b506b3eb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:12.019349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 147/295] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:01:12.019509 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf981-6b39-49f5-9a0e-2065b506b3eb None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:12.021677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 149/296] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:12.025332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa5403-d3bb-41f3-a2cc-7b36eee565f1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:12.025622 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa5403-d3bb-41f3-a2cc-7b36eee565f1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:12.025897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa5403-d3bb-41f3-a2cc-7b36eee565f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:12.028728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec51f15-9df1-4b26-ba04-293346ae5f0d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:12.029253 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec51f15-9df1-4b26-ba04-293346ae5f0d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:12.029744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec51f15-9df1-4b26-ba04-293346ae5f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:12.043357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-61fa5403-d3bb-41f3-a2cc-7b36eee565f1 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:12.044568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-61fa5403-d3bb-41f3-a2cc-7b36eee565f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:12.050759 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4ec51f15-9df1-4b26-ba04-293346ae5f0d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:12.052321 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4ec51f15-9df1-4b26-ba04-293346ae5f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:12.120948 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 148/297] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:12.144925 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa5403-d3bb-41f3-a2cc-7b36eee565f1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:12.152233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 150/298] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:12.178326 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec51f15-9df1-4b26-ba04-293346ae5f0d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:12.240024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:12.258295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:12.268135 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa5403-d3bb-41f3-a2cc-7b36eee565f1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:12.295192 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec51f15-9df1-4b26-ba04-293346ae5f0d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:12.316443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98879f5b-dd15-49bd-b5d9-bf3f3c79e2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:12.317629 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879f5b-dd15-49bd-b5d9-bf3f3c79e2ee None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:12.318124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879f5b-dd15-49bd-b5d9-bf3f3c79e2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:12.318585 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879f5b-dd15-49bd-b5d9-bf3f3c79e2ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:12.320007 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98879f5b-dd15-49bd-b5d9-bf3f3c79e2ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:12.321659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98879f5b-dd15-49bd-b5d9-bf3f3c79e2ee None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:12.323604 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 149/299] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:12.330427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98879f5b-dd15-49bd-b5d9-bf3f3c79e2ee None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:12.338414 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb920b5-3d15-4787-96fb-f74979242cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:12.339529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb920b5-3d15-4787-96fb-f74979242cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:12.340003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb920b5-3d15-4787-96fb-f74979242cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:12.340415 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb920b5-3d15-4787-96fb-f74979242cd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:12.352596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb920b5-3d15-4787-96fb-f74979242cd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-7fb920b5-3d15-4787-96fb-f74979242cd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:12.360944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:12.362038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:12.363030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:12.363030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:12.363030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:12.363030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:12.363030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:12.363030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:12.363030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:12.363030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:12.363030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:12.363030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:12.363030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:01:12.363030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:12.365328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 151/300] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:01:12.371184 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb920b5-3d15-4787-96fb-f74979242cd6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:12.445961 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98879f5b-dd15-49bd-b5d9-bf3f3c79e2ee None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:12.485935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90510-95cf-4af8-831d-e59f30392c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:12.487129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90510-95cf-4af8-831d-e59f30392c29 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:12.487617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90510-95cf-4af8-831d-e59f30392c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:12.488112 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90510-95cf-4af8-831d-e59f30392c29 None admin] PATH_INFO: `/v3/groups` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:12.489049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd90510-95cf-4af8-831d-e59f30392c29 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:12.489275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb920b5-3d15-4787-96fb-f74979242cd6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:12.491131 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd90510-95cf-4af8-831d-e59f30392c29 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:12.519245 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 150/301] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Jul 21 12:01:12 2022] POST /identity/v3/groups => generated 229 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:01:12.528053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:12.535478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a93669-cd4f-490e-bd0f-56287c788782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:12.536778 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a93669-cd4f-490e-bd0f-56287c788782 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:12.537491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a93669-cd4f-490e-bd0f-56287c788782 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:12.537766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a93669-cd4f-490e-bd0f-56287c788782 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:12.538584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a93669-cd4f-490e-bd0f-56287c788782 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:12.538933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a93669-cd4f-490e-bd0f-56287c788782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:12.540518 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a93669-cd4f-490e-bd0f-56287c788782 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:12.551436 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 152/302] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:12.557615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90510-95cf-4af8-831d-e59f30392c29 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:12.576741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:12.687154 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90510-95cf-4af8-831d-e59f30392c29 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:12.727455 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7d309-859c-4e0c-a32e-30090f92a9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:12.728764 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7d309-859c-4e0c-a32e-30090f92a9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:12.729246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7d309-859c-4e0c-a32e-30090f92a9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:12.729525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7d309-859c-4e0c-a32e-30090f92a9e1 None admin] PATH_INFO: `/v3/users/544d17bb59fe46088e4527eb8c7c742b` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:12.746049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7d309-859c-4e0c-a32e-30090f92a9e1 None admin] RBAC: Authorizing `identity:get_user(user_id=544d17bb59fe46088e4527eb8c7c742b)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:12.747581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7d309-859c-4e0c-a32e-30090f92a9e1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:12.750087 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 151/303] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:12 2022] GET /identity/v3/users/544d17bb59fe46088e4527eb8c7c742b => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:12.757169 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a93669-cd4f-490e-bd0f-56287c788782 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:12.860272 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a93669-cd4f-490e-bd0f-56287c788782 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:12.894517 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3941046-ceaa-422c-939c-eaeb00ce32e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:12.895228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3941046-ceaa-422c-939c-eaeb00ce32e8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:12.895511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3941046-ceaa-422c-939c-eaeb00ce32e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:12.895784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3941046-ceaa-422c-939c-eaeb00ce32e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:12.896640 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3941046-ceaa-422c-939c-eaeb00ce32e8 None admin] RBAC: Adding query filter params (role.id=cc0b77c0514d4c6294c8d884a4fea9db, user.id=544d17bb59fe46088e4527eb8c7c742b, scope.system=all) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:12.896952 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3941046-ceaa-422c-939c-eaeb00ce32e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:12.898437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3941046-ceaa-422c-939c-eaeb00ce32e8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:12.904997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 153/304] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Jul 21 12:01:12 2022] GET /identity/v3/role_assignments?user.id=544d17bb59fe46088e4527eb8c7c742b&scope.system=all&role.id=cc0b77c0514d4c6294c8d884a4fea9db => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:13.892030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58833e8-d06e-436d-bffb-5b7203cebe04 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:13.892599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58833e8-d06e-436d-bffb-5b7203cebe04 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:13.892599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58833e8-d06e-436d-bffb-5b7203cebe04 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:13.894263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 152/305] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:13.900032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e1fdd-7225-47cb-add0-2be2adfda964 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:13.901108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e1fdd-7225-47cb-add0-2be2adfda964 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:13.901396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e1fdd-7225-47cb-add0-2be2adfda964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:13.919180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2a9e1fdd-7225-47cb-add0-2be2adfda964 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:13.920383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2a9e1fdd-7225-47cb-add0-2be2adfda964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:13.982691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:14.000860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 154/306] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:14.028849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58833e8-d06e-436d-bffb-5b7203cebe04 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:14.125375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:14.126608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56113b92-7bf0-4df8-a5e3-60c7d92f2b9a None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:14.126939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56113b92-7bf0-4df8-a5e3-60c7d92f2b9a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:14.127225 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56113b92-7bf0-4df8-a5e3-60c7d92f2b9a None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:14.130054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 155/307] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:01:14.134784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2da7b9-2bbd-4eb5-9dbd-15e30613d5b3 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:14.135314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2da7b9-2bbd-4eb5-9dbd-15e30613d5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:14.135739 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2da7b9-2bbd-4eb5-9dbd-15e30613d5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:14.153919 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4d2da7b9-2bbd-4eb5-9dbd-15e30613d5b3 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:14.155511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4d2da7b9-2bbd-4eb5-9dbd-15e30613d5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:14.185866 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58833e8-d06e-436d-bffb-5b7203cebe04 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:14.228045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 156/308] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:14.234884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebaed6-0212-44e1-ab56-5fccc50978b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:14.234884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebaed6-0212-44e1-ab56-5fccc50978b4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:14.234884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebaed6-0212-44e1-ab56-5fccc50978b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:14.234884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebaed6-0212-44e1-ab56-5fccc50978b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:14.247201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebaed6-0212-44e1-ab56-5fccc50978b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:14.252159 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2da7b9-2bbd-4eb5-9dbd-15e30613d5b3 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e6ebaed6-0212-44e1-ab56-5fccc50978b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:14.258584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:14.259577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:14.260350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:14.260350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:14.260350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:14.260350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:14.260350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:14.260350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:14.260350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:14.260350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:14.260350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:14.260350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:14.260350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:01:14.260350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:14.261524 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 153/309] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:14.271301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebaed6-0212-44e1-ab56-5fccc50978b4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:14.360250 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2da7b9-2bbd-4eb5-9dbd-15e30613d5b3 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:14.378856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:14.398261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6da3f8-0953-4ba6-bf38-7449d185fed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:14.399536 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da3f8-0953-4ba6-bf38-7449d185fed8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:14.400026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da3f8-0953-4ba6-bf38-7449d185fed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:14.400499 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da3f8-0953-4ba6-bf38-7449d185fed8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:14.412537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6da3f8-0953-4ba6-bf38-7449d185fed8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-2c6da3f8-0953-4ba6-bf38-7449d185fed8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:14.420785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:14.421729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:14.422508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:14.422508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:14.422508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:14.422508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:14.422508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:14.422508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:14.422508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:14.422508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:14.422508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:14.422508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:14.422508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:14.422508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:14.430013 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 157/310] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:01:14.431719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6da3f8-0953-4ba6-bf38-7449d185fed8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:14.473147 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebaed6-0212-44e1-ab56-5fccc50978b4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:14.513833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:14.524992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627e245-c541-42f3-bef7-949f83489de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:14.525935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627e245-c541-42f3-bef7-949f83489de7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:14.526536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627e245-c541-42f3-bef7-949f83489de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:14.527270 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627e245-c541-42f3-bef7-949f83489de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:14.529099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627e245-c541-42f3-bef7-949f83489de7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:14.529813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627e245-c541-42f3-bef7-949f83489de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:14.532912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627e245-c541-42f3-bef7-949f83489de7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:14.541260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6da3f8-0953-4ba6-bf38-7449d185fed8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:14.550896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 154/311] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:14.561995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627e245-c541-42f3-bef7-949f83489de7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:14.578801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21de58-6eaf-45ec-b6b2-dbdfd5ed9271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:14.579717 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21de58-6eaf-45ec-b6b2-dbdfd5ed9271 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:14.580101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21de58-6eaf-45ec-b6b2-dbdfd5ed9271 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:14.580474 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21de58-6eaf-45ec-b6b2-dbdfd5ed9271 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:14.581352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21de58-6eaf-45ec-b6b2-dbdfd5ed9271 None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:14.581768 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21de58-6eaf-45ec-b6b2-dbdfd5ed9271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:14.583377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21de58-6eaf-45ec-b6b2-dbdfd5ed9271 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:14.597557 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 158/312] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:14.599065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21de58-6eaf-45ec-b6b2-dbdfd5ed9271 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:14.642922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:14.717014 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21de58-6eaf-45ec-b6b2-dbdfd5ed9271 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:14.755842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627e245-c541-42f3-bef7-949f83489de7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:14.757144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd34bf-15c2-409b-93f1-620f0aee6ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:14.758065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd34bf-15c2-409b-93f1-620f0aee6ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:14.758352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd34bf-15c2-409b-93f1-620f0aee6ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:14.758626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd34bf-15c2-409b-93f1-620f0aee6ab3 None admin] PATH_INFO: `/v3/users/bad1c36f642b4c59ba8062513d6145e5` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:14.760136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd34bf-15c2-409b-93f1-620f0aee6ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=bad1c36f642b4c59ba8062513d6145e5)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:14.761633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd34bf-15c2-409b-93f1-620f0aee6ab3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:14.768624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 159/313] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:14 2022] GET /identity/v3/users/bad1c36f642b4c59ba8062513d6145e5 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:14.770402 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd34bf-15c2-409b-93f1-620f0aee6ab3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:14.815306 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb42727-ca84-436a-9a3c-fb299a20731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:14.817179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42727-ca84-436a-9a3c-fb299a20731a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:14.817725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42727-ca84-436a-9a3c-fb299a20731a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:14.818231 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42727-ca84-436a-9a3c-fb299a20731a None admin] PATH_INFO: `/v3/users/34d2d17f9cb848d0bd925b9d8bbb5287` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:14.820202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb42727-ca84-436a-9a3c-fb299a20731a None admin] RBAC: Authorizing `identity:get_user(user_id=34d2d17f9cb848d0bd925b9d8bbb5287)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:14.822011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb42727-ca84-436a-9a3c-fb299a20731a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:14.824184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 155/314] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:14 2022] GET /identity/v3/users/34d2d17f9cb848d0bd925b9d8bbb5287 => generated 297 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:14.833390 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb42727-ca84-436a-9a3c-fb299a20731a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:14.923071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd34bf-15c2-409b-93f1-620f0aee6ab3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:14.929670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:14.931394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:14.976895 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd297d-812d-439a-9baf-acfbee322bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:14.978894 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd297d-812d-439a-9baf-acfbee322bf0 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:14.979611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd297d-812d-439a-9baf-acfbee322bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:14.980322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd297d-812d-439a-9baf-acfbee322bf0 None admin] PATH_INFO: `/v3/system/users/bad1c36f642b4c59ba8062513d6145e5/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:14.983108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd297d-812d-439a-9baf-acfbee322bf0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bad1c36f642b4c59ba8062513d6145e5, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:14.985964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd297d-812d-439a-9baf-acfbee322bf0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:15.001934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 160/315] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Jul 21 12:01:14 2022] PUT /identity/v3/system/users/bad1c36f642b4c59ba8062513d6145e5/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:01:15.002182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb42727-ca84-436a-9a3c-fb299a20731a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:15.005239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc5d56-dd87-4a85-80c4-ce2852fb8c35 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:15.006203 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc5d56-dd87-4a85-80c4-ce2852fb8c35 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:15.007055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc5d56-dd87-4a85-80c4-ce2852fb8c35 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:15.010903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 161/316] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:15.017669 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb4537-f1bf-4c61-bc8f-24a310f795ad None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:15.018644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb4537-f1bf-4c61-bc8f-24a310f795ad None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:15.019536 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb4537-f1bf-4c61-bc8f-24a310f795ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:15.051211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f1bb4537-f1bf-4c61-bc8f-24a310f795ad None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:15.053894 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f1bb4537-f1bf-4c61-bc8f-24a310f795ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:15.070165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe2d98-0e71-4aed-a347-fe854c6ae599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:15.070996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe2d98-0e71-4aed-a347-fe854c6ae599 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:15.071282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe2d98-0e71-4aed-a347-fe854c6ae599 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:15.071573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe2d98-0e71-4aed-a347-fe854c6ae599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:15.165540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 162/317] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:15.172369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad3f39-c5ad-401a-bc11-00785d7f42cf None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:15.173093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad3f39-c5ad-401a-bc11-00785d7f42cf None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:15.173682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad3f39-c5ad-401a-bc11-00785d7f42cf None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:15.175559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 163/318] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:15.185283 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6538a-5382-4f8c-af44-4195eb0a9924 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:15.186271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6538a-5382-4f8c-af44-4195eb0a9924 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:15.186271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6538a-5382-4f8c-af44-4195eb0a9924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:15.200512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe2d98-0e71-4aed-a347-fe854c6ae599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:15.202389 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe2d98-0e71-4aed-a347-fe854c6ae599 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:15.214703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2bf6538a-5382-4f8c-af44-4195eb0a9924 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:15.216562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2bf6538a-5382-4f8c-af44-4195eb0a9924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:15.271962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:15.336112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 164/319] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:15.337346 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6538a-5382-4f8c-af44-4195eb0a9924 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:15.341546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 156/320] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:15.349390 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe2d98-0e71-4aed-a347-fe854c6ae599 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:15.392180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:15.484087 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe2d98-0e71-4aed-a347-fe854c6ae599 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:15.514742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6538a-5382-4f8c-af44-4195eb0a9924 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:15.529883 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e34c-3db1-47a0-8286-150b2cb62d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:15.530688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e34c-3db1-47a0-8286-150b2cb62d86 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:15.530984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e34c-3db1-47a0-8286-150b2cb62d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:15.531264 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e34c-3db1-47a0-8286-150b2cb62d86 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:15.532826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00e34c-3db1-47a0-8286-150b2cb62d86 None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:15.534466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00e34c-3db1-47a0-8286-150b2cb62d86 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:15.545219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 157/321] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:15 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:15.545219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e34c-3db1-47a0-8286-150b2cb62d86 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:15.581717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:15.590172 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d2a35-81bc-4c3d-bfc1-b80436eaad4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:15.591349 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d2a35-81bc-4c3d-bfc1-b80436eaad4c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:15.591757 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d2a35-81bc-4c3d-bfc1-b80436eaad4c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:15.593322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d2a35-81bc-4c3d-bfc1-b80436eaad4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:15.594374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d2a35-81bc-4c3d-bfc1-b80436eaad4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:15.596267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d2a35-81bc-4c3d-bfc1-b80436eaad4c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:15.598555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 165/322] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:15.600018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d2a35-81bc-4c3d-bfc1-b80436eaad4c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:15.677258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e34c-3db1-47a0-8286-150b2cb62d86 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:15.722498 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:15.725849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f1b1b-eac2-4690-9cfb-2b1e6857b847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:15.727659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f1b1b-eac2-4690-9cfb-2b1e6857b847 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:15.728120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f1b1b-eac2-4690-9cfb-2b1e6857b847 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:15.728574 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f1b1b-eac2-4690-9cfb-2b1e6857b847 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:15.729528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d2a35-81bc-4c3d-bfc1-b80436eaad4c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:15.745723 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f1b1b-eac2-4690-9cfb-2b1e6857b847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-221f1b1b-eac2-4690-9cfb-2b1e6857b847 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:15.759658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:15.760627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:15.761431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:15.761431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:15.761431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:15.761431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:15.761431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:15.761431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:15.761431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:15.761431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:15.761431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:15.761431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:15.761431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:01:15.761431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:15.769484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 158/323] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:15.770813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f1b1b-eac2-4690-9cfb-2b1e6857b847 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:15.789295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef330-fd65-4b42-9479-0ec2df788bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:15.790041 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef330-fd65-4b42-9479-0ec2df788bfc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:15.790307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef330-fd65-4b42-9479-0ec2df788bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:15.790786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef330-fd65-4b42-9479-0ec2df788bfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:15.792257 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ef330-fd65-4b42-9479-0ec2df788bfc None admin] RBAC: Adding query filter params (role.id=cc0b77c0514d4c6294c8d884a4fea9db, scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8, user.id=34d2d17f9cb848d0bd925b9d8bbb5287) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:15.792721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ef330-fd65-4b42-9479-0ec2df788bfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:15.795092 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ef330-fd65-4b42-9479-0ec2df788bfc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:15.806723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 166/324] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:01:15 2022] GET /identity/v3/role_assignments?user.id=34d2d17f9cb848d0bd925b9d8bbb5287&scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8&role.id=cc0b77c0514d4c6294c8d884a4fea9db => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:15.808029 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef330-fd65-4b42-9479-0ec2df788bfc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:15.937291 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:15.964076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f1b1b-eac2-4690-9cfb-2b1e6857b847 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:15.965504 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef330-fd65-4b42-9479-0ec2df788bfc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:16.018860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93871292-166e-4695-85cc-70c7296869f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:16.019800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871292-166e-4695-85cc-70c7296869f5 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:16.020086 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871292-166e-4695-85cc-70c7296869f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:16.020497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871292-166e-4695-85cc-70c7296869f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:16.021414 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93871292-166e-4695-85cc-70c7296869f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:16.021735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93871292-166e-4695-85cc-70c7296869f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:16.023265 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93871292-166e-4695-85cc-70c7296869f5 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:16.024527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc48ee-d162-42cc-96cd-b77a449bd6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:16.025467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc48ee-d162-42cc-96cd-b77a449bd6d0 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:16.025983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc48ee-d162-42cc-96cd-b77a449bd6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:16.026318 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc48ee-d162-42cc-96cd-b77a449bd6d0 None admin] PATH_INFO: `/v3/groups` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:16.027134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc48ee-d162-42cc-96cd-b77a449bd6d0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:16.028707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc48ee-d162-42cc-96cd-b77a449bd6d0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:16.037442 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 167/325] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:16.043953 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93871292-166e-4695-85cc-70c7296869f5 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:16.059831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 159/326] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Jul 21 12:01:15 2022] POST /identity/v3/groups => generated 226 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:01:16.088618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:16.185723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93871292-166e-4695-85cc-70c7296869f5 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:16.228312 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b355f-a036-4a96-81dc-5985c0c0a4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:16.229209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b355f-a036-4a96-81dc-5985c0c0a4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:16.229490 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b355f-a036-4a96-81dc-5985c0c0a4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:16.229761 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b355f-a036-4a96-81dc-5985c0c0a4b2 None admin] PATH_INFO: `/v3/users/544d17bb59fe46088e4527eb8c7c742b` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:16.231189 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b355f-a036-4a96-81dc-5985c0c0a4b2 None admin] RBAC: Authorizing `identity:get_user(user_id=544d17bb59fe46088e4527eb8c7c742b)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:16.232711 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b355f-a036-4a96-81dc-5985c0c0a4b2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:16.235113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 168/327] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:16 2022] GET /identity/v3/users/544d17bb59fe46088e4527eb8c7c742b => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:16.240885 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc48ee-d162-42cc-96cd-b77a449bd6d0 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:16.354878 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc48ee-d162-42cc-96cd-b77a449bd6d0 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:16.391599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50114cb1-e68f-4552-bbd5-9da69c0341bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:16.392733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50114cb1-e68f-4552-bbd5-9da69c0341bc None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:16.393163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50114cb1-e68f-4552-bbd5-9da69c0341bc None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:16.393603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50114cb1-e68f-4552-bbd5-9da69c0341bc None admin] PATH_INFO: `/v3/system/users/544d17bb59fe46088e4527eb8c7c742b/roles/cc0b77c0514d4c6294c8d884a4fea9db` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:16.395317 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50114cb1-e68f-4552-bbd5-9da69c0341bc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=544d17bb59fe46088e4527eb8c7c742b, role_id=cc0b77c0514d4c6294c8d884a4fea9db)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:16.396853 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50114cb1-e68f-4552-bbd5-9da69c0341bc None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:16.411634 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 160/328] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Jul 21 12:01:16 2022] PUT /identity/v3/system/users/544d17bb59fe46088e4527eb8c7c742b/roles/cc0b77c0514d4c6294c8d884a4fea9db => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:01:17.343166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8be34-be08-47be-a969-95db0efb995e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:17.343715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8be34-be08-47be-a969-95db0efb995e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:17.344034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8be34-be08-47be-a969-95db0efb995e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:17.346149 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 169/329] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:17.352445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2384f-3e04-4070-ae14-a11c8eb79ebe None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:17.352957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2384f-3e04-4070-ae14-a11c8eb79ebe None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:17.353033 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2384f-3e04-4070-ae14-a11c8eb79ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:17.384726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-cbc2384f-3e04-4070-ae14-a11c8eb79ebe None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:17.386714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cbc2384f-3e04-4070-ae14-a11c8eb79ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:17.394251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:17.546295 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 161/330] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:17.611281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8be34-be08-47be-a969-95db0efb995e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:17.748175 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:17.764547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8be34-be08-47be-a969-95db0efb995e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:17.810210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad113e10-f9e7-4774-83f7-acc3ada14ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:17.811461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad113e10-f9e7-4774-83f7-acc3ada14ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:17.811956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad113e10-f9e7-4774-83f7-acc3ada14ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:17.812430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad113e10-f9e7-4774-83f7-acc3ada14ec6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:17.824760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad113e10-f9e7-4774-83f7-acc3ada14ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-ad113e10-f9e7-4774-83f7-acc3ada14ec6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:17.837620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:17.838573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:17.839398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:17.839398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:17.839398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:17.839398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:17.839398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:17.839398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:17.839398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:17.839398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:17.839398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:17.839398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:17.839398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:17.839398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:17.842226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 170/331] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:17.853917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2384f-3e04-4070-ae14-a11c8eb79ebe None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:18.103919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2384f-3e04-4070-ae14-a11c8eb79ebe None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:18.182579 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf75bb-530e-457f-a519-c53927096ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:18.183747 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf75bb-530e-457f-a519-c53927096ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:18.184235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf75bb-530e-457f-a519-c53927096ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:18.184726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf75bb-530e-457f-a519-c53927096ff3 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:18.186132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf75bb-530e-457f-a519-c53927096ff3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:18.186682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf75bb-530e-457f-a519-c53927096ff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:18.189297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf75bb-530e-457f-a519-c53927096ff3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:18.209303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 162/332] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:18.218418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad113e10-f9e7-4774-83f7-acc3ada14ec6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:18.492641 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad113e10-f9e7-4774-83f7-acc3ada14ec6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:18.568056 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f113542-6817-4c01-8f65-be84206d3ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:18.569603 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f113542-6817-4c01-8f65-be84206d3ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:18.570093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f113542-6817-4c01-8f65-be84206d3ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:18.570574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f113542-6817-4c01-8f65-be84206d3ef4 None admin] PATH_INFO: `/v3/users/bad1c36f642b4c59ba8062513d6145e5` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:18.576098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f113542-6817-4c01-8f65-be84206d3ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=bad1c36f642b4c59ba8062513d6145e5)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:18.579128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f113542-6817-4c01-8f65-be84206d3ef4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:18.582298 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 171/333] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:18 2022] GET /identity/v3/users/bad1c36f642b4c59ba8062513d6145e5 => generated 293 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:18.591856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf75bb-530e-457f-a519-c53927096ff3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:18.596907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:18.819514 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf75bb-530e-457f-a519-c53927096ff3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:18.880287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49774a-5a53-41ed-af16-3dac4dadf4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:18.880983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49774a-5a53-41ed-af16-3dac4dadf4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:18.881266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49774a-5a53-41ed-af16-3dac4dadf4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:18.881539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49774a-5a53-41ed-af16-3dac4dadf4d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:18.882405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49774a-5a53-41ed-af16-3dac4dadf4d7 None admin] RBAC: Adding query filter params (role.id=67ad028192f24536a65fa57450a563b9, user.id=bad1c36f642b4c59ba8062513d6145e5, scope.system=all) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:18.882751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49774a-5a53-41ed-af16-3dac4dadf4d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:18.884216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49774a-5a53-41ed-af16-3dac4dadf4d7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:18.903445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 163/334] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Jul 21 12:01:18 2022] GET /identity/v3/role_assignments?user.id=bad1c36f642b4c59ba8062513d6145e5&scope.system=all&role.id=67ad028192f24536a65fa57450a563b9 => generated 510 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:19.918698 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042e3a-8abd-4bb9-bcfa-744f047cfbce None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:19.918698 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042e3a-8abd-4bb9-bcfa-744f047cfbce None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:19.918698 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042e3a-8abd-4bb9-bcfa-744f047cfbce None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:19.920263 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 172/335] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:19.926529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b2689-568e-41f4-8f12-266efd056b1e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:19.927596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b2689-568e-41f4-8f12-266efd056b1e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:19.928086 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b2689-568e-41f4-8f12-266efd056b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:19.952314 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-831b2689-568e-41f4-8f12-266efd056b1e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:19.954005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-831b2689-568e-41f4-8f12-266efd056b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:20.033318 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:20.049331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 164/336] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:20.085287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c042e3a-8abd-4bb9-bcfa-744f047cfbce None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:20.140901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:20.163426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4049e0-9b21-4f4a-9b6f-a6a622a6ef67 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:20.164063 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4049e0-9b21-4f4a-9b6f-a6a622a6ef67 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:20.164534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4049e0-9b21-4f4a-9b6f-a6a622a6ef67 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:20.166159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 165/337] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:01:20.179277 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d6a0-9fe9-42ec-9b69-c5a61f667189 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:20.179893 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d6a0-9fe9-42ec-9b69-c5a61f667189 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:20.180384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d6a0-9fe9-42ec-9b69-c5a61f667189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:20.213315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-49d5d6a0-9fe9-42ec-9b69-c5a61f667189 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:20.223006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-49d5d6a0-9fe9-42ec-9b69-c5a61f667189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:20.322842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 166/338] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:20.329334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c042e3a-8abd-4bb9-bcfa-744f047cfbce None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:20.348686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d6a0-9fe9-42ec-9b69-c5a61f667189 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:20.417987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109ef0b-7fc4-4e96-b9aa-2b1df8e32fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:20.419150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ef0b-7fc4-4e96-b9aa-2b1df8e32fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:20.421540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ef0b-7fc4-4e96-b9aa-2b1df8e32fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:20.422029 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ef0b-7fc4-4e96-b9aa-2b1df8e32fe7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:20.457019 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109ef0b-7fc4-4e96-b9aa-2b1df8e32fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-3109ef0b-7fc4-4e96-b9aa-2b1df8e32fe7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:20.465195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:20.466361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:20.467379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:20.467379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:20.467379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:20.467379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:20.467379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:20.467379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:20.467379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:20.467379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:20.467379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:20.467379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:20.467379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:20.467379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:20.476114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 173/339] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:20.500875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109ef0b-7fc4-4e96-b9aa-2b1df8e32fe7 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:20.543813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d6a0-9fe9-42ec-9b69-c5a61f667189 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:20.599843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:20.636903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2cef4-e952-4ef1-87e3-41306b8bbf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:20.638187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2cef4-e952-4ef1-87e3-41306b8bbf1d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:20.638715 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2cef4-e952-4ef1-87e3-41306b8bbf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:20.639178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2cef4-e952-4ef1-87e3-41306b8bbf1d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:20.671539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2cef4-e952-4ef1-87e3-41306b8bbf1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:20.678446 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-00a2cef4-e952-4ef1-87e3-41306b8bbf1d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:20.680415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:20.682772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:20.684293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:20.684293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:20.684293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:20.684293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:20.684293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:20.684293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:20.684293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:20.684293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:20.684293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:20.684293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:20.684293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:20.684293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:20.684293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 167/340] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:01:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:20.690931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2cef4-e952-4ef1-87e3-41306b8bbf1d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:20.735659 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109ef0b-7fc4-4e96-b9aa-2b1df8e32fe7 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:20.816612 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86325f4b-bb8d-44b4-90ce-804bb92b28c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:20.818266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86325f4b-bb8d-44b4-90ce-804bb92b28c8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:20.819064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86325f4b-bb8d-44b4-90ce-804bb92b28c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:20.819816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86325f4b-bb8d-44b4-90ce-804bb92b28c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:20.821722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86325f4b-bb8d-44b4-90ce-804bb92b28c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:20.822574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86325f4b-bb8d-44b4-90ce-804bb92b28c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:20.825606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86325f4b-bb8d-44b4-90ce-804bb92b28c8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:20.852373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 174/341] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:20.859378 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86325f4b-bb8d-44b4-90ce-804bb92b28c8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:20.918118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2cef4-e952-4ef1-87e3-41306b8bbf1d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:20.993062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4b4c5-1ed7-442f-8425-377a7bdb45b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:20.993701 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4b4c5-1ed7-442f-8425-377a7bdb45b7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:20.993952 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4b4c5-1ed7-442f-8425-377a7bdb45b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:20.996702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4b4c5-1ed7-442f-8425-377a7bdb45b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:20.996702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4b4c5-1ed7-442f-8425-377a7bdb45b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:20.996702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4b4c5-1ed7-442f-8425-377a7bdb45b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:20.996989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4b4c5-1ed7-442f-8425-377a7bdb45b7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:21.011084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 168/342] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:21.019832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4b4c5-1ed7-442f-8425-377a7bdb45b7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:21.100582 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:21.170464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86325f4b-bb8d-44b4-90ce-804bb92b28c8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:21.266541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4b4c5-1ed7-442f-8425-377a7bdb45b7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:21.295921 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97461f1-7f82-4951-855b-1f6dcff8e23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:21.296893 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97461f1-7f82-4951-855b-1f6dcff8e23c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:21.297577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97461f1-7f82-4951-855b-1f6dcff8e23c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:21.298089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97461f1-7f82-4951-855b-1f6dcff8e23c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:21.335313 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:21.339558 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca5379-50da-4c90-bfc0-8a56794a5a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:21.340258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca5379-50da-4c90-bfc0-8a56794a5a9b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:21.340541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca5379-50da-4c90-bfc0-8a56794a5a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:21.340819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca5379-50da-4c90-bfc0-8a56794a5a9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:21.441532 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca5379-50da-4c90-bfc0-8a56794a5a9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:21.443897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca5379-50da-4c90-bfc0-8a56794a5a9b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:21.476112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97461f1-7f82-4951-855b-1f6dcff8e23c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:21.478012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97461f1-7f82-4951-855b-1f6dcff8e23c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:21.521638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:21.604658 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 175/343] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 12:01:21.606478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d85dec-65a5-4659-8038-b2796af9c7a7 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:21.606957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d85dec-65a5-4659-8038-b2796af9c7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:21.607403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d85dec-65a5-4659-8038-b2796af9c7a7 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:21.609397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 176/344] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:21.611034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf441b0-9ded-498f-a61b-8f3f39734b5c None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:21.611644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf441b0-9ded-498f-a61b-8f3f39734b5c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:21.612083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf441b0-9ded-498f-a61b-8f3f39734b5c None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:21.613758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 177/345] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:21.615319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c58357-fa37-474b-9aaa-b0f608d39261 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:21.615782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c58357-fa37-474b-9aaa-b0f608d39261 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:21.616246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c58357-fa37-474b-9aaa-b0f608d39261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:21.629175 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 169/346] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:21.630393 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca5379-50da-4c90-bfc0-8a56794a5a9b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:21.654688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b2c58357-fa37-474b-9aaa-b0f608d39261 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:21.655556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b2c58357-fa37-474b-9aaa-b0f608d39261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:21.730519 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:21.766924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca5379-50da-4c90-bfc0-8a56794a5a9b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:21.798485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 178/347] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:21.799913 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec826d17-8c6f-4934-843a-29723ddf544c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:21.800486 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec826d17-8c6f-4934-843a-29723ddf544c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:21.800774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec826d17-8c6f-4934-843a-29723ddf544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:21.812939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04389f9-bc60-41e0-b3fc-51536deb76f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:21.813890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04389f9-bc60-41e0-b3fc-51536deb76f0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:21.814167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04389f9-bc60-41e0-b3fc-51536deb76f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:21.814438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04389f9-bc60-41e0-b3fc-51536deb76f0 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:21.817130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04389f9-bc60-41e0-b3fc-51536deb76f0 None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:21.823253 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04389f9-bc60-41e0-b3fc-51536deb76f0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:21.825193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 170/348] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:21 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:21.826380 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04389f9-bc60-41e0-b3fc-51536deb76f0 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:21.835034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ec826d17-8c6f-4934-843a-29723ddf544c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:21.837211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ec826d17-8c6f-4934-843a-29723ddf544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:21.846503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:21.955985 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 179/349] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:21.958646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec826d17-8c6f-4934-843a-29723ddf544c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:22.024618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04389f9-bc60-41e0-b3fc-51536deb76f0 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:22.103475 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35588353-7ede-4ed7-b778-8e2dcda8e943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:22.104637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35588353-7ede-4ed7-b778-8e2dcda8e943 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:22.104895 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec826d17-8c6f-4934-843a-29723ddf544c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:22.105085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35588353-7ede-4ed7-b778-8e2dcda8e943 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:22.105498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35588353-7ede-4ed7-b778-8e2dcda8e943 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:22.107174 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:22.108228 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35588353-7ede-4ed7-b778-8e2dcda8e943 None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:22.110826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35588353-7ede-4ed7-b778-8e2dcda8e943 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:22.114333 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 171/350] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:21 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:22.119252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35588353-7ede-4ed7-b778-8e2dcda8e943 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:22.167070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48b92f-0500-4804-ad41-d56b7f2f843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:22.168746 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48b92f-0500-4804-ad41-d56b7f2f843b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:22.169072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48b92f-0500-4804-ad41-d56b7f2f843b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:22.169314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48b92f-0500-4804-ad41-d56b7f2f843b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:22.186604 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48b92f-0500-4804-ad41-d56b7f2f843b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-4d48b92f-0500-4804-ad41-d56b7f2f843b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:22.196025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:22.197128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:22.198506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:22.198506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:22.198506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:22.198506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:22.198506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:22.198506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:22.198506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:22.198506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:22.198506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:22.198506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:22.198506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:22.198506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:22.198506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 180/351] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:01:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:22.200517 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d0588-3ae3-47ff-a915-1dce78113aa4 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:22.200517 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d0588-3ae3-47ff-a915-1dce78113aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:22.200517 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d0588-3ae3-47ff-a915-1dce78113aa4 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:22.200870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 181/352] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:22.203114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d0588-3ae3-47ff-a915-1dce78113aa4 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:22.302562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:22.331187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35588353-7ede-4ed7-b778-8e2dcda8e943 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:22.374391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d0588-3ae3-47ff-a915-1dce78113aa4 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:22.394499 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ca458-d8d5-497e-bfd0-c96fd3f57f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:22.395555 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ca458-d8d5-497e-bfd0-c96fd3f57f07 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:22.395849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ca458-d8d5-497e-bfd0-c96fd3f57f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:22.396216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ca458-d8d5-497e-bfd0-c96fd3f57f07 None admin] PATH_INFO: `/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:22.403478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ca458-d8d5-497e-bfd0-c96fd3f57f07 None admin] RBAC: Authorizing `identity:get_group(group_id=7d0bd34480f94a8593b05b2e828dfbaf)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:22.404915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ca458-d8d5-497e-bfd0-c96fd3f57f07 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:22.407031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 172/353] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:22 2022] GET /identity/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:22.407800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ca458-d8d5-497e-bfd0-c96fd3f57f07 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:22.428651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cb94b-e8ef-4ab1-a651-6842aa5a60ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:22.429522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cb94b-e8ef-4ab1-a651-6842aa5a60ae None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:22.429798 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cb94b-e8ef-4ab1-a651-6842aa5a60ae None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:22.430074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cb94b-e8ef-4ab1-a651-6842aa5a60ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:22.449665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cb94b-e8ef-4ab1-a651-6842aa5a60ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-e50cb94b-e8ef-4ab1-a651-6842aa5a60ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:22.455487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:22.456742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:22.457670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:22.457670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:22.457670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:22.457670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:22.457670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:22.457670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:22.457670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:22.457670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:22.457670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:22.457670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:22.457670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 12:01:22.457670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:22.457670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 182/354] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:22.458464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43ed0f-1390-4ebf-a563-8bc55502b204 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:22.458464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43ed0f-1390-4ebf-a563-8bc55502b204 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:22.458634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43ed0f-1390-4ebf-a563-8bc55502b204 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:22.464899 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 183/355] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:22.465344 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43ed0f-1390-4ebf-a563-8bc55502b204 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:22.503294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:22.561192 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ca458-d8d5-497e-bfd0-c96fd3f57f07 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:22.610171 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dcab4-fd76-4081-8693-353222bf5827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:22.611641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dcab4-fd76-4081-8693-353222bf5827 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:22.612112 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dcab4-fd76-4081-8693-353222bf5827 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:22.612556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dcab4-fd76-4081-8693-353222bf5827 None admin] PATH_INFO: `/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:22.614361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dcab4-fd76-4081-8693-353222bf5827 None admin] RBAC: Authorizing `identity:get_group(group_id=7d0bd34480f94a8593b05b2e828dfbaf)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:22.616389 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dcab4-fd76-4081-8693-353222bf5827 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:22.618880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 173/356] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:22 2022] GET /identity/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:22.619168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43ed0f-1390-4ebf-a563-8bc55502b204 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:22.620525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839182d-ebf0-44dc-8531-21868b05341f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:22.621033 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839182d-ebf0-44dc-8531-21868b05341f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:22.621410 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839182d-ebf0-44dc-8531-21868b05341f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:22.644133 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4839182d-ebf0-44dc-8531-21868b05341f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:22.645711 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4839182d-ebf0-44dc-8531-21868b05341f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:22.652530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:22.675757 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b233c1-278f-48b7-8b36-c4c19cab9a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:22.677152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b233c1-278f-48b7-8b36-c4c19cab9a00 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:22.677652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b233c1-278f-48b7-8b36-c4c19cab9a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:22.678014 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b233c1-278f-48b7-8b36-c4c19cab9a00 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:22.679543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b233c1-278f-48b7-8b36-c4c19cab9a00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:22.680092 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b233c1-278f-48b7-8b36-c4c19cab9a00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:22.682804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b233c1-278f-48b7-8b36-c4c19cab9a00 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:22.699957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 184/357] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:22.702278 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b233c1-278f-48b7-8b36-c4c19cab9a00 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:22.772497 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 174/358] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:22.774114 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839182d-ebf0-44dc-8531-21868b05341f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:22.861691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:22.896316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b233c1-278f-48b7-8b36-c4c19cab9a00 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:22.926246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839182d-ebf0-44dc-8531-21868b05341f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:22.960342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0e683-af32-4c4b-abf8-4adc37b9b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:22.961675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0e683-af32-4c4b-abf8-4adc37b9b47e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:22.961675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0e683-af32-4c4b-abf8-4adc37b9b47e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:22.961675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0e683-af32-4c4b-abf8-4adc37b9b47e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:22.962550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0e683-af32-4c4b-abf8-4adc37b9b47e None admin] RBAC: Adding query filter params (group.id=7d0bd34480f94a8593b05b2e828dfbaf, role.id=67ad028192f24536a65fa57450a563b9, scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:22.962917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0e683-af32-4c4b-abf8-4adc37b9b47e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:22.964419 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0e683-af32-4c4b-abf8-4adc37b9b47e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:22.972075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 185/359] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jul 21 12:01:22 2022] GET /identity/v3/role_assignments?group.id=7d0bd34480f94a8593b05b2e828dfbaf&scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793&role.id=67ad028192f24536a65fa57450a563b9 => generated 260 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:22.972748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287925d5-b559-4cb9-8cf8-ec238af87eea None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:22.972748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287925d5-b559-4cb9-8cf8-ec238af87eea None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:22.973006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287925d5-b559-4cb9-8cf8-ec238af87eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:22.992204 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6f191-f7ed-4618-b3a9-9919ad3c7f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:22.993370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6f191-f7ed-4618-b3a9-9919ad3c7f5f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:22.993850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6f191-f7ed-4618-b3a9-9919ad3c7f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:22.994331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6f191-f7ed-4618-b3a9-9919ad3c7f5f None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:22.995865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6f191-f7ed-4618-b3a9-9919ad3c7f5f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:22.997152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6f191-f7ed-4618-b3a9-9919ad3c7f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:22.999972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6f191-f7ed-4618-b3a9-9919ad3c7f5f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:23.007104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-287925d5-b559-4cb9-8cf8-ec238af87eea None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:23.009024 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-287925d5-b559-4cb9-8cf8-ec238af87eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:23.021021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 175/360] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:23.022720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6f191-f7ed-4618-b3a9-9919ad3c7f5f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:23.029148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:23.145144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 186/361] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:23.147393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287925d5-b559-4cb9-8cf8-ec238af87eea None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:23.201040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6f191-f7ed-4618-b3a9-9919ad3c7f5f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:23.273562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d212d6-02ff-41d3-9c68-a5cc360dcc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:23.275844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d212d6-02ff-41d3-9c68-a5cc360dcc35 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:23.275844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d212d6-02ff-41d3-9c68-a5cc360dcc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:23.275844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d212d6-02ff-41d3-9c68-a5cc360dcc35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:23.278848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d212d6-02ff-41d3-9c68-a5cc360dcc35 None admin] RBAC: Adding query filter params (group.id=7d0bd34480f94a8593b05b2e828dfbaf, role.id=a6779b95437c46648185d3ce128f658b, scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:23.279394 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d212d6-02ff-41d3-9c68-a5cc360dcc35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:23.282353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d212d6-02ff-41d3-9c68-a5cc360dcc35 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:23.299125 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 176/362] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jul 21 12:01:23 2022] GET /identity/v3/role_assignments?group.id=7d0bd34480f94a8593b05b2e828dfbaf&scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793&role.id=a6779b95437c46648185d3ce128f658b => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:23.300627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d212d6-02ff-41d3-9c68-a5cc360dcc35 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:23.334907 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:23.372093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287925d5-b559-4cb9-8cf8-ec238af87eea None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:23.441658 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaa927-e621-4103-b837-a72ce40ae8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:23.442688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaa927-e621-4103-b837-a72ce40ae8bc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:23.443212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaa927-e621-4103-b837-a72ce40ae8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:23.443705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaa927-e621-4103-b837-a72ce40ae8bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:23.466855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:23.525042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d212d6-02ff-41d3-9c68-a5cc360dcc35 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:23.594031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9ba19-e725-4436-ac4f-8b93f5e42bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:23.595426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaa927-e621-4103-b837-a72ce40ae8bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:23.596670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9ba19-e725-4436-ac4f-8b93f5e42bbd None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:23.596985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9ba19-e725-4436-ac4f-8b93f5e42bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:23.597217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9ba19-e725-4436-ac4f-8b93f5e42bbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:23.599467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaa927-e621-4103-b837-a72ce40ae8bc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:23.620124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9ba19-e725-4436-ac4f-8b93f5e42bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-1bd9ba19-e725-4436-ac4f-8b93f5e42bbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:23.639453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:23.641104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:23.642592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:23.642592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:23.642592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:23.642592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:23.642592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:23.642592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:23.642592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:23.642592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:23.642592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:23.642592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:23.642592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:23.642592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:23.642592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 177/363] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:23.643750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9ba19-e725-4436-ac4f-8b93f5e42bbd None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:23.739328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:23.761416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 187/364] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:23.762331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaa927-e621-4103-b837-a72ce40ae8bc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:23.800785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9ba19-e725-4436-ac4f-8b93f5e42bbd None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:23.832449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:23.842601 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40303549-7192-459d-993a-1f350f1b26c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:23.843540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40303549-7192-459d-993a-1f350f1b26c6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:23.843822 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40303549-7192-459d-993a-1f350f1b26c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:23.844097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40303549-7192-459d-993a-1f350f1b26c6 None admin] PATH_INFO: `/v3/users/544d17bb59fe46088e4527eb8c7c742b` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:23.845577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40303549-7192-459d-993a-1f350f1b26c6 None admin] RBAC: Authorizing `identity:get_user(user_id=544d17bb59fe46088e4527eb8c7c742b)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:23.847112 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40303549-7192-459d-993a-1f350f1b26c6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:23.848847 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 178/365] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:01:23 2022] GET /identity/v3/users/544d17bb59fe46088e4527eb8c7c742b => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:23.849655 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40303549-7192-459d-993a-1f350f1b26c6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:23.963018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaa927-e621-4103-b837-a72ce40ae8bc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:23.963468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40303549-7192-459d-993a-1f350f1b26c6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:24.002476 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99be55-92c2-44ec-80b5-dbcf1ed4140c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:24.003108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99be55-92c2-44ec-80b5-dbcf1ed4140c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:24.003486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99be55-92c2-44ec-80b5-dbcf1ed4140c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:24.003769 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99be55-92c2-44ec-80b5-dbcf1ed4140c None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:24.004594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99be55-92c2-44ec-80b5-dbcf1ed4140c None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:24.004908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99be55-92c2-44ec-80b5-dbcf1ed4140c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:24.006334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99be55-92c2-44ec-80b5-dbcf1ed4140c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:24.016098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 179/366] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:24.017024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99be55-92c2-44ec-80b5-dbcf1ed4140c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:24.028016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f43b3-4d1e-47ae-8372-f971692f3fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:24.029355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f43b3-4d1e-47ae-8372-f971692f3fee None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:24.029845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f43b3-4d1e-47ae-8372-f971692f3fee None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:24.030333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f43b3-4d1e-47ae-8372-f971692f3fee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:24.051682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f43b3-4d1e-47ae-8372-f971692f3fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-953f43b3-4d1e-47ae-8372-f971692f3fee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:24.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:24.071697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:24.074740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:24.074740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:24.074740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:24.074740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:24.074740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:24.074740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:24.074740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:24.074740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:24.074740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:24.074740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:24.074740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:01:24.074740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:24.083751 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 188/367] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:01:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:24.083751 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f43b3-4d1e-47ae-8372-f971692f3fee None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:24.084171 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:24.133764 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99be55-92c2-44ec-80b5-dbcf1ed4140c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:24.166271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:24.179041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689df1d-2564-4ec8-a89d-c87b4a66a6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:24.180013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689df1d-2564-4ec8-a89d-c87b4a66a6fc None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:24.180634 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689df1d-2564-4ec8-a89d-c87b4a66a6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:24.180915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689df1d-2564-4ec8-a89d-c87b4a66a6fc None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:24.183166 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689df1d-2564-4ec8-a89d-c87b4a66a6fc None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:24.185114 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689df1d-2564-4ec8-a89d-c87b4a66a6fc None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:24.187498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 180/368] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:24 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:24.188477 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689df1d-2564-4ec8-a89d-c87b4a66a6fc None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:24.312073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f43b3-4d1e-47ae-8372-f971692f3fee None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:24.390522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d9bb7-6d1e-4caa-beb8-bdeab5d63d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:24.392893 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d9bb7-6d1e-4caa-beb8-bdeab5d63d91 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:24.394584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d9bb7-6d1e-4caa-beb8-bdeab5d63d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:24.395367 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d9bb7-6d1e-4caa-beb8-bdeab5d63d91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:24.397581 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d9bb7-6d1e-4caa-beb8-bdeab5d63d91 None admin] RBAC: Adding query filter params (role.id=cc0b77c0514d4c6294c8d884a4fea9db, user.id=544d17bb59fe46088e4527eb8c7c742b, scope.system=all) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:24.398418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d9bb7-6d1e-4caa-beb8-bdeab5d63d91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:24.402359 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d9bb7-6d1e-4caa-beb8-bdeab5d63d91 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:24.415571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689df1d-2564-4ec8-a89d-c87b4a66a6fc None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:24.427647 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 189/369] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Jul 21 12:01:24 2022] GET /identity/v3/role_assignments?user.id=544d17bb59fe46088e4527eb8c7c742b&scope.system=all&role.id=cc0b77c0514d4c6294c8d884a4fea9db => generated 510 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:24.430460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d9bb7-6d1e-4caa-beb8-bdeab5d63d91 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:24.478988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:24.501843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b440b-42eb-42e0-bc7d-917c8fa6a0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:24.503080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b440b-42eb-42e0-bc7d-917c8fa6a0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:24.503590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b440b-42eb-42e0-bc7d-917c8fa6a0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:24.504142 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b440b-42eb-42e0-bc7d-917c8fa6a0f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:24.729111 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:24.734601 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b440b-42eb-42e0-bc7d-917c8fa6a0f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:24.738042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b440b-42eb-42e0-bc7d-917c8fa6a0f9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:24.746604 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d9bb7-6d1e-4caa-beb8-bdeab5d63d91 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:24.829645 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0078e-836b-47e3-9699-eff9c08072a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:24.831026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0078e-836b-47e3-9699-eff9c08072a1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:24.832496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0078e-836b-47e3-9699-eff9c08072a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:24.833021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0078e-836b-47e3-9699-eff9c08072a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:24.834496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0078e-836b-47e3-9699-eff9c08072a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:24.835088 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0078e-836b-47e3-9699-eff9c08072a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:24.837910 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0078e-836b-47e3-9699-eff9c08072a1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:24.861810 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 190/370] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:24.865357 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0078e-836b-47e3-9699-eff9c08072a1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:24.975586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 181/371] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:24.977841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b440b-42eb-42e0-bc7d-917c8fa6a0f9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:25.035040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:25.096215 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0078e-836b-47e3-9699-eff9c08072a1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:25.167226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25e703-589f-405a-8c76-66cd70f5a133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:25.168512 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25e703-589f-405a-8c76-66cd70f5a133 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:25.169484 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25e703-589f-405a-8c76-66cd70f5a133 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:25.169484 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25e703-589f-405a-8c76-66cd70f5a133 None admin] PATH_INFO: `/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:25.171189 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25e703-589f-405a-8c76-66cd70f5a133 None admin] RBAC: Authorizing `identity:get_group(group_id=7d0bd34480f94a8593b05b2e828dfbaf)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:25.173630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25e703-589f-405a-8c76-66cd70f5a133 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:25.178710 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 191/372] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:24 2022] GET /identity/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:25.179918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25e703-589f-405a-8c76-66cd70f5a133 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:25.194084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b440b-42eb-42e0-bc7d-917c8fa6a0f9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:25.242247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:25.277817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c429356-4b09-4310-8e7f-fa1e8b6e1618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:25.278687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c429356-4b09-4310-8e7f-fa1e8b6e1618 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:25.279110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c429356-4b09-4310-8e7f-fa1e8b6e1618 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:25.279569 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c429356-4b09-4310-8e7f-fa1e8b6e1618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:25.396519 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25e703-589f-405a-8c76-66cd70f5a133 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:25.434134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c429356-4b09-4310-8e7f-fa1e8b6e1618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:25.435438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c429356-4b09-4310-8e7f-fa1e8b6e1618 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:25.470466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbdc12-358d-490f-a691-b87b1467585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:25.471461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbdc12-358d-490f-a691-b87b1467585d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:25.471840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbdc12-358d-490f-a691-b87b1467585d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:25.472212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbdc12-358d-490f-a691-b87b1467585d None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:25.473614 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbdc12-358d-490f-a691-b87b1467585d None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:25.476245 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbdc12-358d-490f-a691-b87b1467585d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:25.477357 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 192/373] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:25 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:25.478313 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbdc12-358d-490f-a691-b87b1467585d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:25.503862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:25.633245 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:25.644209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbdc12-358d-490f-a691-b87b1467585d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:25.688960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 182/374] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:25.690756 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c429356-4b09-4310-8e7f-fa1e8b6e1618 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:25.714788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743f807-e19a-41f6-9719-706587b6d875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:25.715482 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743f807-e19a-41f6-9719-706587b6d875 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:25.715767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743f807-e19a-41f6-9719-706587b6d875 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:25.716045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743f807-e19a-41f6-9719-706587b6d875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:25.717258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743f807-e19a-41f6-9719-706587b6d875 None admin] RBAC: Adding query filter params (group.id=7d0bd34480f94a8593b05b2e828dfbaf, role.id=a6779b95437c46648185d3ce128f658b, scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:25.717575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743f807-e19a-41f6-9719-706587b6d875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:25.719157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743f807-e19a-41f6-9719-706587b6d875 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:25.734707 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 193/375] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jul 21 12:01:25 2022] GET /identity/v3/role_assignments?group.id=7d0bd34480f94a8593b05b2e828dfbaf&scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8&role.id=a6779b95437c46648185d3ce128f658b => generated 260 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:25.734707 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743f807-e19a-41f6-9719-706587b6d875 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:25.997029 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743f807-e19a-41f6-9719-706587b6d875 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:26.018511 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c429356-4b09-4310-8e7f-fa1e8b6e1618 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:26.061729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a01afe-93c3-4573-aa12-d332c8e2b7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:26.064042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01afe-93c3-4573-aa12-d332c8e2b7cb None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:26.064859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01afe-93c3-4573-aa12-d332c8e2b7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:26.065777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01afe-93c3-4573-aa12-d332c8e2b7cb None admin] PATH_INFO: `/v3/projects/2ea0112c11004c7db4f26fe8670575dc` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:26.067523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:26.069674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a01afe-93c3-4573-aa12-d332c8e2b7cb None admin] RBAC: Authorizing `identity:get_project(project_id=2ea0112c11004c7db4f26fe8670575dc)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:26.073068 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a01afe-93c3-4573-aa12-d332c8e2b7cb None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:26.078274 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 194/376] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:25 2022] GET /identity/v3/projects/2ea0112c11004c7db4f26fe8670575dc => generated 344 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:26.081165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43428ebf-aba8-48ea-94c9-7617e6c9754b None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:26.082005 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43428ebf-aba8-48ea-94c9-7617e6c9754b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:26.082947 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43428ebf-aba8-48ea-94c9-7617e6c9754b None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:26.086463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 195/377] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:26.088231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43428ebf-aba8-48ea-94c9-7617e6c9754b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:26.094021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f233071-05b0-453b-8be0-c7fcd0c9c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:26.095704 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f233071-05b0-453b-8be0-c7fcd0c9c861 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:26.096196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f233071-05b0-453b-8be0-c7fcd0c9c861 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:26.096685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f233071-05b0-453b-8be0-c7fcd0c9c861 None admin] PATH_INFO: `/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:26.099044 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f233071-05b0-453b-8be0-c7fcd0c9c861 None admin] RBAC: Authorizing `identity:get_group(group_id=7d0bd34480f94a8593b05b2e828dfbaf)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:26.101791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f233071-05b0-453b-8be0-c7fcd0c9c861 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:26.105189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 183/378] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:25 2022] GET /identity/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf => generated 226 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:26.114335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390145e5-e770-4948-9ed2-a2e57435914f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:26.115193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390145e5-e770-4948-9ed2-a2e57435914f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:26.115894 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390145e5-e770-4948-9ed2-a2e57435914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:26.148127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:26.152714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-390145e5-e770-4948-9ed2-a2e57435914f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:26.155232 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-390145e5-e770-4948-9ed2-a2e57435914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:26.305329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43428ebf-aba8-48ea-94c9-7617e6c9754b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:26.310873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 184/379] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:26.314793 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390145e5-e770-4948-9ed2-a2e57435914f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:26.396541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2db10a-e217-4a88-8dbc-c7d32edf9354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:26.398045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2db10a-e217-4a88-8dbc-c7d32edf9354 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:26.398511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2db10a-e217-4a88-8dbc-c7d32edf9354 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:26.399027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2db10a-e217-4a88-8dbc-c7d32edf9354 None admin] PATH_INFO: `/v3/groups/594a30ff998b42f686d8a1756bb72e32` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:26.412314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2db10a-e217-4a88-8dbc-c7d32edf9354 None admin] RBAC: Authorizing `identity:get_group(group_id=594a30ff998b42f686d8a1756bb72e32)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:26.415455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2db10a-e217-4a88-8dbc-c7d32edf9354 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:26.419683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 196/380] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:26 2022] GET /identity/v3/groups/594a30ff998b42f686d8a1756bb72e32 => generated 229 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:26.421437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2db10a-e217-4a88-8dbc-c7d32edf9354 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:26.569139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390145e5-e770-4948-9ed2-a2e57435914f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:26.665777 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:26.702497 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cebd2c-4e38-4027-8020-fd68a72b6dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:26.703717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cebd2c-4e38-4027-8020-fd68a72b6dbf None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:26.704206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cebd2c-4e38-4027-8020-fd68a72b6dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:26.704682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cebd2c-4e38-4027-8020-fd68a72b6dbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:26.706289 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cebd2c-4e38-4027-8020-fd68a72b6dbf None admin] RBAC: Adding query filter params (group.id=7d0bd34480f94a8593b05b2e828dfbaf, role.id=67ad028192f24536a65fa57450a563b9, scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:26.714252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cebd2c-4e38-4027-8020-fd68a72b6dbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:26.717207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cebd2c-4e38-4027-8020-fd68a72b6dbf None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:26.733975 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:26.743449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 185/381] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jul 21 12:01:26 2022] GET /identity/v3/role_assignments?group.id=7d0bd34480f94a8593b05b2e828dfbaf&scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8&role.id=67ad028192f24536a65fa57450a563b9 => generated 260 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:26.744009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cebd2c-4e38-4027-8020-fd68a72b6dbf None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:26.775781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2db10a-e217-4a88-8dbc-c7d32edf9354 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:26.925942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ac72a-f2fc-4b44-a31b-203e452c47e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:26.926700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ac72a-f2fc-4b44-a31b-203e452c47e9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:26.927013 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ac72a-f2fc-4b44-a31b-203e452c47e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:26.927258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ac72a-f2fc-4b44-a31b-203e452c47e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:26.967905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ac72a-f2fc-4b44-a31b-203e452c47e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c22ac72a-f2fc-4b44-a31b-203e452c47e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:26.995455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:26.997139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:26.998635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:26.998635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:26.998635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:26.998635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:26.998635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:26.998635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:26.998635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:26.998635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:26.998635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:26.998635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:26.998635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:26.998635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:26.998635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 197/382] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 578 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:27.006690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279707d-a07f-480c-9727-ab724009dec9 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:27.006690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279707d-a07f-480c-9727-ab724009dec9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:27.006690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279707d-a07f-480c-9727-ab724009dec9 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:27.006690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 198/383] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:27.012491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279707d-a07f-480c-9727-ab724009dec9 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:27.028868 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cebd2c-4e38-4027-8020-fd68a72b6dbf None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:27.135770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279707d-a07f-480c-9727-ab724009dec9 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:27.138258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8b518-c904-45ee-8693-dffba93b37c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:27.138448 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b518-c904-45ee-8693-dffba93b37c3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:27.140460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b518-c904-45ee-8693-dffba93b37c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:27.140460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b518-c904-45ee-8693-dffba93b37c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:27.140460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8b518-c904-45ee-8693-dffba93b37c3 None admin] RBAC: Adding query filter params (group.id=594a30ff998b42f686d8a1756bb72e32, role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=2ea0112c11004c7db4f26fe8670575dc) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:27.140460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8b518-c904-45ee-8693-dffba93b37c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:27.141992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8b518-c904-45ee-8693-dffba93b37c3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:27.166544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 186/384] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jul 21 12:01:26 2022] GET /identity/v3/role_assignments?group.id=594a30ff998b42f686d8a1756bb72e32&scope.project.id=2ea0112c11004c7db4f26fe8670575dc&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 260 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:27.166544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309b46e-a97d-4116-a78b-e1be24be5925 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:27.166544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309b46e-a97d-4116-a78b-e1be24be5925 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:27.166544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309b46e-a97d-4116-a78b-e1be24be5925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:27.218806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a309b46e-a97d-4116-a78b-e1be24be5925 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:27.218806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a309b46e-a97d-4116-a78b-e1be24be5925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:27.242430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ff0ce-4290-47cc-98c9-a120d9a58313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:27.246802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ff0ce-4290-47cc-98c9-a120d9a58313 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:27.246802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ff0ce-4290-47cc-98c9-a120d9a58313 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:27.246802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ff0ce-4290-47cc-98c9-a120d9a58313 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:27.246802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ff0ce-4290-47cc-98c9-a120d9a58313 None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:27.246802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ff0ce-4290-47cc-98c9-a120d9a58313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:27.248523 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ff0ce-4290-47cc-98c9-a120d9a58313 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:27.278713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 199/385] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:27.282926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ff0ce-4290-47cc-98c9-a120d9a58313 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:27.337902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:27.351144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:27.435496 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 187/386] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:27.487964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309b46e-a97d-4116-a78b-e1be24be5925 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:27.606462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ff0ce-4290-47cc-98c9-a120d9a58313 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:27.697606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9709706-1faa-4d46-a3b7-df1eb6291f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:27.699194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9709706-1faa-4d46-a3b7-df1eb6291f5f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:27.699687 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9709706-1faa-4d46-a3b7-df1eb6291f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:27.700246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9709706-1faa-4d46-a3b7-df1eb6291f5f None admin] PATH_INFO: `/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:27.704465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9709706-1faa-4d46-a3b7-df1eb6291f5f None admin] RBAC: Authorizing `identity:get_group(group_id=7d0bd34480f94a8593b05b2e828dfbaf)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:27.706966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9709706-1faa-4d46-a3b7-df1eb6291f5f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:27.710218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 200/387] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:27 2022] GET /identity/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf => generated 226 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:27.716303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9709706-1faa-4d46-a3b7-df1eb6291f5f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:27.727191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309b46e-a97d-4116-a78b-e1be24be5925 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:27.808106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe888472-1820-4146-90d8-8a6075f40b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:27.808947 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe888472-1820-4146-90d8-8a6075f40b95 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:27.809231 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe888472-1820-4146-90d8-8a6075f40b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:27.809508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe888472-1820-4146-90d8-8a6075f40b95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:27.832978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe888472-1820-4146-90d8-8a6075f40b95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-fe888472-1820-4146-90d8-8a6075f40b95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:27.843280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:27.845510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:27.848187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:27.848187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:27.848187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:27.848187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:27.848187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:27.848187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:27.848187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:27.848187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:27.848187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:27.848187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:27.848187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:27.848187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:27.848187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 188/388] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:01:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:27.851752 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe888472-1820-4146-90d8-8a6075f40b95 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:27.943222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:28.003184 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9709706-1faa-4d46-a3b7-df1eb6291f5f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:28.019301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:28.140214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd012144-853c-4e89-aac2-6330d5173c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:28.141096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd012144-853c-4e89-aac2-6330d5173c3b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:28.141377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd012144-853c-4e89-aac2-6330d5173c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:28.141645 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd012144-853c-4e89-aac2-6330d5173c3b None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:28.147645 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd012144-853c-4e89-aac2-6330d5173c3b None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:28.149143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd012144-853c-4e89-aac2-6330d5173c3b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:28.151392 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 201/389] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:27 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:28.157196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd012144-853c-4e89-aac2-6330d5173c3b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:28.188297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe888472-1820-4146-90d8-8a6075f40b95 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:28.261714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747d9f3-32b5-455f-9df7-9758a4af9aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:28.263756 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d9f3-32b5-455f-9df7-9758a4af9aee None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:28.264572 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d9f3-32b5-455f-9df7-9758a4af9aee None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:28.265334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d9f3-32b5-455f-9df7-9758a4af9aee None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:28.267469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747d9f3-32b5-455f-9df7-9758a4af9aee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:28.268341 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747d9f3-32b5-455f-9df7-9758a4af9aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:28.271590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747d9f3-32b5-455f-9df7-9758a4af9aee None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:28.292200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 189/390] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:28.300486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747d9f3-32b5-455f-9df7-9758a4af9aee None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:28.362894 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd012144-853c-4e89-aac2-6330d5173c3b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:28.408307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8c049-da72-4656-b0f9-fcd85e20f391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:28.409147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8c049-da72-4656-b0f9-fcd85e20f391 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:28.409429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8c049-da72-4656-b0f9-fcd85e20f391 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:28.409704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8c049-da72-4656-b0f9-fcd85e20f391 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793/groups/7d0bd34480f94a8593b05b2e828dfbaf/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:28.415601 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8c049-da72-4656-b0f9-fcd85e20f391 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b45dfbbda8f46df9f9ad99a6691e793, group_id=7d0bd34480f94a8593b05b2e828dfbaf, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:28.417181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8c049-da72-4656-b0f9-fcd85e20f391 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:28.452246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 202/391] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jul 21 12:01:28 2022] PUT /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793/groups/7d0bd34480f94a8593b05b2e828dfbaf/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:01:28.524336 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747d9f3-32b5-455f-9df7-9758a4af9aee None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:28.526153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:28.582518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c2330-7127-49c6-af6b-6407baab658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:28.583489 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c2330-7127-49c6-af6b-6407baab658c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:28.583773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c2330-7127-49c6-af6b-6407baab658c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:28.584054 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c2330-7127-49c6-af6b-6407baab658c None admin] PATH_INFO: `/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:28.585592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c2330-7127-49c6-af6b-6407baab658c None admin] RBAC: Authorizing `identity:get_group(group_id=7d0bd34480f94a8593b05b2e828dfbaf)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:28.587194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c2330-7127-49c6-af6b-6407baab658c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:28.589075 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 190/392] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:28 2022] GET /identity/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:28.596084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8c049-da72-4656-b0f9-fcd85e20f391 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:28.634548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:28.794910 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8c049-da72-4656-b0f9-fcd85e20f391 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:28.853263 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2f24e-0f95-4a30-bb11-8fd28abf9bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:28.854188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f24e-0f95-4a30-bb11-8fd28abf9bca None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:28.854467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f24e-0f95-4a30-bb11-8fd28abf9bca None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:28.854778 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f24e-0f95-4a30-bb11-8fd28abf9bca None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:28.859532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2f24e-0f95-4a30-bb11-8fd28abf9bca None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:28.861140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2f24e-0f95-4a30-bb11-8fd28abf9bca None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:28.863070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 203/393] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:28 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:28.870183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c2330-7127-49c6-af6b-6407baab658c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:29.128127 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c2330-7127-49c6-af6b-6407baab658c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:29.219890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b50ad-b6c6-44e4-b03a-f91b48b1294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:29.221907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b50ad-b6c6-44e4-b03a-f91b48b1294d None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:29.222761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b50ad-b6c6-44e4-b03a-f91b48b1294d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:29.223510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b50ad-b6c6-44e4-b03a-f91b48b1294d None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793/groups/7d0bd34480f94a8593b05b2e828dfbaf/roles/a6779b95437c46648185d3ce128f658b` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:29.227836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b50ad-b6c6-44e4-b03a-f91b48b1294d None admin] RBAC: Authorizing `identity:create_grant(project_id=1b45dfbbda8f46df9f9ad99a6691e793, group_id=7d0bd34480f94a8593b05b2e828dfbaf, role_id=a6779b95437c46648185d3ce128f658b)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:29.231080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b50ad-b6c6-44e4-b03a-f91b48b1294d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:29.275088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 191/394] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jul 21 12:01:28 2022] PUT /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793/groups/7d0bd34480f94a8593b05b2e828dfbaf/roles/a6779b95437c46648185d3ce128f658b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:01:29.348708 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157d781-3aea-4f40-ad5f-dccf395bb4c0 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:29.349140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157d781-3aea-4f40-ad5f-dccf395bb4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:29.349310 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157d781-3aea-4f40-ad5f-dccf395bb4c0 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:29.350963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 204/395] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:29.362176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8a83a-2d78-42ac-ad7e-4fbdc5e6e2fb None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:29.363319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8a83a-2d78-42ac-ad7e-4fbdc5e6e2fb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:29.364149 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8a83a-2d78-42ac-ad7e-4fbdc5e6e2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:29.402757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1ef8a83a-2d78-42ac-ad7e-4fbdc5e6e2fb None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:29.405411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1ef8a83a-2d78-42ac-ad7e-4fbdc5e6e2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:29.456228 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:29.528135 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 192/396] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:29.567300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157d781-3aea-4f40-ad5f-dccf395bb4c0 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:29.660946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:29.700487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157d781-3aea-4f40-ad5f-dccf395bb4c0 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:29.752460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f7b0a-2f85-4d85-aaf1-a10bc4930432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:29.753295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7b0a-2f85-4d85-aaf1-a10bc4930432 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:29.753581 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7b0a-2f85-4d85-aaf1-a10bc4930432 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:29.753861 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7b0a-2f85-4d85-aaf1-a10bc4930432 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:29.768702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f7b0a-2f85-4d85-aaf1-a10bc4930432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-482f7b0a-2f85-4d85-aaf1-a10bc4930432 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:29.776958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:29.778559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:29.780237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:29.780237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:29.780237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:29.780237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:29.780237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:29.780237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:29.780237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:29.780237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:29.780237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:29.780237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:29.780237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:29.780237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:29.785519 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 205/397] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:01:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:29.788595 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8a83a-2d78-42ac-ad7e-4fbdc5e6e2fb None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:29.829894 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaa2ad-e57d-429f-9fba-c04f31a3baec None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:29.830427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaa2ad-e57d-429f-9fba-c04f31a3baec None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:29.830427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaa2ad-e57d-429f-9fba-c04f31a3baec None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:29.832281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 206/398] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:29.838315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c482f-5c81-4b41-a86f-9774e5a69776 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:29.838740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c482f-5c81-4b41-a86f-9774e5a69776 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:29.838997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c482f-5c81-4b41-a86f-9774e5a69776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:29.881433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1e8c482f-5c81-4b41-a86f-9774e5a69776 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:29.882706 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1e8c482f-5c81-4b41-a86f-9774e5a69776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:29.926691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8a83a-2d78-42ac-ad7e-4fbdc5e6e2fb None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:29.966063 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacd509-bda8-4825-a5a1-43e304f2b48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:29.966803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacd509-bda8-4825-a5a1-43e304f2b48a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:29.967089 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacd509-bda8-4825-a5a1-43e304f2b48a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:29.967367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacd509-bda8-4825-a5a1-43e304f2b48a None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:29.968139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacd509-bda8-4825-a5a1-43e304f2b48a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:29.968445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacd509-bda8-4825-a5a1-43e304f2b48a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:29.970092 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacd509-bda8-4825-a5a1-43e304f2b48a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:29.980423 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 193/399] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:29.988638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacd509-bda8-4825-a5a1-43e304f2b48a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:30.067197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:30.077785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 207/400] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:30.148331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacd509-bda8-4825-a5a1-43e304f2b48a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:30.148585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c482f-5c81-4b41-a86f-9774e5a69776 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:30.186453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d971d-faf4-4f0e-95a2-fbcf4e0fe737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:30.187269 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d971d-faf4-4f0e-95a2-fbcf4e0fe737 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:30.187557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d971d-faf4-4f0e-95a2-fbcf4e0fe737 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:30.187881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d971d-faf4-4f0e-95a2-fbcf4e0fe737 None admin] PATH_INFO: `/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:30.189120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d971d-faf4-4f0e-95a2-fbcf4e0fe737 None admin] RBAC: Authorizing `identity:get_group(group_id=7d0bd34480f94a8593b05b2e828dfbaf)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:30.190731 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d971d-faf4-4f0e-95a2-fbcf4e0fe737 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:30.192819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 194/401] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:29 2022] GET /identity/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:30.216390 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d971d-faf4-4f0e-95a2-fbcf4e0fe737 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:30.301864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:30.370792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:30.384343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c482f-5c81-4b41-a86f-9774e5a69776 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:30.390950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d971d-faf4-4f0e-95a2-fbcf4e0fe737 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:30.471636 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6c42a-e35e-4e9d-992d-7e95560d0c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:30.472564 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6c42a-e35e-4e9d-992d-7e95560d0c90 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:30.472847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6c42a-e35e-4e9d-992d-7e95560d0c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:30.473222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6c42a-e35e-4e9d-992d-7e95560d0c90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:30.484457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cff55-4c2e-4cb4-bde9-b775155b41c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:30.485396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cff55-4c2e-4cb4-bde9-b775155b41c1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:30.485678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cff55-4c2e-4cb4-bde9-b775155b41c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:30.485956 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cff55-4c2e-4cb4-bde9-b775155b41c1 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:30.486115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6c42a-e35e-4e9d-992d-7e95560d0c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:30.487232 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cff55-4c2e-4cb4-bde9-b775155b41c1 None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:30.488684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cff55-4c2e-4cb4-bde9-b775155b41c1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:30.490953 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 195/402] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:30 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:30.492314 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335121e4-fbd1-4a61-bed8-83e983413835 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:30.492651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335121e4-fbd1-4a61-bed8-83e983413835 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:30.492932 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335121e4-fbd1-4a61-bed8-83e983413835 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-fef6c42a-e35e-4e9d-992d-7e95560d0c90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:30.493897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:30.495529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:30.497038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:30.497038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:30.497038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:30.497038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:30.497038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:30.497038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:30.497038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:30.497038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:30.497038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:30.497038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:30.497038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:30.497038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:30.498165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 196/403] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:30.498291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 208/404] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:30.502683 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335121e4-fbd1-4a61-bed8-83e983413835 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:30.503613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1ff1-53a0-40cd-b495-4296ccdc02d7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:30.503899 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1ff1-53a0-40cd-b495-4296ccdc02d7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:30.504404 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1ff1-53a0-40cd-b495-4296ccdc02d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:30.523738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-937a1ff1-53a0-40cd-b495-4296ccdc02d7 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:30.524940 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-937a1ff1-53a0-40cd-b495-4296ccdc02d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:30.608321 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 209/405] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:30.609306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a1ff1-53a0-40cd-b495-4296ccdc02d7 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:30.630491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335121e4-fbd1-4a61-bed8-83e983413835 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:30.684531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:30.689576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea70b4-8dd5-42c7-9a9c-9d5044858763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:30.691179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea70b4-8dd5-42c7-9a9c-9d5044858763 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:30.691877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea70b4-8dd5-42c7-9a9c-9d5044858763 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:30.692700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea70b4-8dd5-42c7-9a9c-9d5044858763 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8/groups/7d0bd34480f94a8593b05b2e828dfbaf/roles/a6779b95437c46648185d3ce128f658b` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:30.695402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea70b4-8dd5-42c7-9a9c-9d5044858763 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8968618a5b8461fbd567cb7fdbd05b8, group_id=7d0bd34480f94a8593b05b2e828dfbaf, role_id=a6779b95437c46648185d3ce128f658b)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:30.698035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea70b4-8dd5-42c7-9a9c-9d5044858763 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:30.721870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 197/406] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jul 21 12:01:30 2022] PUT /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8/groups/7d0bd34480f94a8593b05b2e828dfbaf/roles/a6779b95437c46648185d3ce128f658b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:01:30.723502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea70b4-8dd5-42c7-9a9c-9d5044858763 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:30.745249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a1ff1-53a0-40cd-b495-4296ccdc02d7 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:30.751164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:30.817974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623cf7e-726f-4728-8ccd-fa46a9cf709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:30.818992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623cf7e-726f-4728-8ccd-fa46a9cf709c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:30.819447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623cf7e-726f-4728-8ccd-fa46a9cf709c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:30.819859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623cf7e-726f-4728-8ccd-fa46a9cf709c None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:30.820937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623cf7e-726f-4728-8ccd-fa46a9cf709c None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:30.821412 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623cf7e-726f-4728-8ccd-fa46a9cf709c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:30.823059 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623cf7e-726f-4728-8ccd-fa46a9cf709c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:30.835130 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 210/407] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:30.845304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623cf7e-726f-4728-8ccd-fa46a9cf709c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:30.948640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea70b4-8dd5-42c7-9a9c-9d5044858763 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:30.987456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623cf7e-726f-4728-8ccd-fa46a9cf709c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:31.008204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:31.019653 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd744136-6690-468d-a665-61f2200af73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:31.021042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd744136-6690-468d-a665-61f2200af73e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:31.021526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd744136-6690-468d-a665-61f2200af73e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:31.022081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd744136-6690-468d-a665-61f2200af73e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:31.031059 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202c6d-4679-4184-848f-4e22f96143a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:31.032271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202c6d-4679-4184-848f-4e22f96143a5 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:31.032702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202c6d-4679-4184-848f-4e22f96143a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:31.033124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202c6d-4679-4184-848f-4e22f96143a5 None admin] PATH_INFO: `/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:31.034611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86202c6d-4679-4184-848f-4e22f96143a5 None admin] RBAC: Authorizing `identity:get_group(group_id=7d0bd34480f94a8593b05b2e828dfbaf)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:31.036291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86202c6d-4679-4184-848f-4e22f96143a5 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:31.038857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 211/408] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:30 2022] GET /identity/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:31.044168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd744136-6690-468d-a665-61f2200af73e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:31.044602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202c6d-4679-4184-848f-4e22f96143a5 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-bd744136-6690-468d-a665-61f2200af73e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:31.060376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:31.061539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:31.062523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:31.062523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:31.062523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:31.062523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:31.062523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:31.062523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:31.062523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:31.062523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:31.062523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:31.062523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:31.062523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:01:31.062523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:31.062523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 198/409] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:01:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:31.070385 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd744136-6690-468d-a665-61f2200af73e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:31.220514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202c6d-4679-4184-848f-4e22f96143a5 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:31.269736 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378032ff-931e-489c-94c4-142f4a313f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:31.271158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378032ff-931e-489c-94c4-142f4a313f03 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:31.271756 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378032ff-931e-489c-94c4-142f4a313f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:31.272234 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378032ff-931e-489c-94c4-142f4a313f03 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:31.278137 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378032ff-931e-489c-94c4-142f4a313f03 None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:31.278880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:31.281109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378032ff-931e-489c-94c4-142f4a313f03 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:31.284050 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 212/410] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:31 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:31.289962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378032ff-931e-489c-94c4-142f4a313f03 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:31.315003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd744136-6690-468d-a665-61f2200af73e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:31.384799 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa54b7-970c-485f-9fa0-0072e2f964de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:31.385993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa54b7-970c-485f-9fa0-0072e2f964de None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:31.386485 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa54b7-970c-485f-9fa0-0072e2f964de None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:31.386963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa54b7-970c-485f-9fa0-0072e2f964de None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:31.388285 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa54b7-970c-485f-9fa0-0072e2f964de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:31.388811 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa54b7-970c-485f-9fa0-0072e2f964de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:31.397885 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa54b7-970c-485f-9fa0-0072e2f964de None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:31.418334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 199/411] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:31.430894 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa54b7-970c-485f-9fa0-0072e2f964de None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:31.439105 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:31.550540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378032ff-931e-489c-94c4-142f4a313f03 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:31.607426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a526f-00f7-4416-ad50-eaad341ecb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:31.609828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a526f-00f7-4416-ad50-eaad341ecb62 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:31.611235 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a526f-00f7-4416-ad50-eaad341ecb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:31.611968 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a526f-00f7-4416-ad50-eaad341ecb62 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8/groups/7d0bd34480f94a8593b05b2e828dfbaf/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:31.615923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a526f-00f7-4416-ad50-eaad341ecb62 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8968618a5b8461fbd567cb7fdbd05b8, group_id=7d0bd34480f94a8593b05b2e828dfbaf, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:31.620068 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a526f-00f7-4416-ad50-eaad341ecb62 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:31.650808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 213/412] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jul 21 12:01:31 2022] PUT /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8/groups/7d0bd34480f94a8593b05b2e828dfbaf/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:01:31.653727 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a9c9-04ce-448a-835d-f2c40d35eccd None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:31.654760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a9c9-04ce-448a-835d-f2c40d35eccd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:31.655611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a9c9-04ce-448a-835d-f2c40d35eccd None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:31.658827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 214/413] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:31.669006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb9387-48fd-482c-a9ad-176c4fa72459 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:31.669945 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb9387-48fd-482c-a9ad-176c4fa72459 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:31.670792 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb9387-48fd-482c-a9ad-176c4fa72459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:31.679919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa54b7-970c-485f-9fa0-0072e2f964de None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:31.705252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3acb9387-48fd-482c-a9ad-176c4fa72459 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:31.708684 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3acb9387-48fd-482c-a9ad-176c4fa72459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:31.722500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06329c73-a495-449c-8493-3eb7c026d894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:31.723442 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329c73-a495-449c-8493-3eb7c026d894 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:31.723734 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329c73-a495-449c-8493-3eb7c026d894 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:31.723990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329c73-a495-449c-8493-3eb7c026d894 None admin] PATH_INFO: `/v3/groups/594a30ff998b42f686d8a1756bb72e32` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:31.725651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06329c73-a495-449c-8493-3eb7c026d894 None admin] RBAC: Authorizing `identity:get_group(group_id=594a30ff998b42f686d8a1756bb72e32)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:31.727326 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06329c73-a495-449c-8493-3eb7c026d894 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:31.729352 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 200/414] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:31 2022] GET /identity/v3/groups/594a30ff998b42f686d8a1756bb72e32 => generated 229 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:31.735504 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06329c73-a495-449c-8493-3eb7c026d894 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:31.747887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:31.853543 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06329c73-a495-449c-8493-3eb7c026d894 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:31.858609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 215/415] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:31.894887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1bd03-944f-4eed-a84b-902319f7d160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:31.895848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1bd03-944f-4eed-a84b-902319f7d160 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:31.896177 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1bd03-944f-4eed-a84b-902319f7d160 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:31.896455 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1bd03-944f-4eed-a84b-902319f7d160 None admin] PATH_INFO: `/v3/projects/2ea0112c11004c7db4f26fe8670575dc` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:31.897855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1bd03-944f-4eed-a84b-902319f7d160 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea0112c11004c7db4f26fe8670575dc)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:31.899456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1bd03-944f-4eed-a84b-902319f7d160 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:31.901877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 201/416] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:31 2022] GET /identity/v3/projects/2ea0112c11004c7db4f26fe8670575dc => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:31.904859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb9387-48fd-482c-a9ad-176c4fa72459 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:31.907924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1bd03-944f-4eed-a84b-902319f7d160 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:31.996210 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:32.005830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:32.023903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1bd03-944f-4eed-a84b-902319f7d160 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:32.062783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aa970-3772-4fd8-8b58-c763ca77bf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:32.064758 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aa970-3772-4fd8-8b58-c763ca77bf68 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:32.065065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aa970-3772-4fd8-8b58-c763ca77bf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:32.065344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aa970-3772-4fd8-8b58-c763ca77bf68 None admin] PATH_INFO: `/v3/projects/2ea0112c11004c7db4f26fe8670575dc/groups/594a30ff998b42f686d8a1756bb72e32/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:32.067579 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aa970-3772-4fd8-8b58-c763ca77bf68 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ea0112c11004c7db4f26fe8670575dc, group_id=594a30ff998b42f686d8a1756bb72e32, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:32.069039 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aa970-3772-4fd8-8b58-c763ca77bf68 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:32.088030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 202/417] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jul 21 12:01:31 2022] PUT /identity/v3/projects/2ea0112c11004c7db4f26fe8670575dc/groups/594a30ff998b42f686d8a1756bb72e32/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:01:32.133219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb9387-48fd-482c-a9ad-176c4fa72459 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:32.208413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee88f5c-f4b2-4ffe-8fd2-ec450e58cdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:32.210303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee88f5c-f4b2-4ffe-8fd2-ec450e58cdbc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:32.211315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee88f5c-f4b2-4ffe-8fd2-ec450e58cdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:32.212076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee88f5c-f4b2-4ffe-8fd2-ec450e58cdbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:32.234983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee88f5c-f4b2-4ffe-8fd2-ec450e58cdbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-cee88f5c-f4b2-4ffe-8fd2-ec450e58cdbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:32.251280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:32.253021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:32.255301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:32.255301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:32.255301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:32.255301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:32.255301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:32.255301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:32.255301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:32.255301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:32.255301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:32.255301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:32.255301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:32.255301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:32.259815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 216/418] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:32.270210 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aa970-3772-4fd8-8b58-c763ca77bf68 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:32.489164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aa970-3772-4fd8-8b58-c763ca77bf68 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:32.580886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6902101-7daf-43f7-a15e-62b6b66110a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:32.582007 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6902101-7daf-43f7-a15e-62b6b66110a8 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:32.582490 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6902101-7daf-43f7-a15e-62b6b66110a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:32.582998 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6902101-7daf-43f7-a15e-62b6b66110a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:32.584386 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6902101-7daf-43f7-a15e-62b6b66110a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:32.584917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6902101-7daf-43f7-a15e-62b6b66110a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:32.587576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6902101-7daf-43f7-a15e-62b6b66110a8 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:32.596840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:32.614869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 203/419] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:32.626316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee88f5c-f4b2-4ffe-8fd2-ec450e58cdbc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:32.639667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f26d1-ec8c-4142-bbda-7ed150369ffd None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:32.640113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f26d1-ec8c-4142-bbda-7ed150369ffd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:32.640574 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f26d1-ec8c-4142-bbda-7ed150369ffd None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:32.645045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 204/420] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:32.649684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c77039-8a6d-4b08-a472-d544adfa731f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:32.650132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c77039-8a6d-4b08-a472-d544adfa731f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:32.650594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c77039-8a6d-4b08-a472-d544adfa731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:32.700356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e7c77039-8a6d-4b08-a472-d544adfa731f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:32.702624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e7c77039-8a6d-4b08-a472-d544adfa731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:32.834144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee88f5c-f4b2-4ffe-8fd2-ec450e58cdbc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:32.840230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:32.897099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 205/421] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:32.907314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815fcc2-01f9-4902-b8d8-96817dafdcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:32.908901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815fcc2-01f9-4902-b8d8-96817dafdcfc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:32.909682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815fcc2-01f9-4902-b8d8-96817dafdcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:32.910415 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815fcc2-01f9-4902-b8d8-96817dafdcfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:32.950205 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c77039-8a6d-4b08-a472-d544adfa731f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:33.047435 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815fcc2-01f9-4902-b8d8-96817dafdcfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:33.050772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815fcc2-01f9-4902-b8d8-96817dafdcfc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:33.138278 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c77039-8a6d-4b08-a472-d544adfa731f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:33.188174 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:33.208487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbe502-ce60-4a99-9072-dff5e31b92bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:33.209326 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbe502-ce60-4a99-9072-dff5e31b92bb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:33.209607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbe502-ce60-4a99-9072-dff5e31b92bb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:33.209872 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbe502-ce60-4a99-9072-dff5e31b92bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:33.228690 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbe502-ce60-4a99-9072-dff5e31b92bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-f8bbe502-ce60-4a99-9072-dff5e31b92bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:33.245312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:33.247079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:33.248620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:33.248620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:33.248620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:33.248620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:33.248620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:33.248620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:33.248620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:33.248620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:33.248620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:33.248620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:33.248620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:33.248620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:33.248620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 206/422] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:01:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:33.255763 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbe502-ce60-4a99-9072-dff5e31b92bb None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:33.263129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 217/423] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:33.273120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815fcc2-01f9-4902-b8d8-96817dafdcfc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:33.279725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:33.491589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815fcc2-01f9-4902-b8d8-96817dafdcfc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:33.557002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01ccb6-0edc-4bf9-b57d-2b80273a70b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:33.559034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01ccb6-0edc-4bf9-b57d-2b80273a70b1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:33.559754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01ccb6-0edc-4bf9-b57d-2b80273a70b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:33.560453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01ccb6-0edc-4bf9-b57d-2b80273a70b1 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:33.563288 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01ccb6-0edc-4bf9-b57d-2b80273a70b1 None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:33.566360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01ccb6-0edc-4bf9-b57d-2b80273a70b1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:33.569883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 218/424] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:33 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:33.579714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01ccb6-0edc-4bf9-b57d-2b80273a70b1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:33.598199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbe502-ce60-4a99-9072-dff5e31b92bb None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:33.691405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bccc6-53be-48d8-a614-f43ad6c70caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:33.692462 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bccc6-53be-48d8-a614-f43ad6c70caf None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:33.692936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bccc6-53be-48d8-a614-f43ad6c70caf None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:33.693400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bccc6-53be-48d8-a614-f43ad6c70caf None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:33.694755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bccc6-53be-48d8-a614-f43ad6c70caf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:33.695281 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bccc6-53be-48d8-a614-f43ad6c70caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:33.697735 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bccc6-53be-48d8-a614-f43ad6c70caf None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:33.712723 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 207/425] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:33.717113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:33.722134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b59f2-722c-456b-a715-eccd4d3ff29f None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:33.722726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b59f2-722c-456b-a715-eccd4d3ff29f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:33.723207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b59f2-722c-456b-a715-eccd4d3ff29f None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:33.725663 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 208/426] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:33.726954 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b59f2-722c-456b-a715-eccd4d3ff29f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:33.776303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01ccb6-0edc-4bf9-b57d-2b80273a70b1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:33.810606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:33.846202 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7483b-7184-4e17-8e9a-13bc416e90b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:33.848095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7483b-7184-4e17-8e9a-13bc416e90b0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:33.848718 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7483b-7184-4e17-8e9a-13bc416e90b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:33.849338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7483b-7184-4e17-8e9a-13bc416e90b0 None admin] PATH_INFO: `/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:33.851923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7483b-7184-4e17-8e9a-13bc416e90b0 None admin] RBAC: Authorizing `identity:get_group(group_id=7d0bd34480f94a8593b05b2e828dfbaf)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:33.855003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7483b-7184-4e17-8e9a-13bc416e90b0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:33.858718 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 219/427] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:33 2022] GET /identity/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:33.867203 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514ccf6-b7c1-4aaa-88c2-bd1dfa17aaec None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:33.867203 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514ccf6-b7c1-4aaa-88c2-bd1dfa17aaec None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:33.867203 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514ccf6-b7c1-4aaa-88c2-bd1dfa17aaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:33.888235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b59f2-722c-456b-a715-eccd4d3ff29f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:33.901770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2514ccf6-b7c1-4aaa-88c2-bd1dfa17aaec None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:33.904477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2514ccf6-b7c1-4aaa-88c2-bd1dfa17aaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:33.930145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab82b65-f67e-45e2-8480-82adf7ffc489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:33.931114 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab82b65-f67e-45e2-8480-82adf7ffc489 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:33.931536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab82b65-f67e-45e2-8480-82adf7ffc489 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:33.931980 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab82b65-f67e-45e2-8480-82adf7ffc489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:34.005539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab82b65-f67e-45e2-8480-82adf7ffc489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:34.007281 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab82b65-f67e-45e2-8480-82adf7ffc489 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:34.050681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 220/428] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:34.050681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514ccf6-b7c1-4aaa-88c2-bd1dfa17aaec None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:34.086685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:34.145696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 209/429] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:34.146944 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab82b65-f67e-45e2-8480-82adf7ffc489 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:34.183441 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:34.243553 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514ccf6-b7c1-4aaa-88c2-bd1dfa17aaec None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:34.249051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab82b65-f67e-45e2-8480-82adf7ffc489 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:34.284438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33771e-cb60-4b7e-8243-c9b6b057d362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:34.285258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33771e-cb60-4b7e-8243-c9b6b057d362 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:34.285534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33771e-cb60-4b7e-8243-c9b6b057d362 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:34.285802 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33771e-cb60-4b7e-8243-c9b6b057d362 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:34.296484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33771e-cb60-4b7e-8243-c9b6b057d362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-0c33771e-cb60-4b7e-8243-c9b6b057d362 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:34.304712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:34.306343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:34.308052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:34.308052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:34.308052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:34.308052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:34.308052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:34.308052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:34.308052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:34.308052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:34.308052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:34.308052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:34.308052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:34.308052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:34.308052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 210/430] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:01:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:34.308052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33771e-cb60-4b7e-8243-c9b6b057d362 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:34.320759 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cfafe-46a8-4d3f-bff2-97e7921512b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:34.321479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cfafe-46a8-4d3f-bff2-97e7921512b3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:34.321763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cfafe-46a8-4d3f-bff2-97e7921512b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:34.322036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cfafe-46a8-4d3f-bff2-97e7921512b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:34.322922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cfafe-46a8-4d3f-bff2-97e7921512b3 None admin] RBAC: Adding query filter params (group.id=7d0bd34480f94a8593b05b2e828dfbaf, role.id=67ad028192f24536a65fa57450a563b9, scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:34.323304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cfafe-46a8-4d3f-bff2-97e7921512b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:34.324988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cfafe-46a8-4d3f-bff2-97e7921512b3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:34.335895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:34.342926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 221/431] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jul 21 12:01:34 2022] GET /identity/v3/role_assignments?group.id=7d0bd34480f94a8593b05b2e828dfbaf&scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793&role.id=67ad028192f24536a65fa57450a563b9 => generated 611 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:34.344049 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cfafe-46a8-4d3f-bff2-97e7921512b3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:34.486877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33771e-cb60-4b7e-8243-c9b6b057d362 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:34.535391 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910df463-40d8-46c6-a242-0671cb0d17a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:34.536213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910df463-40d8-46c6-a242-0671cb0d17a4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:34.536489 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910df463-40d8-46c6-a242-0671cb0d17a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:34.536780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910df463-40d8-46c6-a242-0671cb0d17a4 None admin] PATH_INFO: `/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:34.537970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910df463-40d8-46c6-a242-0671cb0d17a4 None admin] RBAC: Authorizing `identity:get_project(project_id=1b45dfbbda8f46df9f9ad99a6691e793)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:34.539483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910df463-40d8-46c6-a242-0671cb0d17a4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:34.541709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 211/432] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:34 2022] GET /identity/v3/projects/1b45dfbbda8f46df9f9ad99a6691e793 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:34.549109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910df463-40d8-46c6-a242-0671cb0d17a4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:34.570180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cfafe-46a8-4d3f-bff2-97e7921512b3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:34.627468 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2a897-7a6e-4bcf-a4f5-ab30ed2e5275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:34.629417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2a897-7a6e-4bcf-a4f5-ab30ed2e5275 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:34.629702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2a897-7a6e-4bcf-a4f5-ab30ed2e5275 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:34.630206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2a897-7a6e-4bcf-a4f5-ab30ed2e5275 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:34.631030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2a897-7a6e-4bcf-a4f5-ab30ed2e5275 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:34.631345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2a897-7a6e-4bcf-a4f5-ab30ed2e5275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:34.633075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2a897-7a6e-4bcf-a4f5-ab30ed2e5275 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:34.634891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:34.649112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 222/433] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:34.655190 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2a897-7a6e-4bcf-a4f5-ab30ed2e5275 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:34.677473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:34.703941 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910df463-40d8-46c6-a242-0671cb0d17a4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:34.740367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba759ab-031a-4b7f-be7b-d0c92060c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:34.742034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba759ab-031a-4b7f-be7b-d0c92060c0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:34.742505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba759ab-031a-4b7f-be7b-d0c92060c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:34.743014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba759ab-031a-4b7f-be7b-d0c92060c0e7 None admin] PATH_INFO: `/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:34.744515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba759ab-031a-4b7f-be7b-d0c92060c0e7 None admin] RBAC: Authorizing `identity:get_group(group_id=7d0bd34480f94a8593b05b2e828dfbaf)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:34.746151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba759ab-031a-4b7f-be7b-d0c92060c0e7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:34.748370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 212/434] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:34 2022] GET /identity/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:34.759789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba759ab-031a-4b7f-be7b-d0c92060c0e7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:34.797101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2a897-7a6e-4bcf-a4f5-ab30ed2e5275 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:34.846416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4145b2-e52c-4f38-93cb-a35583d11107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:34.847201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4145b2-e52c-4f38-93cb-a35583d11107 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:34.847535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4145b2-e52c-4f38-93cb-a35583d11107 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:34.848188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4145b2-e52c-4f38-93cb-a35583d11107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:34.907010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba759ab-031a-4b7f-be7b-d0c92060c0e7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:34.943298 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:34.948056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d9e5e-26da-49d0-8127-4670e162e620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:34.948813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d9e5e-26da-49d0-8127-4670e162e620 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:34.949097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d9e5e-26da-49d0-8127-4670e162e620 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:34.949378 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d9e5e-26da-49d0-8127-4670e162e620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:34.950301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d9e5e-26da-49d0-8127-4670e162e620 None admin] RBAC: Adding query filter params (group.id=7d0bd34480f94a8593b05b2e828dfbaf, role.id=a6779b95437c46648185d3ce128f658b, scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:34.950616 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d9e5e-26da-49d0-8127-4670e162e620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:34.951700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4145b2-e52c-4f38-93cb-a35583d11107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:34.952548 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d9e5e-26da-49d0-8127-4670e162e620 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:34.953580 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4145b2-e52c-4f38-93cb-a35583d11107 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:34.961311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 213/435] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jul 21 12:01:34 2022] GET /identity/v3/role_assignments?group.id=7d0bd34480f94a8593b05b2e828dfbaf&scope.project.id=1b45dfbbda8f46df9f9ad99a6691e793&role.id=a6779b95437c46648185d3ce128f658b => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:34.962811 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06031b2-e21c-4fc6-9018-da3742f54a04 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:34.963101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06031b2-e21c-4fc6-9018-da3742f54a04 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:34.963991 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06031b2-e21c-4fc6-9018-da3742f54a04 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:34.965448 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 214/436] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:34.967387 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d445c4f-0b60-4cad-9502-822aa44ff06a None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:34.967684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d445c4f-0b60-4cad-9502-822aa44ff06a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:34.967982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d445c4f-0b60-4cad-9502-822aa44ff06a None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:34.969856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 215/437] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:34.971943 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06371bbf-ca21-4604-8558-425125987541 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:34.972605 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06371bbf-ca21-4604-8558-425125987541 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:34.972949 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06371bbf-ca21-4604-8558-425125987541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:34.992601 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-06371bbf-ca21-4604-8558-425125987541 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:34.993981 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-06371bbf-ca21-4604-8558-425125987541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:34.997651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:35.107745 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 216/438] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:35.109510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e99d9-fcb6-4d7f-8870-2f1465520125 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:35.109793 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e99d9-fcb6-4d7f-8870-2f1465520125 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:35.110251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e99d9-fcb6-4d7f-8870-2f1465520125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:35.128910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-076e99d9-fcb6-4d7f-8870-2f1465520125 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:35.130138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-076e99d9-fcb6-4d7f-8870-2f1465520125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:35.140337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 223/439] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:35.147350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4145b2-e52c-4f38-93cb-a35583d11107 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:35.230818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 217/440] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:35.231699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e99d9-fcb6-4d7f-8870-2f1465520125 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:35.287503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:35.294215 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4145b2-e52c-4f38-93cb-a35583d11107 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:35.349342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:35.359389 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e87921-8937-4ecd-86bb-e8c9af79bcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:35.361303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e87921-8937-4ecd-86bb-e8c9af79bcce None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:35.361303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e87921-8937-4ecd-86bb-e8c9af79bcce None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:35.361524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e87921-8937-4ecd-86bb-e8c9af79bcce None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:35.365370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e87921-8937-4ecd-86bb-e8c9af79bcce None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:35.367933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e87921-8937-4ecd-86bb-e8c9af79bcce None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:35.371356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 224/441] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:35 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:35.372578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e87921-8937-4ecd-86bb-e8c9af79bcce None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:35.409857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e99d9-fcb6-4d7f-8870-2f1465520125 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:35.468888 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e0e80-d874-4d7a-b96e-aa39994e702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:35.470113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e0e80-d874-4d7a-b96e-aa39994e702a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:35.470541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e0e80-d874-4d7a-b96e-aa39994e702a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:35.471027 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e0e80-d874-4d7a-b96e-aa39994e702a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:35.486895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e0e80-d874-4d7a-b96e-aa39994e702a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-af8e0e80-d874-4d7a-b96e-aa39994e702a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:35.499237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:35.500792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:35.502709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:35.502709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:35.502709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:35.502709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:35.502709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:35.502709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:35.502709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:35.502709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:35.502709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:35.502709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:35.502709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:01:35.502709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:35.502709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 218/442] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:01:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:35.502709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e0e80-d874-4d7a-b96e-aa39994e702a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:35.527609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e87921-8937-4ecd-86bb-e8c9af79bcce None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:35.569139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d9e26-6c96-4bfb-a783-970c0cf095b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:35.570435 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d9e26-6c96-4bfb-a783-970c0cf095b6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:35.570934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d9e26-6c96-4bfb-a783-970c0cf095b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:35.571413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d9e26-6c96-4bfb-a783-970c0cf095b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:35.585953 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d9e26-6c96-4bfb-a783-970c0cf095b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-208d9e26-6c96-4bfb-a783-970c0cf095b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:35.594611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:35.595605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:35.596388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:35.596388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:35.596388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:35.596388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:35.596388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:35.596388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:35.596388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:35.596388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:35.596388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:35.596388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:35.596388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 12:01:35.596388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:35.597121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 225/443] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:35.597923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d9e26-6c96-4bfb-a783-970c0cf095b6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:35.620350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e0e80-d874-4d7a-b96e-aa39994e702a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:35.626563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:35.651298 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:35.658539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc95fa-1f00-4d05-afab-cdfb8ba99ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:35.659460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc95fa-1f00-4d05-afab-cdfb8ba99ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:35.659799 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc95fa-1f00-4d05-afab-cdfb8ba99ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:35.660083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc95fa-1f00-4d05-afab-cdfb8ba99ec7 None admin] PATH_INFO: `/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:35.661363 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc95fa-1f00-4d05-afab-cdfb8ba99ec7 None admin] RBAC: Authorizing `identity:get_group(group_id=7d0bd34480f94a8593b05b2e828dfbaf)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:35.662891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc95fa-1f00-4d05-afab-cdfb8ba99ec7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:35.664785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 219/444] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:35 2022] GET /identity/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:35.665395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc95fa-1f00-4d05-afab-cdfb8ba99ec7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:35.714061 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d9e26-6c96-4bfb-a783-970c0cf095b6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:35.751069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3bc94-255c-4820-af58-56a6c4871a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:35.751771 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3bc94-255c-4820-af58-56a6c4871a15 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:35.762141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3bc94-255c-4820-af58-56a6c4871a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:35.762471 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3bc94-255c-4820-af58-56a6c4871a15 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:35.763311 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3bc94-255c-4820-af58-56a6c4871a15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:35.763624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3bc94-255c-4820-af58-56a6c4871a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:35.765056 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3bc94-255c-4820-af58-56a6c4871a15 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:35.771047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc95fa-1f00-4d05-afab-cdfb8ba99ec7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:35.775193 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 226/445] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:35.776709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3bc94-255c-4820-af58-56a6c4871a15 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:35.811162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb82de-fdcb-468b-a3a4-d59f99f812a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:35.812219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb82de-fdcb-468b-a3a4-d59f99f812a9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:35.812779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb82de-fdcb-468b-a3a4-d59f99f812a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:35.813234 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb82de-fdcb-468b-a3a4-d59f99f812a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:35.814541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb82de-fdcb-468b-a3a4-d59f99f812a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:35.815083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb82de-fdcb-468b-a3a4-d59f99f812a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:35.817440 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb82de-fdcb-468b-a3a4-d59f99f812a9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:35.831519 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 220/446] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:01:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:35.832516 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb82de-fdcb-468b-a3a4-d59f99f812a9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:35.903134 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:35.920192 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:35.922381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3bc94-255c-4820-af58-56a6c4871a15 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:35.969430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dc08a-0b0d-44b6-893d-2888f2f6b792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:35.970113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dc08a-0b0d-44b6-893d-2888f2f6b792 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:35.970401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dc08a-0b0d-44b6-893d-2888f2f6b792 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:35.970693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dc08a-0b0d-44b6-893d-2888f2f6b792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:35.971558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dc08a-0b0d-44b6-893d-2888f2f6b792 None admin] RBAC: Adding query filter params (group.id=7d0bd34480f94a8593b05b2e828dfbaf, role.id=a6779b95437c46648185d3ce128f658b, scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:35.971872 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dc08a-0b0d-44b6-893d-2888f2f6b792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:35.973328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dc08a-0b0d-44b6-893d-2888f2f6b792 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:35.975981 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb82de-fdcb-468b-a3a4-d59f99f812a9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:35.979856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 227/447] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jul 21 12:01:35 2022] GET /identity/v3/role_assignments?group.id=7d0bd34480f94a8593b05b2e828dfbaf&scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8&role.id=a6779b95437c46648185d3ce128f658b => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:35.980690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dc08a-0b0d-44b6-893d-2888f2f6b792 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:36.032016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07274d8-a3ce-47fe-a79f-a66186f0758b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:36.032692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07274d8-a3ce-47fe-a79f-a66186f0758b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:36.032980 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07274d8-a3ce-47fe-a79f-a66186f0758b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:36.033254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07274d8-a3ce-47fe-a79f-a66186f0758b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:36.114682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dc08a-0b0d-44b6-893d-2888f2f6b792 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:36.122557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07274d8-a3ce-47fe-a79f-a66186f0758b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:36.124788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07274d8-a3ce-47fe-a79f-a66186f0758b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:36.157284 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972891c-c108-4087-84ad-5827986d6d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:36.157841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972891c-c108-4087-84ad-5827986d6d22 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:36.158129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972891c-c108-4087-84ad-5827986d6d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:36.158415 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972891c-c108-4087-84ad-5827986d6d22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:36.183066 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:36.210311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:36.253665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972891c-c108-4087-84ad-5827986d6d22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:36.255194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972891c-c108-4087-84ad-5827986d6d22 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:36.264325 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 221/448] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:36.270458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07274d8-a3ce-47fe-a79f-a66186f0758b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:36.364665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 228/449] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:36.370489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972891c-c108-4087-84ad-5827986d6d22 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:36.398082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07274d8-a3ce-47fe-a79f-a66186f0758b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:36.427238 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:36.438761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a93b8-31e9-4056-82ec-9f617a1f255b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:36.439646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a93b8-31e9-4056-82ec-9f617a1f255b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:36.439930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a93b8-31e9-4056-82ec-9f617a1f255b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:36.440206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a93b8-31e9-4056-82ec-9f617a1f255b None admin] PATH_INFO: `/v3/projects/2ea0112c11004c7db4f26fe8670575dc` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:36.441522 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a93b8-31e9-4056-82ec-9f617a1f255b None admin] RBAC: Authorizing `identity:get_project(project_id=2ea0112c11004c7db4f26fe8670575dc)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:36.443015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a93b8-31e9-4056-82ec-9f617a1f255b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:36.444935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 222/450] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:36 2022] GET /identity/v3/projects/2ea0112c11004c7db4f26fe8670575dc => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:36.450467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a93b8-31e9-4056-82ec-9f617a1f255b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:36.480718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:36.487280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972891c-c108-4087-84ad-5827986d6d22 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:36.523404 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefd540-33b8-4a98-852a-a7da219c5ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:36.524369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd540-33b8-4a98-852a-a7da219c5ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:36.524655 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd540-33b8-4a98-852a-a7da219c5ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:36.524937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd540-33b8-4a98-852a-a7da219c5ad8 None admin] PATH_INFO: `/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:36.526228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefd540-33b8-4a98-852a-a7da219c5ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=d8968618a5b8461fbd567cb7fdbd05b8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:36.527719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefd540-33b8-4a98-852a-a7da219c5ad8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:36.529530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 229/451] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:01:36 2022] GET /identity/v3/projects/d8968618a5b8461fbd567cb7fdbd05b8 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:36.535376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefd540-33b8-4a98-852a-a7da219c5ad8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:36.557069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a93b8-31e9-4056-82ec-9f617a1f255b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:36.594181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445dc41-66d6-4c6c-abcd-dbf31b7d5e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:36.595224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445dc41-66d6-4c6c-abcd-dbf31b7d5e1d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:36.595646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445dc41-66d6-4c6c-abcd-dbf31b7d5e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:36.595977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445dc41-66d6-4c6c-abcd-dbf31b7d5e1d None admin] PATH_INFO: `/v3/groups/594a30ff998b42f686d8a1756bb72e32` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:36.597646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445dc41-66d6-4c6c-abcd-dbf31b7d5e1d None admin] RBAC: Authorizing `identity:get_group(group_id=594a30ff998b42f686d8a1756bb72e32)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:36.599313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445dc41-66d6-4c6c-abcd-dbf31b7d5e1d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:36.606993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 223/452] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:36 2022] GET /identity/v3/groups/594a30ff998b42f686d8a1756bb72e32 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:36.609195 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445dc41-66d6-4c6c-abcd-dbf31b7d5e1d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:36.645104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefd540-33b8-4a98-852a-a7da219c5ad8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:36.662628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:36.685579 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211edee8-37d3-4dc8-9f7a-9c4e4182b6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:36.686819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211edee8-37d3-4dc8-9f7a-9c4e4182b6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:36.687266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211edee8-37d3-4dc8-9f7a-9c4e4182b6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:36.687776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211edee8-37d3-4dc8-9f7a-9c4e4182b6f1 None admin] PATH_INFO: `/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:36.689696 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211edee8-37d3-4dc8-9f7a-9c4e4182b6f1 None admin] RBAC: Authorizing `identity:get_group(group_id=7d0bd34480f94a8593b05b2e828dfbaf)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:36.691754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211edee8-37d3-4dc8-9f7a-9c4e4182b6f1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:36.694515 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 230/453] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jul 21 12:01:36 2022] GET /identity/v3/groups/7d0bd34480f94a8593b05b2e828dfbaf => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:36.701477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211edee8-37d3-4dc8-9f7a-9c4e4182b6f1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:36.725385 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:36.732707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445dc41-66d6-4c6c-abcd-dbf31b7d5e1d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:36.770260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffd567-abce-4cb8-9324-aeb30f1ab52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:36.770962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffd567-abce-4cb8-9324-aeb30f1ab52a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:36.771249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffd567-abce-4cb8-9324-aeb30f1ab52a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:36.771976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffd567-abce-4cb8-9324-aeb30f1ab52a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:36.772380 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffd567-abce-4cb8-9324-aeb30f1ab52a None admin] RBAC: Adding query filter params (group.id=594a30ff998b42f686d8a1756bb72e32, role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=2ea0112c11004c7db4f26fe8670575dc) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:36.772688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffd567-abce-4cb8-9324-aeb30f1ab52a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:36.774148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffd567-abce-4cb8-9324-aeb30f1ab52a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:36.780372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 224/454] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jul 21 12:01:36 2022] GET /identity/v3/role_assignments?group.id=594a30ff998b42f686d8a1756bb72e32&scope.project.id=2ea0112c11004c7db4f26fe8670575dc&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:36.814302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211edee8-37d3-4dc8-9f7a-9c4e4182b6f1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:36.858210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fa5eb-ba06-4beb-be43-f4a54ebd0ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:36.859089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fa5eb-ba06-4beb-be43-f4a54ebd0ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:36.859500 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fa5eb-ba06-4beb-be43-f4a54ebd0ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:36.860223 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fa5eb-ba06-4beb-be43-f4a54ebd0ef5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:36.861411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fa5eb-ba06-4beb-be43-f4a54ebd0ef5 None admin] RBAC: Adding query filter params (group.id=7d0bd34480f94a8593b05b2e828dfbaf, role.id=67ad028192f24536a65fa57450a563b9, scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:36.861733 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fa5eb-ba06-4beb-be43-f4a54ebd0ef5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:36.863995 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fa5eb-ba06-4beb-be43-f4a54ebd0ef5 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:36.871670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 231/455] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jul 21 12:01:36 2022] GET /identity/v3/role_assignments?group.id=7d0bd34480f94a8593b05b2e828dfbaf&scope.project.id=d8968618a5b8461fbd567cb7fdbd05b8&role.id=67ad028192f24536a65fa57450a563b9 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:39.924926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853258-a582-425f-b4bf-9187a48c5bed None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:39.925463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853258-a582-425f-b4bf-9187a48c5bed None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:39.925463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853258-a582-425f-b4bf-9187a48c5bed None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:39.927337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 225/456] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:39.934114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19802a51-0cd3-474e-af55-eb10eda4facc None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:39.934611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19802a51-0cd3-474e-af55-eb10eda4facc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:39.935119 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19802a51-0cd3-474e-af55-eb10eda4facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:39.976509 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-19802a51-0cd3-474e-af55-eb10eda4facc None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:39.978427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-19802a51-0cd3-474e-af55-eb10eda4facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:40.020128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167091e-b51f-42fa-b3ed-4d619cd48a38 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:40.020770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167091e-b51f-42fa-b3ed-4d619cd48a38 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:40.021235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167091e-b51f-42fa-b3ed-4d619cd48a38 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:40.023232 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 226/457] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:40.042542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fcf88-e676-4d34-9d60-19b382b960bb None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:40.042991 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fcf88-e676-4d34-9d60-19b382b960bb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:40.043369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fcf88-e676-4d34-9d60-19b382b960bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:40.093181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-cc9fcf88-e676-4d34-9d60-19b382b960bb None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:40.097342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cc9fcf88-e676-4d34-9d60-19b382b960bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:40.110903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:40.152847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 232/458] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:40.177150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19802a51-0cd3-474e-af55-eb10eda4facc None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:40.291499 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 227/459] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:40.334941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19802a51-0cd3-474e-af55-eb10eda4facc None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:40.341353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fcf88-e676-4d34-9d60-19b382b960bb None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:40.455092 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781843c-4b12-415e-b89e-7fc2cba1ead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:40.456342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781843c-4b12-415e-b89e-7fc2cba1ead1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:40.456837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781843c-4b12-415e-b89e-7fc2cba1ead1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:40.457324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781843c-4b12-415e-b89e-7fc2cba1ead1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:40.495985 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781843c-4b12-415e-b89e-7fc2cba1ead1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:40.497499 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781843c-4b12-415e-b89e-7fc2cba1ead1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-4781843c-4b12-415e-b89e-7fc2cba1ead1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:40.544510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:40.546095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:40.548643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:40.548643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:40.548643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:40.548643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:40.548643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 233/460] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:01:40.558580 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:40.562997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781843c-4b12-415e-b89e-7fc2cba1ead1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:40.570413 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fcf88-e676-4d34-9d60-19b382b960bb None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:40.611424 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86958b89-f4b0-4963-8bb4-10a4fcacdc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:40.612277 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86958b89-f4b0-4963-8bb4-10a4fcacdc75 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:40.612558 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86958b89-f4b0-4963-8bb4-10a4fcacdc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:40.612828 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86958b89-f4b0-4963-8bb4-10a4fcacdc75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:40.638984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86958b89-f4b0-4963-8bb4-10a4fcacdc75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:40.640630 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86958b89-f4b0-4963-8bb4-10a4fcacdc75 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:40.651248 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-86958b89-f4b0-4963-8bb4-10a4fcacdc75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:40.676415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:40.678097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:40.680191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:40.680191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:40.680191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:40.680191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:40.680191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 228/461] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:01:40.696662 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86958b89-f4b0-4963-8bb4-10a4fcacdc75 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:40.794970 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781843c-4b12-415e-b89e-7fc2cba1ead1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:40.876910 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c0e7b-a064-4eec-95ff-209565bdd79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:40.877599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c0e7b-a064-4eec-95ff-209565bdd79a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:40.877884 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c0e7b-a064-4eec-95ff-209565bdd79a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:40.878161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c0e7b-a064-4eec-95ff-209565bdd79a None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:40.878944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c0e7b-a064-4eec-95ff-209565bdd79a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:40.879253 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c0e7b-a064-4eec-95ff-209565bdd79a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:40.880664 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c0e7b-a064-4eec-95ff-209565bdd79a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:40.907220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 234/462] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:40.912762 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c0e7b-a064-4eec-95ff-209565bdd79a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:40.927474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86958b89-f4b0-4963-8bb4-10a4fcacdc75 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:40.970975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825a331-4079-446b-908c-e59c6e4777a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:40.971664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825a331-4079-446b-908c-e59c6e4777a5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:40.971946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825a331-4079-446b-908c-e59c6e4777a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:40.972223 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825a331-4079-446b-908c-e59c6e4777a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:40.972975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825a331-4079-446b-908c-e59c6e4777a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:40.973284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825a331-4079-446b-908c-e59c6e4777a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:40.974728 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825a331-4079-446b-908c-e59c6e4777a5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:41.003391 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 229/463] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:41.012730 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825a331-4079-446b-908c-e59c6e4777a5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:41.017575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:41.120081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:41.136282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c0e7b-a064-4eec-95ff-209565bdd79a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:41.197833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857edbbc-87df-4a04-9fcf-eb28e8e22674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:41.199124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edbbc-87df-4a04-9fcf-eb28e8e22674 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:41.199713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edbbc-87df-4a04-9fcf-eb28e8e22674 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:41.200308 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edbbc-87df-4a04-9fcf-eb28e8e22674 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:41.202062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857edbbc-87df-4a04-9fcf-eb28e8e22674 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:41.204974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857edbbc-87df-4a04-9fcf-eb28e8e22674 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:41.214158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825a331-4079-446b-908c-e59c6e4777a5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:41.239934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 235/464] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:01:40 2022] POST /identity/v3/users => generated 248 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:01:41.242745 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18aecd-533f-4de5-9987-5f9cc8167c8e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:41.243515 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18aecd-533f-4de5-9987-5f9cc8167c8e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:41.244175 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18aecd-533f-4de5-9987-5f9cc8167c8e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:41.247682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 236/465] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:41.258431 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ce45-c884-46c9-aab7-625ef416dec8 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:41.259047 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ce45-c884-46c9-aab7-625ef416dec8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:41.259562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ce45-c884-46c9-aab7-625ef416dec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:41.322406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-e126ce45-c884-46c9-aab7-625ef416dec8 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:41.326351 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e126ce45-c884-46c9-aab7-625ef416dec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:41.340815 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d379b8-5409-4cc8-8c14-3258c60d943a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:41.342108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d379b8-5409-4cc8-8c14-3258c60d943a None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:41.345282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d379b8-5409-4cc8-8c14-3258c60d943a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:41.345815 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d379b8-5409-4cc8-8c14-3258c60d943a None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:41.347268 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d379b8-5409-4cc8-8c14-3258c60d943a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:41.356951 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d379b8-5409-4cc8-8c14-3258c60d943a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:41.423973 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 230/466] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:01:41 2022] POST /identity/v3/users => generated 246 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:01:41.530702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 237/467] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:41.575584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d379b8-5409-4cc8-8c14-3258c60d943a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:41.719211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:41.803014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d379b8-5409-4cc8-8c14-3258c60d943a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:41.867033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371461-b060-43ee-b4c8-48ce7939345e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:41.868006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371461-b060-43ee-b4c8-48ce7939345e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:41.868780 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371461-b060-43ee-b4c8-48ce7939345e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:41.874698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3084cd7-1e00-49f5-ae5c-eb280f681686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:41.875202 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 238/468] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:41.878685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084cd7-1e00-49f5-ae5c-eb280f681686 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:41.878685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084cd7-1e00-49f5-ae5c-eb280f681686 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:41.878685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084cd7-1e00-49f5-ae5c-eb280f681686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:41.883823 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fd752-f906-4996-8269-c1852ae3eaf9 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:41.884670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fd752-f906-4996-8269-c1852ae3eaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:41.885415 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fd752-f906-4996-8269-c1852ae3eaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:41.897437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3084cd7-1e00-49f5-ae5c-eb280f681686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:41.899520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3084cd7-1e00-49f5-ae5c-eb280f681686 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:41.924172 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-dd6fd752-f906-4996-8269-c1852ae3eaf9 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:41.926573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-dd6fd752-f906-4996-8269-c1852ae3eaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-b3084cd7-1e00-49f5-ae5c-eb280f681686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:41.932098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:41.934062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:41.936457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:41.936457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:41.936457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:41.936457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:41.940560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 231/469] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:41.944546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3084cd7-1e00-49f5-ae5c-eb280f681686 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:42.076992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 239/470] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:42.076992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c812c-fbc9-41ba-b7d9-ba123270d253 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:42.076992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c812c-fbc9-41ba-b7d9-ba123270d253 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:42.076992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c812c-fbc9-41ba-b7d9-ba123270d253 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:42.076992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 240/471] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:42.097221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee108a-e2ad-40ed-9ba6-62ca2f70abd2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:42.097865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee108a-e2ad-40ed-9ba6-62ca2f70abd2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:42.098455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee108a-e2ad-40ed-9ba6-62ca2f70abd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:42.149858 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6bee108a-e2ad-40ed-9ba6-62ca2f70abd2 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:42.151952 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6bee108a-e2ad-40ed-9ba6-62ca2f70abd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:42.155839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:42.157037 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3084cd7-1e00-49f5-ae5c-eb280f681686 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:42.181765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:42.227745 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98ecc4-3c8a-41dc-b639-11e4af485dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:42.228850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ecc4-3c8a-41dc-b639-11e4af485dfb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:42.229355 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ecc4-3c8a-41dc-b639-11e4af485dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:42.229854 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ecc4-3c8a-41dc-b639-11e4af485dfb None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:42.231368 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98ecc4-3c8a-41dc-b639-11e4af485dfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:42.231889 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98ecc4-3c8a-41dc-b639-11e4af485dfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:42.234680 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98ecc4-3c8a-41dc-b639-11e4af485dfb None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:42.264897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 232/472] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:42.264897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98ecc4-3c8a-41dc-b639-11e4af485dfb None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:42.309606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 241/473] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:42.309606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee108a-e2ad-40ed-9ba6-62ca2f70abd2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:42.471373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98ecc4-3c8a-41dc-b639-11e4af485dfb None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:42.515514 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179faf9-4805-46c9-8350-730859629df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:42.516339 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179faf9-4805-46c9-8350-730859629df7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:42.516622 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179faf9-4805-46c9-8350-730859629df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:42.516899 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179faf9-4805-46c9-8350-730859629df7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:42.518240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee108a-e2ad-40ed-9ba6-62ca2f70abd2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:42.531829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179faf9-4805-46c9-8350-730859629df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:42.533392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179faf9-4805-46c9-8350-730859629df7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-1179faf9-4805-46c9-8350-730859629df7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:42.556156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:42.557748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:42.560395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:42.560395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:42.560395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:42.560395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:42.560395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 233/474] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:42.560395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179faf9-4805-46c9-8350-730859629df7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:42.592609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:42.596799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3064fd-26e1-4d80-89e0-2465a97a3737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:42.597886 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3064fd-26e1-4d80-89e0-2465a97a3737 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:42.598160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3064fd-26e1-4d80-89e0-2465a97a3737 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:42.598435 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3064fd-26e1-4d80-89e0-2465a97a3737 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:42.599204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3064fd-26e1-4d80-89e0-2465a97a3737 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:42.600690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3064fd-26e1-4d80-89e0-2465a97a3737 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:42.621834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:42.661342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 242/475] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:01:42 2022] POST /identity/v3/users => generated 248 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:01:42.664314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3064fd-26e1-4d80-89e0-2465a97a3737 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:42.711729 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179faf9-4805-46c9-8350-730859629df7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:42.779083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5cc7e-791e-4b31-a2da-a48fa6bcb24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:42.779787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5cc7e-791e-4b31-a2da-a48fa6bcb24e None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:42.780067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5cc7e-791e-4b31-a2da-a48fa6bcb24e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:42.780349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5cc7e-791e-4b31-a2da-a48fa6bcb24e None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:42.781229 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5cc7e-791e-4b31-a2da-a48fa6bcb24e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:42.784440 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5cc7e-791e-4b31-a2da-a48fa6bcb24e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:42.800236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.sql.core [None req-31b5cc7e-791e-4b31-a2da-a48fa6bcb24e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 12:01:42.800236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 12:01:42.800236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [parameters: {'id': '5a8d68d3df804bca8fa96c92231f66de', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 12:01:42.800236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80411) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-31b5cc7e-791e-4b31-a2da-a48fa6bcb24e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application conn.query(q) Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application result.read() Jul 21 12:01:42.838034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 12:01:42.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application next(self.gen) Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application yield resource Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application next(self.gen) Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise self.value Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application session.commit() Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 12:01:42.841457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self.session.flush() Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application compat.raise_( Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 12:01:42.844417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 12:01:42.847916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application conn.query(q) Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application result.read() Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 12:01:42.855897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [parameters: {'id': '5a8d68d3df804bca8fa96c92231f66de', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:42.859211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 12:01:42.862101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:42.867681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 234/476] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jul 21 12:01:42 2022] POST /identity/v3/roles => generated 144 bytes in 282 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:42.867681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5cc7e-791e-4b31-a2da-a48fa6bcb24e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:42.934557 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3064fd-26e1-4d80-89e0-2465a97a3737 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:43.018715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df417eb-0c34-43f0-89b0-b1964e526401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:43.021341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df417eb-0c34-43f0-89b0-b1964e526401 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:43.021341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df417eb-0c34-43f0-89b0-b1964e526401 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:43.021543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df417eb-0c34-43f0-89b0-b1964e526401 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:43.023302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df417eb-0c34-43f0-89b0-b1964e526401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:43.023849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df417eb-0c34-43f0-89b0-b1964e526401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:43.027421 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:43.029296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df417eb-0c34-43f0-89b0-b1964e526401 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:43.053392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5cc7e-791e-4b31-a2da-a48fa6bcb24e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:43.061290 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 243/477] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:43.069678 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df417eb-0c34-43f0-89b0-b1964e526401 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:43.103987 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4214d2-4d7d-4e7d-b3e7-662044d19cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:43.104832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4214d2-4d7d-4e7d-b3e7-662044d19cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:43.105173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4214d2-4d7d-4e7d-b3e7-662044d19cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:43.106027 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4214d2-4d7d-4e7d-b3e7-662044d19cc6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:43.122203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4214d2-4d7d-4e7d-b3e7-662044d19cc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-0f4214d2-4d7d-4e7d-b3e7-662044d19cc6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:43.133100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:43.134791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:43.136395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:43.136395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:43.136395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:43.136395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:43.136395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:43.136395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:43.136395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:43.136395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:43.136395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:43.136395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:43.136395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 12:01:43.136395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:43.136395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 235/478] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:01:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:43.148721 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4214d2-4d7d-4e7d-b3e7-662044d19cc6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:43.199058 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:43.271668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df417eb-0c34-43f0-89b0-b1964e526401 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:43.357206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f06c9-43c6-4647-b403-a50f0444b2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:43.358366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f06c9-43c6-4647-b403-a50f0444b2f2 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:43.358905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f06c9-43c6-4647-b403-a50f0444b2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:43.359369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f06c9-43c6-4647-b403-a50f0444b2f2 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:43.360677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f06c9-43c6-4647-b403-a50f0444b2f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:43.363378 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f06c9-43c6-4647-b403-a50f0444b2f2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:43.417841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 244/479] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:01:43 2022] POST /identity/v3/users => generated 249 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:01:43.440282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4214d2-4d7d-4e7d-b3e7-662044d19cc6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:43.487850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9335b8b-46e4-4ecd-8423-91da9db08b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:43.488664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9335b8b-46e4-4ecd-8423-91da9db08b69 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:43.489031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9335b8b-46e4-4ecd-8423-91da9db08b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:43.489349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9335b8b-46e4-4ecd-8423-91da9db08b69 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:43.490290 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9335b8b-46e4-4ecd-8423-91da9db08b69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:43.490604 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9335b8b-46e4-4ecd-8423-91da9db08b69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:43.492135 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9335b8b-46e4-4ecd-8423-91da9db08b69 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:43.509315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 236/480] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:44.722456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3b906-3375-4bbc-979e-140de7bdcbb6 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:44.722980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3b906-3375-4bbc-979e-140de7bdcbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:44.722980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3b906-3375-4bbc-979e-140de7bdcbb6 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:44.724643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 245/481] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:44.729785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cbb4a-82e2-4352-917f-4812f46e69a4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:44.730242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cbb4a-82e2-4352-917f-4812f46e69a4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:44.730534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cbb4a-82e2-4352-917f-4812f46e69a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:44.749002 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-145cbb4a-82e2-4352-917f-4812f46e69a4 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:44.750304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-145cbb4a-82e2-4352-917f-4812f46e69a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:44.752561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:44.757948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db039d-7300-492f-9861-7e6e80dc7dcf None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:44.758231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db039d-7300-492f-9861-7e6e80dc7dcf None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:44.758507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db039d-7300-492f-9861-7e6e80dc7dcf None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:44.759925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 246/482] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:01:44.772153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1cddf-a692-4d0f-9ada-56bb74b222ad None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:44.772458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1cddf-a692-4d0f-9ada-56bb74b222ad None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:44.772724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1cddf-a692-4d0f-9ada-56bb74b222ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:44.799801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b0a1cddf-a692-4d0f-9ada-56bb74b222ad None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:44.801446 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b0a1cddf-a692-4d0f-9ada-56bb74b222ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:44.845428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 237/483] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:44.870090 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cbb4a-82e2-4352-917f-4812f46e69a4 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:44.934703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 247/484] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:01:44.969595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1cddf-a692-4d0f-9ada-56bb74b222ad None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:45.039800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:45.048857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cbb4a-82e2-4352-917f-4812f46e69a4 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:45.122119 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993df762-89f4-4429-b0da-1ba38b0f8524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:45.124237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993df762-89f4-4429-b0da-1ba38b0f8524 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:45.124579 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993df762-89f4-4429-b0da-1ba38b0f8524 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:45.124855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993df762-89f4-4429-b0da-1ba38b0f8524 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:45.146589 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993df762-89f4-4429-b0da-1ba38b0f8524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:45.159095 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-993df762-89f4-4429-b0da-1ba38b0f8524 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:45.166398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:45.167435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:45.168222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:45.168222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:45.168222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:45.168222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:45.168222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:45.168222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:45.168222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:45.168222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:45.168222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:45.168222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:45.168222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:45.168222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:45.169561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 238/485] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:01:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:01:45.172275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1cddf-a692-4d0f-9ada-56bb74b222ad None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:45.174702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993df762-89f4-4429-b0da-1ba38b0f8524 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:45.242420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90b0a9-9efe-4bbb-aff0-02abaf6865b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:45.243314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90b0a9-9efe-4bbb-aff0-02abaf6865b0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:45.243597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90b0a9-9efe-4bbb-aff0-02abaf6865b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:45.243865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90b0a9-9efe-4bbb-aff0-02abaf6865b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:45.265811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90b0a9-9efe-4bbb-aff0-02abaf6865b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-6a90b0a9-9efe-4bbb-aff0-02abaf6865b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:45.273605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:45.274506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:45.275328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:45.275328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:45.275328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:45.275328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:45.275328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:45.275328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:45.275328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:45.275328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:45.275328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:45.275328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:45.275328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:45.275328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:45.276444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 248/486] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:01:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:01:45.286615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90b0a9-9efe-4bbb-aff0-02abaf6865b0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:45.398714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993df762-89f4-4429-b0da-1ba38b0f8524 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:45.492693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:45.497648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90b0a9-9efe-4bbb-aff0-02abaf6865b0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:45.512910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431bb8e-1c86-4386-a5f3-783092e4bba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:45.513612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431bb8e-1c86-4386-a5f3-783092e4bba6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:45.513898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431bb8e-1c86-4386-a5f3-783092e4bba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:45.514169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431bb8e-1c86-4386-a5f3-783092e4bba6 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:45.515034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431bb8e-1c86-4386-a5f3-783092e4bba6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:45.515345 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431bb8e-1c86-4386-a5f3-783092e4bba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:45.516741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431bb8e-1c86-4386-a5f3-783092e4bba6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:45.547090 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 239/487] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:01:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:45.554802 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431bb8e-1c86-4386-a5f3-783092e4bba6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:45.588951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb9ad7-741e-4e17-aa66-e17de1313c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:45.589663 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb9ad7-741e-4e17-aa66-e17de1313c04 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:45.589951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb9ad7-741e-4e17-aa66-e17de1313c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:45.590235 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb9ad7-741e-4e17-aa66-e17de1313c04 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:45.591162 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb9ad7-741e-4e17-aa66-e17de1313c04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:45.591475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb9ad7-741e-4e17-aa66-e17de1313c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:45.592946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb9ad7-741e-4e17-aa66-e17de1313c04 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:45.614721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 249/488] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:01:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:45.621694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb9ad7-741e-4e17-aa66-e17de1313c04 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:45.689161 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:45.789873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431bb8e-1c86-4386-a5f3-783092e4bba6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:45.814939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb9ad7-741e-4e17-aa66-e17de1313c04 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:45.855536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02493ce-5e49-412f-bd0b-6737452cf888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:45.856361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02493ce-5e49-412f-bd0b-6737452cf888 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:45.856641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02493ce-5e49-412f-bd0b-6737452cf888 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:45.856914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02493ce-5e49-412f-bd0b-6737452cf888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:45.858161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5f77d-c1f0-4d21-acdc-84aa7501f180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:45.859097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5f77d-c1f0-4d21-acdc-84aa7501f180 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:45.859381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5f77d-c1f0-4d21-acdc-84aa7501f180 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:45.859654 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5f77d-c1f0-4d21-acdc-84aa7501f180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:45.872534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5f77d-c1f0-4d21-acdc-84aa7501f180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:45.873944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5f77d-c1f0-4d21-acdc-84aa7501f180 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:45.881754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02493ce-5e49-412f-bd0b-6737452cf888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:45.885861 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02493ce-5e49-412f-bd0b-6737452cf888 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-8ce5f77d-c1f0-4d21-acdc-84aa7501f180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:45.897239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:45.899052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:45.900413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:45.900413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:45.900413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:45.900413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:45.900413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 250/489] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:01:45.900413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3454a-e8b3-4235-8c66-a610f65f3d39 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:45.901018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3454a-e8b3-4235-8c66-a610f65f3d39 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:45.901018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3454a-e8b3-4235-8c66-a610f65f3d39 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:45.906766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 251/490] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:45.906766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3454a-e8b3-4235-8c66-a610f65f3d39 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-c02493ce-5e49-412f-bd0b-6737452cf888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:45.921657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:45.922593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:45.923492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:45.923492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:45.923492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:45.923492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:45.925808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 240/491] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:45.931679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3349f0-9cc3-4e1f-bed4-4654eeaf1537 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:45.932236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3349f0-9cc3-4e1f-bed4-4654eeaf1537 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:45.932688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3349f0-9cc3-4e1f-bed4-4654eeaf1537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:45.942877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:45.952963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-cf3349f0-9cc3-4e1f-bed4-4654eeaf1537 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:45.954523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cf3349f0-9cc3-4e1f-bed4-4654eeaf1537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:46.062783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 241/492] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:46.065458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3349f0-9cc3-4e1f-bed4-4654eeaf1537 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:46.097453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3454a-e8b3-4235-8c66-a610f65f3d39 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:46.145215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:46.170099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e8c69-555f-44f8-b9ed-40750226c951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:46.171789 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e8c69-555f-44f8-b9ed-40750226c951 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:46.172618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e8c69-555f-44f8-b9ed-40750226c951 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:46.173110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e8c69-555f-44f8-b9ed-40750226c951 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:46.174475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e8c69-555f-44f8-b9ed-40750226c951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:46.175046 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e8c69-555f-44f8-b9ed-40750226c951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:46.178728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e8c69-555f-44f8-b9ed-40750226c951 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:46.205192 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 252/493] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:46.206564 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e8c69-555f-44f8-b9ed-40750226c951 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:46.224811 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3349f0-9cc3-4e1f-bed4-4654eeaf1537 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:46.263849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05b60c-f7e9-4e57-9c07-040a0f2f1a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:46.264988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05b60c-f7e9-4e57-9c07-040a0f2f1a2d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:46.265516 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05b60c-f7e9-4e57-9c07-040a0f2f1a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:46.266008 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05b60c-f7e9-4e57-9c07-040a0f2f1a2d None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:46.267187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05b60c-f7e9-4e57-9c07-040a0f2f1a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:46.267723 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05b60c-f7e9-4e57-9c07-040a0f2f1a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:46.270299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05b60c-f7e9-4e57-9c07-040a0f2f1a2d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:46.298947 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 242/494] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:46.298947 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71c2dd-05eb-494f-8f8a-b0a6dadf9c0a None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:46.298947 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71c2dd-05eb-494f-8f8a-b0a6dadf9c0a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:46.298947 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71c2dd-05eb-494f-8f8a-b0a6dadf9c0a None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:46.298947 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 243/495] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:46.298947 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71c2dd-05eb-494f-8f8a-b0a6dadf9c0a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:46.326088 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:46.353806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e8c69-555f-44f8-b9ed-40750226c951 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:46.389335 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22ec41-65ba-4abc-8968-63eaac39e6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:46.390179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22ec41-65ba-4abc-8968-63eaac39e6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:46.390475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22ec41-65ba-4abc-8968-63eaac39e6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:46.390776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22ec41-65ba-4abc-8968-63eaac39e6e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:46.401892 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22ec41-65ba-4abc-8968-63eaac39e6e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-fb22ec41-65ba-4abc-8968-63eaac39e6e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:46.409833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:46.411598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:46.413075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:46.413075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:46.413075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:46.413075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:46.413075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:46.413075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:46.413075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:46.413075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:46.413075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:46.413075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:46.413075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:46.413075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:46.413075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 253/496] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:01:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:46.413075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f3257-6104-413a-a972-691ba5b7fe98 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:46.414383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f3257-6104-413a-a972-691ba5b7fe98 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:46.414383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f3257-6104-413a-a972-691ba5b7fe98 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:46.414780 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 254/497] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:46.415455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f3257-6104-413a-a972-691ba5b7fe98 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:46.458098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71c2dd-05eb-494f-8f8a-b0a6dadf9c0a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:46.460797 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:46.501523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d82af7-f44c-40f5-a825-a9bf9ae4b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:46.502332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d82af7-f44c-40f5-a825-a9bf9ae4b47e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:46.502777 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d82af7-f44c-40f5-a825-a9bf9ae4b47e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:46.502935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d82af7-f44c-40f5-a825-a9bf9ae4b47e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:46.511110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d82af7-f44c-40f5-a825-a9bf9ae4b47e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:46.512599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d82af7-f44c-40f5-a825-a9bf9ae4b47e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-73d82af7-f44c-40f5-a825-a9bf9ae4b47e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:01:46.529816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:46.531957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:46.533844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:46.533844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:46.533844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:01:46.533844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:01:46.533844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:01:46.533844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:01:46.533844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:01:46.533844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:01:46.533844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:01:46.533844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:46.533844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 244/498] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jul 21 12:01:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:46.533844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80270970-cc1f-4a2b-8f9a-6018caa9f8c3 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:46.533844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80270970-cc1f-4a2b-8f9a-6018caa9f8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:46.535014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80270970-cc1f-4a2b-8f9a-6018caa9f8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:46.546489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f3257-6104-413a-a972-691ba5b7fe98 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:46.551483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-80270970-cc1f-4a2b-8f9a-6018caa9f8c3 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:46.552812 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-80270970-cc1f-4a2b-8f9a-6018caa9f8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:46.581623 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939cd84-26b9-40a3-8bab-234994525b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:46.582436 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939cd84-26b9-40a3-8bab-234994525b69 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:46.582746 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939cd84-26b9-40a3-8bab-234994525b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:46.583022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939cd84-26b9-40a3-8bab-234994525b69 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:46.585161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:46.592720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939cd84-26b9-40a3-8bab-234994525b69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:46.594194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939cd84-26b9-40a3-8bab-234994525b69 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-e939cd84-26b9-40a3-8bab-234994525b69 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:01:46.610447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:46.611565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:46.612569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:46.612569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:46.612569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:01:46.612569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:01:46.612569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:01:46.612569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:01:46.612569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:01:46.612569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:01:46.612569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 12:01:46.612569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:46.612569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 255/499] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:46.613128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939cd84-26b9-40a3-8bab-234994525b69 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:46.633441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 245/500] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:46.635700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63e74c-684b-4fc8-8f79-416a306ab967 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:46.636289 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63e74c-684b-4fc8-8f79-416a306ab967 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:46.636769 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63e74c-684b-4fc8-8f79-416a306ab967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:46.664585 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fb63e74c-684b-4fc8-8f79-416a306ab967 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:46.666011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fb63e74c-684b-4fc8-8f79-416a306ab967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:46.732140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939cd84-26b9-40a3-8bab-234994525b69 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:46.765379 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 246/501] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:46.766855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63e74c-684b-4fc8-8f79-416a306ab967 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:46.786887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e0786-b498-429e-babd-943aa06101f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:46.788161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e0786-b498-429e-babd-943aa06101f5 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:46.788657 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e0786-b498-429e-babd-943aa06101f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:46.789150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e0786-b498-429e-babd-943aa06101f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:46.790616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e0786-b498-429e-babd-943aa06101f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:46.791202 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e0786-b498-429e-babd-943aa06101f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:46.793820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e0786-b498-429e-babd-943aa06101f5 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:46.799178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:46.804443 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 256/502] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:01:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:46.805314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e0786-b498-429e-babd-943aa06101f5 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:46.874045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:46.915408 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63e74c-684b-4fc8-8f79-416a306ab967 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:46.939521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e0786-b498-429e-babd-943aa06101f5 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:46.959975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb2457-057a-4efe-b548-0ee2b8319b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:46.960790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb2457-057a-4efe-b548-0ee2b8319b98 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:46.961082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb2457-057a-4efe-b548-0ee2b8319b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:46.961358 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb2457-057a-4efe-b548-0ee2b8319b98 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:46.962253 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb2457-057a-4efe-b548-0ee2b8319b98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:46.962568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb2457-057a-4efe-b548-0ee2b8319b98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:46.964202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb2457-057a-4efe-b548-0ee2b8319b98 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:46.993715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30147261-a014-43a8-9496-1fc155954fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:46.994589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30147261-a014-43a8-9496-1fc155954fbc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:46.994927 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30147261-a014-43a8-9496-1fc155954fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:46.995200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30147261-a014-43a8-9496-1fc155954fbc None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:46.996425 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30147261-a014-43a8-9496-1fc155954fbc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:46.996806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30147261-a014-43a8-9496-1fc155954fbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:46.999312 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30147261-a014-43a8-9496-1fc155954fbc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:47.005149 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 247/503] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jul 21 12:01:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:47.006120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb2457-057a-4efe-b548-0ee2b8319b98 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:47.049324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 257/504] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jul 21 12:01:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:47.050194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30147261-a014-43a8-9496-1fc155954fbc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:47.122931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:47.159317 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb2457-057a-4efe-b548-0ee2b8319b98 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:47.166160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30147261-a014-43a8-9496-1fc155954fbc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:47.185537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:47.212668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbf1d0-e8af-4209-ad9d-048dbd20e3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:47.213577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbf1d0-e8af-4209-ad9d-048dbd20e3ee None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:47.213754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99f2d7-0f06-4ec5-b91b-3064284cf1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:47.214009 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbf1d0-e8af-4209-ad9d-048dbd20e3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:47.214424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbf1d0-e8af-4209-ad9d-048dbd20e3ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:47.214784 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99f2d7-0f06-4ec5-b91b-3064284cf1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:47.215176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99f2d7-0f06-4ec5-b91b-3064284cf1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:47.215593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99f2d7-0f06-4ec5-b91b-3064284cf1a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:47.227847 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99f2d7-0f06-4ec5-b91b-3064284cf1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:47.228775 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbf1d0-e8af-4209-ad9d-048dbd20e3ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:47.229673 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99f2d7-0f06-4ec5-b91b-3064284cf1a3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-29bbf1d0-e8af-4209-ad9d-048dbd20e3ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:47.236662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:47.238596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:47.241187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:47.241187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:47.241187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:47.241187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:47.241187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:47.241187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:47.241187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:47.241187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:47.241187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:47.241187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:47.241187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:47.241187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:47.241187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 258/505] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:01:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:47.241187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbf1d0-e8af-4209-ad9d-048dbd20e3ee None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-1b99f2d7-0f06-4ec5-b91b-3064284cf1a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:47.257816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:47.259700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:47.262267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:47.262267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:47.262267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:47.262267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:47.262267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 248/506] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:47.262267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99f2d7-0f06-4ec5-b91b-3064284cf1a3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:47.376379 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99f2d7-0f06-4ec5-b91b-3064284cf1a3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:47.388179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbf1d0-e8af-4209-ad9d-048dbd20e3ee None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:47.413364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:47.421743 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2d3ef-541b-4e50-a764-e95c14e5b825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:47.422498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2d3ef-541b-4e50-a764-e95c14e5b825 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:47.422914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2d3ef-541b-4e50-a764-e95c14e5b825 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:47.423272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2d3ef-541b-4e50-a764-e95c14e5b825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:47.433007 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9b70c-baac-41bc-ae0f-b309ef026065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:47.434354 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9b70c-baac-41bc-ae0f-b309ef026065 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:47.434872 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9b70c-baac-41bc-ae0f-b309ef026065 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:47.435356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9b70c-baac-41bc-ae0f-b309ef026065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:47.453385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9b70c-baac-41bc-ae0f-b309ef026065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:47.456017 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9b70c-baac-41bc-ae0f-b309ef026065 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-03f9b70c-baac-41bc-ae0f-b309ef026065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:47.477967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:47.479862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:47.481725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:47.481725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:47.481725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:47.481725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:47.481725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 259/507] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:47.481725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9b70c-baac-41bc-ae0f-b309ef026065 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:47.526579 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:47.531258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2d3ef-541b-4e50-a764-e95c14e5b825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:47.533387 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2d3ef-541b-4e50-a764-e95c14e5b825 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:47.622900 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9b70c-baac-41bc-ae0f-b309ef026065 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:47.659381 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 249/508] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:47.660272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2d3ef-541b-4e50-a764-e95c14e5b825 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:47.667095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a65dcb-a0b7-4713-9dd1-c28babb7dcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:47.667764 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a65dcb-a0b7-4713-9dd1-c28babb7dcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:47.668047 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a65dcb-a0b7-4713-9dd1-c28babb7dcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:47.668323 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a65dcb-a0b7-4713-9dd1-c28babb7dcc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:47.707767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:47.763946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a65dcb-a0b7-4713-9dd1-c28babb7dcc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:47.766438 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a65dcb-a0b7-4713-9dd1-c28babb7dcc0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:47.805150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:47.814049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2d3ef-541b-4e50-a764-e95c14e5b825 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:47.859738 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba34ad-f3df-4202-808f-a8fe2868ae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:47.860551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba34ad-f3df-4202-808f-a8fe2868ae77 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:47.860910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba34ad-f3df-4202-808f-a8fe2868ae77 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:47.861300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba34ad-f3df-4202-808f-a8fe2868ae77 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:47.862169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba34ad-f3df-4202-808f-a8fe2868ae77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:47.862570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba34ad-f3df-4202-808f-a8fe2868ae77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:47.864072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba34ad-f3df-4202-808f-a8fe2868ae77 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:47.876196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 250/509] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:01:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:47.877627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba34ad-f3df-4202-808f-a8fe2868ae77 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:47.893926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 260/510] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:47.895479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a65dcb-a0b7-4713-9dd1-c28babb7dcc0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:47.989578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:47.997000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba34ad-f3df-4202-808f-a8fe2868ae77 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:48.035889 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b3786-152c-4898-88a4-5e9f225cc457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:48.037024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b3786-152c-4898-88a4-5e9f225cc457 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:48.037510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b3786-152c-4898-88a4-5e9f225cc457 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:48.038054 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b3786-152c-4898-88a4-5e9f225cc457 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:48.039032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b3786-152c-4898-88a4-5e9f225cc457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:48.039587 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b3786-152c-4898-88a4-5e9f225cc457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:48.040393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a65dcb-a0b7-4713-9dd1-c28babb7dcc0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:48.042213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b3786-152c-4898-88a4-5e9f225cc457 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:48.061534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 251/511] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:48.062927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b3786-152c-4898-88a4-5e9f225cc457 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:48.072928 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:48.088290 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48925c-347e-4f16-8ea8-c7ff2c63feb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:48.089268 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48925c-347e-4f16-8ea8-c7ff2c63feb8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:48.089716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48925c-347e-4f16-8ea8-c7ff2c63feb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:48.090126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48925c-347e-4f16-8ea8-c7ff2c63feb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:48.091040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48925c-347e-4f16-8ea8-c7ff2c63feb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:48.091526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48925c-347e-4f16-8ea8-c7ff2c63feb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:48.093945 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48925c-347e-4f16-8ea8-c7ff2c63feb8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:48.117988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 261/512] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:48.117988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48925c-347e-4f16-8ea8-c7ff2c63feb8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:48.206354 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b3786-152c-4898-88a4-5e9f225cc457 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:48.243962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48925c-347e-4f16-8ea8-c7ff2c63feb8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:48.248914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21c7ca-ec46-475e-ba18-9be66104a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:48.249989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21c7ca-ec46-475e-ba18-9be66104a934 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:48.250371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21c7ca-ec46-475e-ba18-9be66104a934 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:48.250772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21c7ca-ec46-475e-ba18-9be66104a934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:48.263909 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21c7ca-ec46-475e-ba18-9be66104a934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:48.265702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21c7ca-ec46-475e-ba18-9be66104a934 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:48.281776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ccd4d-abb5-42ba-8d47-54865f725342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:48.282588 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ccd4d-abb5-42ba-8d47-54865f725342 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:48.282889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ccd4d-abb5-42ba-8d47-54865f725342 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:48.283160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ccd4d-abb5-42ba-8d47-54865f725342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-5e21c7ca-ec46-475e-ba18-9be66104a934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:48.285633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:48.286559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:48.287456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:48.287456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:48.287456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:48.287456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:48.287456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 252/513] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:48.287933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21c7ca-ec46-475e-ba18-9be66104a934 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:48.300959 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ccd4d-abb5-42ba-8d47-54865f725342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:48.302067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:48.304000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ccd4d-abb5-42ba-8d47-54865f725342 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-d99ccd4d-abb5-42ba-8d47-54865f725342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:48.335946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:48.337494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:48.339077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:48.339077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:48.339077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:48.339077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:48.339077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 262/514] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:48.339904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ccd4d-abb5-42ba-8d47-54865f725342 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:48.403908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:48.408691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21c7ca-ec46-475e-ba18-9be66104a934 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:48.449750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e032bd-7515-4809-b475-c0e005ed8937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:48.451418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e032bd-7515-4809-b475-c0e005ed8937 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:48.451853 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e032bd-7515-4809-b475-c0e005ed8937 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:48.452281 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e032bd-7515-4809-b475-c0e005ed8937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:48.467681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e032bd-7515-4809-b475-c0e005ed8937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:48.470155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e032bd-7515-4809-b475-c0e005ed8937 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:48.488901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ccd4d-abb5-42ba-8d47-54865f725342 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-64e032bd-7515-4809-b475-c0e005ed8937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:48.502843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:48.504692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:48.506215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:48.506215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:48.506215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:48.506215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:48.506215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 253/515] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:48.507110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e032bd-7515-4809-b475-c0e005ed8937 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:48.529824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a921d-244f-4271-b8b1-fc27b0848846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:48.530574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a921d-244f-4271-b8b1-fc27b0848846 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:48.530894 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a921d-244f-4271-b8b1-fc27b0848846 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:48.531163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a921d-244f-4271-b8b1-fc27b0848846 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:48.531896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a921d-244f-4271-b8b1-fc27b0848846 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:48.533354 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a921d-244f-4271-b8b1-fc27b0848846 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:48.557219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 263/516] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:01:48 2022] POST /identity/v3/users => generated 247 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:01:48.558419 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a921d-244f-4271-b8b1-fc27b0848846 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:48.604018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:48.664302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e032bd-7515-4809-b475-c0e005ed8937 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:48.690315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:48.703595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a921d-244f-4271-b8b1-fc27b0848846 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:48.708473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344a825-98f9-472e-8e83-dd6350916234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:48.709486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344a825-98f9-472e-8e83-dd6350916234 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:48.709931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344a825-98f9-472e-8e83-dd6350916234 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:48.710374 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344a825-98f9-472e-8e83-dd6350916234 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:48.723863 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344a825-98f9-472e-8e83-dd6350916234 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:48.726238 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344a825-98f9-472e-8e83-dd6350916234 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-2344a825-98f9-472e-8e83-dd6350916234 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:01:48.752434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:48.753405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:48.754283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:48.754283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:48.754283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:01:48.754283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:01:48.754283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:01:48.754283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:01:48.754283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:01:48.754283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:01:48.754283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 12:01:48.754283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:48.754283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 254/517] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:48.755601 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344a825-98f9-472e-8e83-dd6350916234 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:48.768744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5568b-5c99-4458-ad59-afb95f00ad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:48.769516 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5568b-5c99-4458-ad59-afb95f00ad12 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:48.769851 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5568b-5c99-4458-ad59-afb95f00ad12 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:48.770214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5568b-5c99-4458-ad59-afb95f00ad12 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:48.771242 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5568b-5c99-4458-ad59-afb95f00ad12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:48.771729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5568b-5c99-4458-ad59-afb95f00ad12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:48.774511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5568b-5c99-4458-ad59-afb95f00ad12 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:48.797426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 264/518] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:48.799489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5568b-5c99-4458-ad59-afb95f00ad12 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:48.936050 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344a825-98f9-472e-8e83-dd6350916234 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:48.955022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5568b-5c99-4458-ad59-afb95f00ad12 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:48.972717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:49.005871 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cec0fc-45b4-49d7-b1ff-66e5bef9ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:49.006134 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a774c3-55f0-46b1-8aff-e5a78c101962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:49.007010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cec0fc-45b4-49d7-b1ff-66e5bef9ca02 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:49.007308 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a774c3-55f0-46b1-8aff-e5a78c101962 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:49.007468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cec0fc-45b4-49d7-b1ff-66e5bef9ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:49.007801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a774c3-55f0-46b1-8aff-e5a78c101962 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:49.007902 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cec0fc-45b4-49d7-b1ff-66e5bef9ca02 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:49.008289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a774c3-55f0-46b1-8aff-e5a78c101962 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:49.009219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cec0fc-45b4-49d7-b1ff-66e5bef9ca02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:49.009698 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a774c3-55f0-46b1-8aff-e5a78c101962 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:49.009788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cec0fc-45b4-49d7-b1ff-66e5bef9ca02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:49.010260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a774c3-55f0-46b1-8aff-e5a78c101962 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:49.012265 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cec0fc-45b4-49d7-b1ff-66e5bef9ca02 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:49.012905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a774c3-55f0-46b1-8aff-e5a78c101962 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:49.039932 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 265/519] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:49.039932 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a774c3-55f0-46b1-8aff-e5a78c101962 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:49.042841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 255/520] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:49.044114 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cec0fc-45b4-49d7-b1ff-66e5bef9ca02 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:49.068874 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:49.184195 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cec0fc-45b4-49d7-b1ff-66e5bef9ca02 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:49.224528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a774c3-55f0-46b1-8aff-e5a78c101962 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:49.232978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5eb9a-b1e3-4447-9a34-2d3098cdc511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:49.236529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5eb9a-b1e3-4447-9a34-2d3098cdc511 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:49.236529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5eb9a-b1e3-4447-9a34-2d3098cdc511 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:49.236529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5eb9a-b1e3-4447-9a34-2d3098cdc511 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:49.248961 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5eb9a-b1e3-4447-9a34-2d3098cdc511 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:49.251950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5eb9a-b1e3-4447-9a34-2d3098cdc511 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:49.275714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe796c9-2307-49a7-96d6-653251c03865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:49.276868 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe796c9-2307-49a7-96d6-653251c03865 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:49.277380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe796c9-2307-49a7-96d6-653251c03865 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:49.277906 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe796c9-2307-49a7-96d6-653251c03865 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-90f5eb9a-b1e3-4447-9a34-2d3098cdc511 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:01:49.279397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:49.280222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:49.281176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:01:49.281176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:01:49.281176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:01:49.281176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:01:49.281176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:01:49.281176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:01:49.281176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:49.281176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:49.281583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe796c9-2307-49a7-96d6-653251c03865 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:49.281583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe796c9-2307-49a7-96d6-653251c03865 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:49.283042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe796c9-2307-49a7-96d6-653251c03865 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:49.289574 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 256/521] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:49.291055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5eb9a-b1e3-4447-9a34-2d3098cdc511 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:49.321109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 266/522] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jul 21 12:01:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:49.321109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe796c9-2307-49a7-96d6-653251c03865 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:49.369775 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:49.435983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:49.486331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe796c9-2307-49a7-96d6-653251c03865 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:49.487714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5eb9a-b1e3-4447-9a34-2d3098cdc511 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:49.531778 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c6b16-1826-44a0-b384-a41ed9c189b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:49.533002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c6b16-1826-44a0-b384-a41ed9c189b1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:49.533420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c6b16-1826-44a0-b384-a41ed9c189b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:49.533842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c6b16-1826-44a0-b384-a41ed9c189b1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:49.543868 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c6b16-1826-44a0-b384-a41ed9c189b1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:49.545881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c6b16-1826-44a0-b384-a41ed9c189b1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:49.553148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9f795-28fe-461f-a14b-b9442c861c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:49.554544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f795-28fe-461f-a14b-b9442c861c47 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:49.555074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f795-28fe-461f-a14b-b9442c861c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:49.555586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f795-28fe-461f-a14b-b9442c861c47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-8e4c6b16-1826-44a0-b384-a41ed9c189b1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:01:49.564863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:49.566621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:49.569782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:49.569782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:49.569782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:01:49.569782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:01:49.569782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:01:49.569782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:01:49.569782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:01:49.569782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:01:49.569782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 12:01:49.569782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:49.569782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 267/523] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:01:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:49.569782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c6b16-1826-44a0-b384-a41ed9c189b1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:49.576568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9f795-28fe-461f-a14b-b9442c861c47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:49.579472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9f795-28fe-461f-a14b-b9442c861c47 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-21f9f795-28fe-461f-a14b-b9442c861c47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:01:49.604607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:49.606286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:49.607685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:01:49.607685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:01:49.607685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:01:49.607685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:01:49.607685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:01:49.607685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:01:49.607685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:49.607685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:49.607685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 257/524] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:49.609898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9f795-28fe-461f-a14b-b9442c861c47 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:49.716386 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c6b16-1826-44a0-b384-a41ed9c189b1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:49.756651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:49.756880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:49.761803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9f795-28fe-461f-a14b-b9442c861c47 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:49.765994 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b29be-f965-4d4c-a559-2f020518615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:49.766718 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b29be-f965-4d4c-a559-2f020518615e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:49.767001 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b29be-f965-4d4c-a559-2f020518615e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:49.767273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b29be-f965-4d4c-a559-2f020518615e None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:49.768087 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b29be-f965-4d4c-a559-2f020518615e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:49.768403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b29be-f965-4d4c-a559-2f020518615e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:49.769879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b29be-f965-4d4c-a559-2f020518615e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:49.790538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 268/525] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:01:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:49.796188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b29be-f965-4d4c-a559-2f020518615e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:49.818430 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485c0b4-a161-4132-8fcc-f980e67254b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:49.819495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485c0b4-a161-4132-8fcc-f980e67254b2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:49.819954 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485c0b4-a161-4132-8fcc-f980e67254b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:49.820421 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485c0b4-a161-4132-8fcc-f980e67254b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:49.924251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485c0b4-a161-4132-8fcc-f980e67254b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:49.926198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485c0b4-a161-4132-8fcc-f980e67254b2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:49.970768 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b29be-f965-4d4c-a559-2f020518615e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:50.031401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54251-b271-42f6-a4b0-e937a25a2574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:50.032146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54251-b271-42f6-a4b0-e937a25a2574 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:50.032608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54251-b271-42f6-a4b0-e937a25a2574 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:50.033103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54251-b271-42f6-a4b0-e937a25a2574 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:50.034827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54251-b271-42f6-a4b0-e937a25a2574 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:50.035394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54251-b271-42f6-a4b0-e937a25a2574 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:50.038136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54251-b271-42f6-a4b0-e937a25a2574 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:50.058162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:50.064602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 258/526] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:50.068219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485c0b4-a161-4132-8fcc-f980e67254b2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:50.074716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 269/527] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Jul 21 12:01:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:50.074716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54251-b271-42f6-a4b0-e937a25a2574 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:50.144328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:50.225395 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54251-b271-42f6-a4b0-e937a25a2574 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:50.229551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485c0b4-a161-4132-8fcc-f980e67254b2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:50.279173 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25743bd1-36fa-4b98-92c0-b47d14352c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:50.279844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25743bd1-36fa-4b98-92c0-b47d14352c5d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:50.280129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25743bd1-36fa-4b98-92c0-b47d14352c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:50.280424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25743bd1-36fa-4b98-92c0-b47d14352c5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:50.281284 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25743bd1-36fa-4b98-92c0-b47d14352c5d None admin] RBAC: Adding query filter params (role.id=8fc2e732d1b54ac193720d2652101798, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=f3fb1d091b27472081549f4166ca172f) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:50.281670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25743bd1-36fa-4b98-92c0-b47d14352c5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:50.283088 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25743bd1-36fa-4b98-92c0-b47d14352c5d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:50.289743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 270/528] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:01:50 2022] GET /identity/v3/role_assignments?user.id=f3fb1d091b27472081549f4166ca172f&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=8fc2e732d1b54ac193720d2652101798 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:50.290147 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b46c2a-d545-4cb9-ae91-8fe219f401e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:50.290333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25743bd1-36fa-4b98-92c0-b47d14352c5d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:50.291878 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b46c2a-d545-4cb9-ae91-8fe219f401e7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:50.292581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b46c2a-d545-4cb9-ae91-8fe219f401e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:50.293287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b46c2a-d545-4cb9-ae91-8fe219f401e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:50.294352 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b46c2a-d545-4cb9-ae91-8fe219f401e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:50.294775 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b46c2a-d545-4cb9-ae91-8fe219f401e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:50.296605 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b46c2a-d545-4cb9-ae91-8fe219f401e7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:50.332778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 259/529] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:01:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:50.332778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b46c2a-d545-4cb9-ae91-8fe219f401e7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:50.440623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:50.496866 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b46c2a-d545-4cb9-ae91-8fe219f401e7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:50.500289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25743bd1-36fa-4b98-92c0-b47d14352c5d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:50.531358 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:50.539617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b855fa2-35a2-4a03-9e9b-9067081fe334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:50.540237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b855fa2-35a2-4a03-9e9b-9067081fe334 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:50.540527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b855fa2-35a2-4a03-9e9b-9067081fe334 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:50.540805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b855fa2-35a2-4a03-9e9b-9067081fe334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:50.579343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a11e9-ef67-4bcb-9d05-210b9ca8821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:50.580887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a11e9-ef67-4bcb-9d05-210b9ca8821e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:50.581760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a11e9-ef67-4bcb-9d05-210b9ca8821e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:50.582249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a11e9-ef67-4bcb-9d05-210b9ca8821e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:50.605254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a11e9-ef67-4bcb-9d05-210b9ca8821e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:50.607949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a11e9-ef67-4bcb-9d05-210b9ca8821e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-6a1a11e9-ef67-4bcb-9d05-210b9ca8821e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:50.642164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:50.643146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:50.643992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:50.643992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:50.643992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:50.643992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:50.646167 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 271/530] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:50.652338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a11e9-ef67-4bcb-9d05-210b9ca8821e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:50.658684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b855fa2-35a2-4a03-9e9b-9067081fe334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:50.660567 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b855fa2-35a2-4a03-9e9b-9067081fe334 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:50.727439 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:50.779304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 260/531] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:50.780625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b855fa2-35a2-4a03-9e9b-9067081fe334 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:50.877639 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a11e9-ef67-4bcb-9d05-210b9ca8821e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:50.917523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b855fa2-35a2-4a03-9e9b-9067081fe334 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:50.942887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccf21f-3021-45d3-9793-a8853626f4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:50.944386 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccf21f-3021-45d3-9793-a8853626f4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:50.945140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccf21f-3021-45d3-9793-a8853626f4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:50.945925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccf21f-3021-45d3-9793-a8853626f4b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:50.947896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccf21f-3021-45d3-9793-a8853626f4b9 None admin] RBAC: Adding query filter params (role.id=8fc2e732d1b54ac193720d2652101798, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=10611bf25b9e4604ad769a6902f7f457) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:50.948772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccf21f-3021-45d3-9793-a8853626f4b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:50.952693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccf21f-3021-45d3-9793-a8853626f4b9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:50.978718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec4182-ab89-490c-94db-d066a4a787ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:50.978718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec4182-ab89-490c-94db-d066a4a787ee None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:50.978718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec4182-ab89-490c-94db-d066a4a787ee None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:50.978718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec4182-ab89-490c-94db-d066a4a787ee None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:50.979365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec4182-ab89-490c-94db-d066a4a787ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:50.979365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec4182-ab89-490c-94db-d066a4a787ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:50.979365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec4182-ab89-490c-94db-d066a4a787ee None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:50.980568 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 272/532] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:01:50 2022] GET /identity/v3/role_assignments?user.id=10611bf25b9e4604ad769a6902f7f457&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=8fc2e732d1b54ac193720d2652101798 => generated 259 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:50.983148 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccf21f-3021-45d3-9793-a8853626f4b9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:50.998347 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 261/533] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:51.008247 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec4182-ab89-490c-94db-d066a4a787ee None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:51.060388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:51.076094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:51.216237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec4182-ab89-490c-94db-d066a4a787ee None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:51.246241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccf21f-3021-45d3-9793-a8853626f4b9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:51.258243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d929c-4ee2-44a2-b084-8ba6b13806de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:51.259104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d929c-4ee2-44a2-b084-8ba6b13806de None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:51.259381 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d929c-4ee2-44a2-b084-8ba6b13806de None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:51.259663 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d929c-4ee2-44a2-b084-8ba6b13806de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:51.267630 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d929c-4ee2-44a2-b084-8ba6b13806de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:51.269147 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d929c-4ee2-44a2-b084-8ba6b13806de None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-948d929c-4ee2-44a2-b084-8ba6b13806de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:01:51.284972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:51.286946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:51.288751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:01:51.288751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:01:51.288751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:01:51.288751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:01:51.288751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:01:51.288751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:01:51.288751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:51.288751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:51.288751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 262/534] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:51.288751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425b9f8-d7ad-4543-8dff-a55d04f146d1 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:51.288751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425b9f8-d7ad-4543-8dff-a55d04f146d1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:51.289877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425b9f8-d7ad-4543-8dff-a55d04f146d1 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:51.290000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bcfd1-29c9-4072-878c-32ef4d05a517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:51.294694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bcfd1-29c9-4072-878c-32ef4d05a517 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:51.294694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bcfd1-29c9-4072-878c-32ef4d05a517 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:51.295194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 263/535] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:51.295370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bcfd1-29c9-4072-878c-32ef4d05a517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:51.295562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425b9f8-d7ad-4543-8dff-a55d04f146d1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:51.313338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bcfd1-29c9-4072-878c-32ef4d05a517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:51.316985 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bcfd1-29c9-4072-878c-32ef4d05a517 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-5f3bcfd1-29c9-4072-878c-32ef4d05a517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:51.346534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:51.348360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:51.350199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:51.350199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:51.350199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:51.350199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:51.350199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 273/536] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:51.350199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3c612-c776-40f4-8642-b2bd4a2c796a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:51.350199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3c612-c776-40f4-8642-b2bd4a2c796a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:51.350199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3c612-c776-40f4-8642-b2bd4a2c796a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:51.369901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-77b3c612-c776-40f4-8642-b2bd4a2c796a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:51.371155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-77b3c612-c776-40f4-8642-b2bd4a2c796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:51.437778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:51.476026 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425b9f8-d7ad-4543-8dff-a55d04f146d1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:51.487873 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 274/537] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:51.489381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3c612-c776-40f4-8642-b2bd4a2c796a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:51.512782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:51.523932 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306eadbd-0bb9-4775-b3e9-194c29daa434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:51.524887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eadbd-0bb9-4775-b3e9-194c29daa434 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:51.525348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eadbd-0bb9-4775-b3e9-194c29daa434 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:51.525741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eadbd-0bb9-4775-b3e9-194c29daa434 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:51.526838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306eadbd-0bb9-4775-b3e9-194c29daa434 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:51.527287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306eadbd-0bb9-4775-b3e9-194c29daa434 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:51.528963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306eadbd-0bb9-4775-b3e9-194c29daa434 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:51.544349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 264/538] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:01:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:51.546024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306eadbd-0bb9-4775-b3e9-194c29daa434 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:51.676190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306eadbd-0bb9-4775-b3e9-194c29daa434 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:51.678360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3c612-c776-40f4-8642-b2bd4a2c796a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:51.727004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b643ea3-d889-4e60-a93c-0dc501baf2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:51.728458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b643ea3-d889-4e60-a93c-0dc501baf2ee None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:51.728851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b643ea3-d889-4e60-a93c-0dc501baf2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:51.729228 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b643ea3-d889-4e60-a93c-0dc501baf2ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:51.738696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:51.745566 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b643ea3-d889-4e60-a93c-0dc501baf2ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:51.749580 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72578fd8-eb4a-416b-9dab-5fd8b23121da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:51.751267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72578fd8-eb4a-416b-9dab-5fd8b23121da None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:51.751720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72578fd8-eb4a-416b-9dab-5fd8b23121da None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:51.752164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72578fd8-eb4a-416b-9dab-5fd8b23121da None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:51.753094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72578fd8-eb4a-416b-9dab-5fd8b23121da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-7b643ea3-d889-4e60-a93c-0dc501baf2ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:51.756128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:51.757637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:51.758895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:51.758895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:51.758895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:51.758895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:51.758895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:51.758895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:51.758895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:51.758895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:51.758895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:51.758895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:51.758895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:51.758895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:51.758895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 265/539] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:01:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:51.758895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b643ea3-d889-4e60-a93c-0dc501baf2ee None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:51.764518 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72578fd8-eb4a-416b-9dab-5fd8b23121da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:51.768492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72578fd8-eb4a-416b-9dab-5fd8b23121da None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:51.796474 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 275/540] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:51.796474 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72578fd8-eb4a-416b-9dab-5fd8b23121da None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:51.896871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:51.934420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b643ea3-d889-4e60-a93c-0dc501baf2ee None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:51.935266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72578fd8-eb4a-416b-9dab-5fd8b23121da None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:51.977240 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41747374-51d1-4b84-a51e-7e12bd871689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:51.977985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41747374-51d1-4b84-a51e-7e12bd871689 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:51.978400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41747374-51d1-4b84-a51e-7e12bd871689 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:51.978817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41747374-51d1-4b84-a51e-7e12bd871689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:51.979805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41747374-51d1-4b84-a51e-7e12bd871689 None admin] RBAC: Adding query filter params (role.id=8fc2e732d1b54ac193720d2652101798, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=2af1aad6bd5c486192345b3747ed3e23) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:51.980221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41747374-51d1-4b84-a51e-7e12bd871689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:51.982376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41747374-51d1-4b84-a51e-7e12bd871689 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:51.990953 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 266/541] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:01:51 2022] GET /identity/v3/role_assignments?user.id=2af1aad6bd5c486192345b3747ed3e23&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=8fc2e732d1b54ac193720d2652101798 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:51.991981 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41747374-51d1-4b84-a51e-7e12bd871689 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:52.021136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a8464-2d3e-4b82-9ece-9d9d0db39d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:52.021966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8464-2d3e-4b82-9ece-9d9d0db39d46 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:52.022116 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8464-2d3e-4b82-9ece-9d9d0db39d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:52.022373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8464-2d3e-4b82-9ece-9d9d0db39d46 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:52.026356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a8464-2d3e-4b82-9ece-9d9d0db39d46 None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:52.026675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a8464-2d3e-4b82-9ece-9d9d0db39d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:52.028241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a8464-2d3e-4b82-9ece-9d9d0db39d46 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:52.049777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 276/542] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:01:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:52.056401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a8464-2d3e-4b82-9ece-9d9d0db39d46 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:52.126212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:52.213396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41747374-51d1-4b84-a51e-7e12bd871689 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:52.257907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef04aeb-3273-494b-9c19-0324d4095f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:52.260039 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef04aeb-3273-494b-9c19-0324d4095f70 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:52.260323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef04aeb-3273-494b-9c19-0324d4095f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:52.260587 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef04aeb-3273-494b-9c19-0324d4095f70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:52.278145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef04aeb-3273-494b-9c19-0324d4095f70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:52.279656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef04aeb-3273-494b-9c19-0324d4095f70 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-eef04aeb-3273-494b-9c19-0324d4095f70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:01:52.301884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:52.303469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:52.304972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:01:52.304972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:01:52.304972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:01:52.304972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:01:52.304972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:01:52.304972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:01:52.304972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:52.304972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:52.304972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 267/543] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:52.311792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef04aeb-3273-494b-9c19-0324d4095f70 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:52.315271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a8464-2d3e-4b82-9ece-9d9d0db39d46 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:52.377249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff374423-1546-48d6-9250-7cd34d42cb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:52.379247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff374423-1546-48d6-9250-7cd34d42cb98 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:52.380026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff374423-1546-48d6-9250-7cd34d42cb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:52.380950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff374423-1546-48d6-9250-7cd34d42cb98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:52.387132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:52.409098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff374423-1546-48d6-9250-7cd34d42cb98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:52.413070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff374423-1546-48d6-9250-7cd34d42cb98 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-ff374423-1546-48d6-9250-7cd34d42cb98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:52.468668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:52.470207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:52.471790 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:52.471790 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:52.471790 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:52.471790 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:52.475807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 277/544] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:52.486024 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff374423-1546-48d6-9250-7cd34d42cb98 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:52.581047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef04aeb-3273-494b-9c19-0324d4095f70 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:52.617783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:52.636563 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f427e3-f848-499a-bc0f-3f315ffdcd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:52.637583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f427e3-f848-499a-bc0f-3f315ffdcd41 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:52.640116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f427e3-f848-499a-bc0f-3f315ffdcd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:52.640577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f427e3-f848-499a-bc0f-3f315ffdcd41 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:52.641537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f427e3-f848-499a-bc0f-3f315ffdcd41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:52.643576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f427e3-f848-499a-bc0f-3f315ffdcd41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:52.645201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f427e3-f848-499a-bc0f-3f315ffdcd41 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:52.672391 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 268/545] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:01:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:52.678765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f427e3-f848-499a-bc0f-3f315ffdcd41 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:52.728988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff374423-1546-48d6-9250-7cd34d42cb98 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:52.835519 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f427e3-f848-499a-bc0f-3f315ffdcd41 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:52.837616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3472e-cfc4-4984-a596-5098f6048f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:52.838365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3472e-cfc4-4984-a596-5098f6048f30 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:52.838786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3472e-cfc4-4984-a596-5098f6048f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:52.839899 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3472e-cfc4-4984-a596-5098f6048f30 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:52.839899 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3472e-cfc4-4984-a596-5098f6048f30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:52.840417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3472e-cfc4-4984-a596-5098f6048f30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:52.841951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3472e-cfc4-4984-a596-5098f6048f30 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:52.877151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 278/546] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:52.883268 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3472e-cfc4-4984-a596-5098f6048f30 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:52.888050 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d87948-9480-4bf6-8b20-1854e95f4980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:52.889089 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d87948-9480-4bf6-8b20-1854e95f4980 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:52.889517 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d87948-9480-4bf6-8b20-1854e95f4980 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:52.891016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d87948-9480-4bf6-8b20-1854e95f4980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:52.892081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d87948-9480-4bf6-8b20-1854e95f4980 None admin] RBAC: Adding query filter params (role.id=8fc2e732d1b54ac193720d2652101798, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=88cfd88c19fd4c979e921e3d8cd9cc3c) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:52.896271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d87948-9480-4bf6-8b20-1854e95f4980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:52.900677 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d87948-9480-4bf6-8b20-1854e95f4980 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:52.911062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 269/547] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:01:52 2022] GET /identity/v3/role_assignments?user.id=88cfd88c19fd4c979e921e3d8cd9cc3c&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=8fc2e732d1b54ac193720d2652101798 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:52.957755 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:53.022266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3472e-cfc4-4984-a596-5098f6048f30 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:53.065018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a5dae-2652-4f1b-ab16-a532e8f59b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:53.066197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a5dae-2652-4f1b-ab16-a532e8f59b17 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:53.066642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a5dae-2652-4f1b-ab16-a532e8f59b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:53.067097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a5dae-2652-4f1b-ab16-a532e8f59b17 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:53.076402 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a5dae-2652-4f1b-ab16-a532e8f59b17 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:53.078339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a5dae-2652-4f1b-ab16-a532e8f59b17 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-6f2a5dae-2652-4f1b-ab16-a532e8f59b17 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:01:53.098015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:53.099571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:53.108279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:53.108279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:53.108279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:01:53.108279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:01:53.108279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:01:53.108279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:01:53.108279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:01:53.108279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:01:53.108279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 12:01:53.108279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:53.108279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 279/548] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:01:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:53.111075 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d87948-9480-4bf6-8b20-1854e95f4980 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:53.188483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:53.272971 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d87948-9480-4bf6-8b20-1854e95f4980 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:53.327767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0e544-d8e7-427c-8e9e-5c4a3f2823ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:53.328850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0e544-d8e7-427c-8e9e-5c4a3f2823ce None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:53.329363 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0e544-d8e7-427c-8e9e-5c4a3f2823ce None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:53.329840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0e544-d8e7-427c-8e9e-5c4a3f2823ce None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:53.330945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0e544-d8e7-427c-8e9e-5c4a3f2823ce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:53.331468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0e544-d8e7-427c-8e9e-5c4a3f2823ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:53.333166 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0e544-d8e7-427c-8e9e-5c4a3f2823ce None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:53.359024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 270/549] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jul 21 12:01:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:53.363858 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a5dae-2652-4f1b-ab16-a532e8f59b17 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:53.445458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3596-72dc-4c1b-9af9-413de598398d None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:53.446340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3596-72dc-4c1b-9af9-413de598398d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:53.447113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3596-72dc-4c1b-9af9-413de598398d None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:53.451192 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 271/550] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:53.465363 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1abf5-a3da-4c48-9e58-4a27c46f30ff None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:53.465851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1abf5-a3da-4c48-9e58-4a27c46f30ff None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:53.466334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1abf5-a3da-4c48-9e58-4a27c46f30ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:53.508195 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f9f1abf5-a3da-4c48-9e58-4a27c46f30ff None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:53.509430 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f9f1abf5-a3da-4c48-9e58-4a27c46f30ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:53.550200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a5dae-2652-4f1b-ab16-a532e8f59b17 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:53.571050 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:53.605246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82554b3f-03cc-47e3-b7e5-4c86e34823d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:53.606083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554b3f-03cc-47e3-b7e5-4c86e34823d2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:53.606560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554b3f-03cc-47e3-b7e5-4c86e34823d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:53.606949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554b3f-03cc-47e3-b7e5-4c86e34823d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:53.632255 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 272/551] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:53.658476 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1abf5-a3da-4c48-9e58-4a27c46f30ff None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:53.730358 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:53.768932 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82554b3f-03cc-47e3-b7e5-4c86e34823d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:53.771548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82554b3f-03cc-47e3-b7e5-4c86e34823d2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:53.895388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1abf5-a3da-4c48-9e58-4a27c46f30ff None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:53.952418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb6e2c-227b-4095-bd2c-fa87e82fd995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:53.953763 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb6e2c-227b-4095-bd2c-fa87e82fd995 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:53.954283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb6e2c-227b-4095-bd2c-fa87e82fd995 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:53.954825 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb6e2c-227b-4095-bd2c-fa87e82fd995 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:53.976557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb6e2c-227b-4095-bd2c-fa87e82fd995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-63bb6e2c-227b-4095-bd2c-fa87e82fd995 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:53.997359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:53.998360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:53.999274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:53.999274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:53.999274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:53.999274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:53.999274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:53.999274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:53.999274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:53.999274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:53.999274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:53.999274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:53.999274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:53.999274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:53.999912 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 280/552] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:01:54.007364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 273/553] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:01:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:01:54.007676 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82554b3f-03cc-47e3-b7e5-4c86e34823d2 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:54.027883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:54.028513 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb6e2c-227b-4095-bd2c-fa87e82fd995 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:54.146026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82554b3f-03cc-47e3-b7e5-4c86e34823d2 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:54.192520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79604f37-8fd1-4960-a102-5fff9b3dcb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:54.194072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79604f37-8fd1-4960-a102-5fff9b3dcb99 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:54.194359 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79604f37-8fd1-4960-a102-5fff9b3dcb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:54.194638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79604f37-8fd1-4960-a102-5fff9b3dcb99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:54.213956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79604f37-8fd1-4960-a102-5fff9b3dcb99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:54.215888 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79604f37-8fd1-4960-a102-5fff9b3dcb99 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:54.228600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:54.238727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb6e2c-227b-4095-bd2c-fa87e82fd995 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-79604f37-8fd1-4960-a102-5fff9b3dcb99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:54.257053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:54.259081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:54.260779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:54.260779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:54.260779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:54.260779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:54.260779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 281/554] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:54.260779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ede72-0375-46f2-91ad-9e001c1a4ecf None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:54.260779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ede72-0375-46f2-91ad-9e001c1a4ecf None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:54.260779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ede72-0375-46f2-91ad-9e001c1a4ecf None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:54.262488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 282/555] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:54.264764 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ede72-0375-46f2-91ad-9e001c1a4ecf None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:54.307221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a6abe-4841-46b9-acef-bb88522147d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:54.308725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a6abe-4841-46b9-acef-bb88522147d4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:54.309523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a6abe-4841-46b9-acef-bb88522147d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:54.310296 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a6abe-4841-46b9-acef-bb88522147d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:54.312291 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a6abe-4841-46b9-acef-bb88522147d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:54.313233 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a6abe-4841-46b9-acef-bb88522147d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:54.316143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a6abe-4841-46b9-acef-bb88522147d4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:54.329995 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:54.337309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 274/556] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:01:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:54.340372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279e61-78aa-4a2b-9834-e641b6514286 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:54.341186 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279e61-78aa-4a2b-9834-e641b6514286 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:54.342092 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279e61-78aa-4a2b-9834-e641b6514286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:54.372158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-29279e61-78aa-4a2b-9834-e641b6514286 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:54.374998 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-29279e61-78aa-4a2b-9834-e641b6514286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:54.375772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ede72-0375-46f2-91ad-9e001c1a4ecf None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:54.413421 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6613e17-0948-4366-a98a-807a51894888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:54.414039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6613e17-0948-4366-a98a-807a51894888 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:54.414320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6613e17-0948-4366-a98a-807a51894888 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:54.414648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6613e17-0948-4366-a98a-807a51894888 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:54.415412 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6613e17-0948-4366-a98a-807a51894888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:54.415764 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6613e17-0948-4366-a98a-807a51894888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:54.417143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6613e17-0948-4366-a98a-807a51894888 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:54.430346 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 283/557] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:01:54.431499 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6613e17-0948-4366-a98a-807a51894888 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:54.494360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 275/558] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:54.495293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29279e61-78aa-4a2b-9834-e641b6514286 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:54.578605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6613e17-0948-4366-a98a-807a51894888 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:54.597127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:54.609720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:54.623630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3dbdd-68ee-4f6f-8042-36f2c291b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:54.624533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3dbdd-68ee-4f6f-8042-36f2c291b198 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:54.624823 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3dbdd-68ee-4f6f-8042-36f2c291b198 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:54.625089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3dbdd-68ee-4f6f-8042-36f2c291b198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:54.634263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29279e61-78aa-4a2b-9834-e641b6514286 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:54.641820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3dbdd-68ee-4f6f-8042-36f2c291b198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:54.643351 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3dbdd-68ee-4f6f-8042-36f2c291b198 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-a0e3dbdd-68ee-4f6f-8042-36f2c291b198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:54.668314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:54.669240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:54.670114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:54.670114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:54.670114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:54.670114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:54.670114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 284/559] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:54.670926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba597d-28d4-4fdc-a62d-8307a66ced0c None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:54.671187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba597d-28d4-4fdc-a62d-8307a66ced0c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:54.671466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba597d-28d4-4fdc-a62d-8307a66ced0c None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:54.674695 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 285/560] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:54.674695 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba597d-28d4-4fdc-a62d-8307a66ced0c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:54.693804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccba2c-208d-4dac-b439-7ce58dff6791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:54.695028 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccba2c-208d-4dac-b439-7ce58dff6791 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:54.695536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccba2c-208d-4dac-b439-7ce58dff6791 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:54.696031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccba2c-208d-4dac-b439-7ce58dff6791 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:54.707300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccba2c-208d-4dac-b439-7ce58dff6791 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:54.710144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccba2c-208d-4dac-b439-7ce58dff6791 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-a0ccba2c-208d-4dac-b439-7ce58dff6791 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:01:54.740468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:54.741933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:54.743130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:01:54.743130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:01:54.743130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:01:54.743130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:01:54.743130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:01:54.743130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:01:54.743130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:54.743130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:54.744627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 276/561] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:54.745705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccba2c-208d-4dac-b439-7ce58dff6791 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:54.842716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba597d-28d4-4fdc-a62d-8307a66ced0c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:54.908246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4938fe0-c1da-4366-9312-bea7171787ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:54.909678 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4938fe0-c1da-4366-9312-bea7171787ff None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:54.910209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4938fe0-c1da-4366-9312-bea7171787ff None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:54.910459 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccba2c-208d-4dac-b439-7ce58dff6791 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:54.910675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4938fe0-c1da-4366-9312-bea7171787ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:54.932150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4938fe0-c1da-4366-9312-bea7171787ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f4938fe0-c1da-4366-9312-bea7171787ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:54.947322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:54.948522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:54.949485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:54.949485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:54.949485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:54.949485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:54.949485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:54.949485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:54.949485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:54.949485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:54.949485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:54.949485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:54.949485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:54.949485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:54.950564 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 286/562] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:01:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:54.953021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7103b-0527-4c6e-a043-8273983fe38b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:54.953483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7103b-0527-4c6e-a043-8273983fe38b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:54.953950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7103b-0527-4c6e-a043-8273983fe38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:54.973172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35d175-056e-46e1-a71e-6bb3a7e58b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:54.973875 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35d175-056e-46e1-a71e-6bb3a7e58b09 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:54.974865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35d175-056e-46e1-a71e-6bb3a7e58b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:54.975154 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35d175-056e-46e1-a71e-6bb3a7e58b09 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:54.975931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35d175-056e-46e1-a71e-6bb3a7e58b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:54.976240 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35d175-056e-46e1-a71e-6bb3a7e58b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:54.977673 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35d175-056e-46e1-a71e-6bb3a7e58b09 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:54.982197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0af7103b-0527-4c6e-a043-8273983fe38b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:54.984253 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0af7103b-0527-4c6e-a043-8273983fe38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:54.996791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 277/563] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:54.996791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35d175-056e-46e1-a71e-6bb3a7e58b09 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:55.002598 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:55.027979 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:55.112800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 287/564] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:55.114401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7103b-0527-4c6e-a043-8273983fe38b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:55.157682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35d175-056e-46e1-a71e-6bb3a7e58b09 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:55.205654 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d83cc-c401-414d-8193-a0ca2f14e09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:55.206255 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d83cc-c401-414d-8193-a0ca2f14e09a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:55.206596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d83cc-c401-414d-8193-a0ca2f14e09a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:55.206878 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d83cc-c401-414d-8193-a0ca2f14e09a None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:55.207674 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d83cc-c401-414d-8193-a0ca2f14e09a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:55.208006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d83cc-c401-414d-8193-a0ca2f14e09a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:55.209532 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d83cc-c401-414d-8193-a0ca2f14e09a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:55.227106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 278/565] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:01:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:55.228440 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d83cc-c401-414d-8193-a0ca2f14e09a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:55.265844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7103b-0527-4c6e-a043-8273983fe38b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:55.316377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98f26d-c546-4414-b0ba-bc447ab2159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:55.317450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98f26d-c546-4414-b0ba-bc447ab2159c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:55.317885 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98f26d-c546-4414-b0ba-bc447ab2159c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:55.318330 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98f26d-c546-4414-b0ba-bc447ab2159c None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:55.319595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98f26d-c546-4414-b0ba-bc447ab2159c None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:55.319851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:55.320304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98f26d-c546-4414-b0ba-bc447ab2159c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:55.322199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98f26d-c546-4414-b0ba-bc447ab2159c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:55.336717 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 288/566] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:01:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:55.338478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98f26d-c546-4414-b0ba-bc447ab2159c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:55.376691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:55.377515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d83cc-c401-414d-8193-a0ca2f14e09a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:55.419268 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e2476-3258-457c-b659-0697f0e8f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:55.420069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e2476-3258-457c-b659-0697f0e8f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:55.420361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e2476-3258-457c-b659-0697f0e8f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:55.420621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e2476-3258-457c-b659-0697f0e8f9e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:55.429110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e2476-3258-457c-b659-0697f0e8f9e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:55.430593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e2476-3258-457c-b659-0697f0e8f9e8 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-a36e2476-3258-457c-b659-0697f0e8f9e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:01:55.457066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:55.459139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:55.461901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:55.461901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:55.461901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:01:55.461901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:01:55.461901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:01:55.461901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:01:55.461901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:01:55.461901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:01:55.461901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:01:55.461901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:55.461901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 279/567] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jul 21 12:01:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:55.463462 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e2476-3258-457c-b659-0697f0e8f9e8 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:55.479531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98f26d-c546-4414-b0ba-bc447ab2159c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:55.517091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0c828-1d8f-46c3-a0e4-b801d4b44f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:55.517903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0c828-1d8f-46c3-a0e4-b801d4b44f4d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:55.518179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0c828-1d8f-46c3-a0e4-b801d4b44f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:55.518447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0c828-1d8f-46c3-a0e4-b801d4b44f4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:55.530117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0c828-1d8f-46c3-a0e4-b801d4b44f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f9e0c828-1d8f-46c3-a0e4-b801d4b44f4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:55.537988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:55.539638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:55.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:55.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:55.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:55.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:55.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:55.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:55.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:55.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:55.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:55.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:55.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:55.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:55.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 289/568] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:01:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:55.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84236170-e997-4f52-bf08-3eb9b9ae50e9 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:55.544411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84236170-e997-4f52-bf08-3eb9b9ae50e9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:55.544411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84236170-e997-4f52-bf08-3eb9b9ae50e9 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:55.544411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 290/569] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:55.544411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84236170-e997-4f52-bf08-3eb9b9ae50e9 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:55.592893 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e2476-3258-457c-b659-0697f0e8f9e8 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:55.626145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:55.637209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d52051-7adb-4361-9517-2d78ca384f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:55.638016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d52051-7adb-4361-9517-2d78ca384f9a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:55.638377 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d52051-7adb-4361-9517-2d78ca384f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:55.638779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d52051-7adb-4361-9517-2d78ca384f9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:55.639906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d52051-7adb-4361-9517-2d78ca384f9a None admin] RBAC: Adding query filter params (role.id=8fc2e732d1b54ac193720d2652101798, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=2dd659c33e0f49dc8edf30bd47737e70) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:55.640303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d52051-7adb-4361-9517-2d78ca384f9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:55.642177 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d52051-7adb-4361-9517-2d78ca384f9a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:55.648825 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 280/570] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:01:55 2022] GET /identity/v3/role_assignments?user.id=2dd659c33e0f49dc8edf30bd47737e70&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=8fc2e732d1b54ac193720d2652101798 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:55.649688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d52051-7adb-4361-9517-2d78ca384f9a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:55.653040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:55.687136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84236170-e997-4f52-bf08-3eb9b9ae50e9 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:55.751111 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f957f-91bf-4a7a-8fb4-b35dce661b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:55.752361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f957f-91bf-4a7a-8fb4-b35dce661b90 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:55.752861 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f957f-91bf-4a7a-8fb4-b35dce661b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:55.753361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f957f-91bf-4a7a-8fb4-b35dce661b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:55.768568 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f957f-91bf-4a7a-8fb4-b35dce661b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:55.770617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f957f-91bf-4a7a-8fb4-b35dce661b90 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-7e4f957f-91bf-4a7a-8fb4-b35dce661b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:55.791296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:55.792455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:55.793472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:55.793472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:55.793472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:55.793472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:55.795161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 291/571] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:55.796268 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f957f-91bf-4a7a-8fb4-b35dce661b90 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:55.826357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d52051-7adb-4361-9517-2d78ca384f9a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:55.884536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b1ad2-56b6-4d87-8fdb-545be79fa9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:55.885721 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b1ad2-56b6-4d87-8fdb-545be79fa9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:55.886216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b1ad2-56b6-4d87-8fdb-545be79fa9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:55.886743 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b1ad2-56b6-4d87-8fdb-545be79fa9e5 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:55.888405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b1ad2-56b6-4d87-8fdb-545be79fa9e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:55.889001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b1ad2-56b6-4d87-8fdb-545be79fa9e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:55.891860 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b1ad2-56b6-4d87-8fdb-545be79fa9e5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:55.926256 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 281/572] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jul 21 12:01:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:55.928749 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb9894-90fd-4b7d-9f71-da800fb9d124 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:55.929239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb9894-90fd-4b7d-9f71-da800fb9d124 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:55.929700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb9894-90fd-4b7d-9f71-da800fb9d124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:55.937702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f957f-91bf-4a7a-8fb4-b35dce661b90 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:55.958892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-eacb9894-90fd-4b7d-9f71-da800fb9d124 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:55.960943 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-eacb9894-90fd-4b7d-9f71-da800fb9d124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:55.977558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767da04-afaf-4232-bd68-1fc94f880051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:55.978607 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767da04-afaf-4232-bd68-1fc94f880051 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:55.979189 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767da04-afaf-4232-bd68-1fc94f880051 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:55.979457 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767da04-afaf-4232-bd68-1fc94f880051 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:55.980249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767da04-afaf-4232-bd68-1fc94f880051 None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:55.980556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767da04-afaf-4232-bd68-1fc94f880051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:55.982043 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767da04-afaf-4232-bd68-1fc94f880051 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:55.983861 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:55.993968 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 292/573] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:01:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:55.995317 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767da04-afaf-4232-bd68-1fc94f880051 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:56.041083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:56.074740 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 282/574] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:56.074740 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb9894-90fd-4b7d-9f71-da800fb9d124 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:56.139142 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767da04-afaf-4232-bd68-1fc94f880051 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:56.181173 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8095a1b-44c3-411b-9b1f-c7f514aeeaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:56.182069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8095a1b-44c3-411b-9b1f-c7f514aeeaab None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:56.182416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8095a1b-44c3-411b-9b1f-c7f514aeeaab None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:56.182850 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8095a1b-44c3-411b-9b1f-c7f514aeeaab None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:56.183874 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8095a1b-44c3-411b-9b1f-c7f514aeeaab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:56.184262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8095a1b-44c3-411b-9b1f-c7f514aeeaab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:56.185999 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8095a1b-44c3-411b-9b1f-c7f514aeeaab None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:56.193534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb9894-90fd-4b7d-9f71-da800fb9d124 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:56.201539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 293/575] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:56.203156 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8095a1b-44c3-411b-9b1f-c7f514aeeaab None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:56.251241 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83d70d-8b0e-4a87-9b0f-49cf86ef8add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:56.252969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d70d-8b0e-4a87-9b0f-49cf86ef8add None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:56.253683 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d70d-8b0e-4a87-9b0f-49cf86ef8add None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:56.254213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d70d-8b0e-4a87-9b0f-49cf86ef8add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:56.272745 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83d70d-8b0e-4a87-9b0f-49cf86ef8add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:56.275029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83d70d-8b0e-4a87-9b0f-49cf86ef8add None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:56.294537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-8c83d70d-8b0e-4a87-9b0f-49cf86ef8add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:56.306940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:56.307923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:56.308818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:56.308818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:56.308818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:56.308818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:56.308818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 283/576] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:56.310009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83d70d-8b0e-4a87-9b0f-49cf86ef8add None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:56.362053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:56.370366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8095a1b-44c3-411b-9b1f-c7f514aeeaab None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:56.424690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8de94f-6d86-4652-a277-c8b2685987ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:56.425951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8de94f-6d86-4652-a277-c8b2685987ea None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:56.426417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8de94f-6d86-4652-a277-c8b2685987ea None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:56.426912 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8de94f-6d86-4652-a277-c8b2685987ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:56.446158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8de94f-6d86-4652-a277-c8b2685987ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:56.448279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8de94f-6d86-4652-a277-c8b2685987ea None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-bf8de94f-6d86-4652-a277-c8b2685987ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:56.474329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:56.476074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:56.478468 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:56.478468 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:56.478468 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:56.478468 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:56.478933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83d70d-8b0e-4a87-9b0f-49cf86ef8add None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:56.479608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 294/577] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:56.481486 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8de94f-6d86-4652-a277-c8b2685987ea None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:56.540507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0406651-587e-482a-bdcf-409e86af53ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:56.541416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0406651-587e-482a-bdcf-409e86af53ef None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:56.541870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0406651-587e-482a-bdcf-409e86af53ef None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:56.542320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0406651-587e-482a-bdcf-409e86af53ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:56.560659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0406651-587e-482a-bdcf-409e86af53ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-b0406651-587e-482a-bdcf-409e86af53ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:56.573923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:56.574990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:56.576170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:56.576170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:56.576170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:56.576170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:56.576170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:56.576170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:56.576170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:56.576170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:56.576170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:56.576170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:56.576170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:56.576170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:56.576170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 284/578] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:01:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:56.577809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0406651-587e-482a-bdcf-409e86af53ef None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:56.655573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8de94f-6d86-4652-a277-c8b2685987ea None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:56.670995 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:56.711052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:56.714962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af57f6-2838-4ccd-9d14-0dda19c6b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:56.716248 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af57f6-2838-4ccd-9d14-0dda19c6b732 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:56.716723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af57f6-2838-4ccd-9d14-0dda19c6b732 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:56.717121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af57f6-2838-4ccd-9d14-0dda19c6b732 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:56.728580 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0406651-587e-482a-bdcf-409e86af53ef None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:56.729677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af57f6-2838-4ccd-9d14-0dda19c6b732 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:56.732136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af57f6-2838-4ccd-9d14-0dda19c6b732 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-75af57f6-2838-4ccd-9d14-0dda19c6b732 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:01:56.758126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:56.759721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:56.766791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:56.766791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:56.766791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:01:56.766791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:01:56.766791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:01:56.766791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:01:56.766791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:01:56.766791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:01:56.766791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 12:01:56.766791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:56.766791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 295/579] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:56.766791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af57f6-2838-4ccd-9d14-0dda19c6b732 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:56.789300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929327b-ffe0-470b-8c45-cfa4dd8c8125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:56.790308 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929327b-ffe0-470b-8c45-cfa4dd8c8125 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:56.790791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929327b-ffe0-470b-8c45-cfa4dd8c8125 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:56.791452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929327b-ffe0-470b-8c45-cfa4dd8c8125 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:56.792636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929327b-ffe0-470b-8c45-cfa4dd8c8125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:56.793132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929327b-ffe0-470b-8c45-cfa4dd8c8125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:56.795335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929327b-ffe0-470b-8c45-cfa4dd8c8125 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:56.820305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 285/580] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:56.820305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929327b-ffe0-470b-8c45-cfa4dd8c8125 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:56.925883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af57f6-2838-4ccd-9d14-0dda19c6b732 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:56.971955 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79957369-df9e-41a6-bbfc-cef1277b48b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:56.972512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929327b-ffe0-470b-8c45-cfa4dd8c8125 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:56.972987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79957369-df9e-41a6-bbfc-cef1277b48b6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:56.973427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79957369-df9e-41a6-bbfc-cef1277b48b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:56.973860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79957369-df9e-41a6-bbfc-cef1277b48b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:56.975099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79957369-df9e-41a6-bbfc-cef1277b48b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:56.975609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79957369-df9e-41a6-bbfc-cef1277b48b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:56.977597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79957369-df9e-41a6-bbfc-cef1277b48b6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:56.996934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 296/581] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:56.998162 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79957369-df9e-41a6-bbfc-cef1277b48b6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:57.036595 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f55a7-9910-4162-a003-69853b7068ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:57.037481 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f55a7-9910-4162-a003-69853b7068ff None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:57.037898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f55a7-9910-4162-a003-69853b7068ff None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:57.038471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f55a7-9910-4162-a003-69853b7068ff None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:57.039522 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f55a7-9910-4162-a003-69853b7068ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:57.039967 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f55a7-9910-4162-a003-69853b7068ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:57.041737 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f55a7-9910-4162-a003-69853b7068ff None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:57.048142 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:57.054143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 286/582] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:01:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:57.057509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f55a7-9910-4162-a003-69853b7068ff None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:57.078892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:57.154836 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79957369-df9e-41a6-bbfc-cef1277b48b6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:57.210475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ef27d-8739-4474-90dc-0118ac04b563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:57.211755 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef27d-8739-4474-90dc-0118ac04b563 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:57.212273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef27d-8739-4474-90dc-0118ac04b563 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:57.212768 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef27d-8739-4474-90dc-0118ac04b563 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:57.214440 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ef27d-8739-4474-90dc-0118ac04b563 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:57.215031 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ef27d-8739-4474-90dc-0118ac04b563 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:57.217928 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ef27d-8739-4474-90dc-0118ac04b563 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:57.223031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f55a7-9910-4162-a003-69853b7068ff None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:57.254639 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 297/583] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jul 21 12:01:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:57.254639 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ef27d-8739-4474-90dc-0118ac04b563 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:57.283872 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93ced7-ff76-4420-b62a-71fc8a753dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:57.285443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93ced7-ff76-4420-b62a-71fc8a753dab None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:57.285919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93ced7-ff76-4420-b62a-71fc8a753dab None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:57.286400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93ced7-ff76-4420-b62a-71fc8a753dab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:57.300348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93ced7-ff76-4420-b62a-71fc8a753dab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:57.303240 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93ced7-ff76-4420-b62a-71fc8a753dab None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-fe93ced7-ff76-4420-b62a-71fc8a753dab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:01:57.331903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:57.333162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:57.334040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:01:57.334040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:01:57.334040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:01:57.334040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:01:57.334040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:01:57.334040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:01:57.334040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:57.334040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:57.335722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 287/584] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:57.336043 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93ced7-ff76-4420-b62a-71fc8a753dab None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:57.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:57.401320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ef27d-8739-4474-90dc-0118ac04b563 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:57.464577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:57.466627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bad37-7c0d-4cfa-8adb-1c1bfe8961c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:57.468261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bad37-7c0d-4cfa-8adb-1c1bfe8961c2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:57.468709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bad37-7c0d-4cfa-8adb-1c1bfe8961c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:57.469230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bad37-7c0d-4cfa-8adb-1c1bfe8961c2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:57.484065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bad37-7c0d-4cfa-8adb-1c1bfe8961c2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:57.486712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bad37-7c0d-4cfa-8adb-1c1bfe8961c2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:57.502115 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93ced7-ff76-4420-b62a-71fc8a753dab None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-799bad37-7c0d-4cfa-8adb-1c1bfe8961c2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:01:57.515788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:57.517705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:57.520292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:57.520292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:57.520292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:01:57.520292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:01:57.520292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:01:57.520292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:01:57.520292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:01:57.520292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:01:57.520292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 12:01:57.520292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:57.520292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 298/585] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:01:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:57.520292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bad37-7c0d-4cfa-8adb-1c1bfe8961c2 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:57.552939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4402e40-3e0a-4c97-9143-74599e6d8ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:57.554449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4402e40-3e0a-4c97-9143-74599e6d8ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:57.555073 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4402e40-3e0a-4c97-9143-74599e6d8ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:57.555647 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4402e40-3e0a-4c97-9143-74599e6d8ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:57.579605 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4402e40-3e0a-4c97-9143-74599e6d8ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:57.583448 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4402e40-3e0a-4c97-9143-74599e6d8ab2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-a4402e40-3e0a-4c97-9143-74599e6d8ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:57.609800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:57.611688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:57.613926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:57.613926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:57.613926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:57.613926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:57.616032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 288/586] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:57.617016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4402e40-3e0a-4c97-9143-74599e6d8ab2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:57.687044 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bad37-7c0d-4cfa-8adb-1c1bfe8961c2 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:57.749744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554d13c-dd9d-4f25-a38a-c12cea80e116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:57.751013 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554d13c-dd9d-4f25-a38a-c12cea80e116 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:57.751448 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554d13c-dd9d-4f25-a38a-c12cea80e116 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:57.751865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554d13c-dd9d-4f25-a38a-c12cea80e116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:57.765037 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554d13c-dd9d-4f25-a38a-c12cea80e116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:57.766855 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554d13c-dd9d-4f25-a38a-c12cea80e116 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:57.776098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:57.787464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4402e40-3e0a-4c97-9143-74599e6d8ab2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-d554d13c-dd9d-4f25-a38a-c12cea80e116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:57.788430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:57.790289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:57.792075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:57.792075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:57.792075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:57.792075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:57.795529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 299/587] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:57.797019 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554d13c-dd9d-4f25-a38a-c12cea80e116 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:57.833002 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:57.855450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ed2db-a159-486c-8f2e-09d4e3fc9da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:57.856489 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed2db-a159-486c-8f2e-09d4e3fc9da4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:57.856963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed2db-a159-486c-8f2e-09d4e3fc9da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:57.857451 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed2db-a159-486c-8f2e-09d4e3fc9da4 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:57.859097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ed2db-a159-486c-8f2e-09d4e3fc9da4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:57.859636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ed2db-a159-486c-8f2e-09d4e3fc9da4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:57.862321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ed2db-a159-486c-8f2e-09d4e3fc9da4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:57.886623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 289/588] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:01:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:57.888239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ed2db-a159-486c-8f2e-09d4e3fc9da4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:57.953807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554d13c-dd9d-4f25-a38a-c12cea80e116 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:58.005770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218425d-c522-41a3-adef-5bef6058206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:58.006466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218425d-c522-41a3-adef-5bef6058206a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:58.006847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218425d-c522-41a3-adef-5bef6058206a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:58.007810 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218425d-c522-41a3-adef-5bef6058206a None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:58.008859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218425d-c522-41a3-adef-5bef6058206a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:58.009172 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218425d-c522-41a3-adef-5bef6058206a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:58.010925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218425d-c522-41a3-adef-5bef6058206a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:58.038181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 300/589] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jul 21 12:01:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:58.038181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218425d-c522-41a3-adef-5bef6058206a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:58.070142 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ed2db-a159-486c-8f2e-09d4e3fc9da4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:58.107528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:58.117925 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b40e75-f6fb-4aa0-ae7a-beef6fa231c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:58.118881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b40e75-f6fb-4aa0-ae7a-beef6fa231c2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:58.119300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b40e75-f6fb-4aa0-ae7a-beef6fa231c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:58.119707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b40e75-f6fb-4aa0-ae7a-beef6fa231c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:58.120962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b40e75-f6fb-4aa0-ae7a-beef6fa231c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:58.121423 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b40e75-f6fb-4aa0-ae7a-beef6fa231c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:58.123251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b40e75-f6fb-4aa0-ae7a-beef6fa231c2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:58.146610 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 290/590] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:58.146610 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b40e75-f6fb-4aa0-ae7a-beef6fa231c2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:58.176007 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218425d-c522-41a3-adef-5bef6058206a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:58.223809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:58.231543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e9bd5-468c-4ce3-af5f-b2542ba1dafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:58.232700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e9bd5-468c-4ce3-af5f-b2542ba1dafd None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:58.233005 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e9bd5-468c-4ce3-af5f-b2542ba1dafd None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:58.233513 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e9bd5-468c-4ce3-af5f-b2542ba1dafd None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:58.234668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e9bd5-468c-4ce3-af5f-b2542ba1dafd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:58.235034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e9bd5-468c-4ce3-af5f-b2542ba1dafd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:58.237650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e9bd5-468c-4ce3-af5f-b2542ba1dafd None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:58.266373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 301/591] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:58.266373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e9bd5-468c-4ce3-af5f-b2542ba1dafd None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:58.304993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b40e75-f6fb-4aa0-ae7a-beef6fa231c2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:58.351931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db614265-06d5-441a-810f-3d3064436339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:58.352862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614265-06d5-441a-810f-3d3064436339 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:58.353164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614265-06d5-441a-810f-3d3064436339 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:58.353440 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614265-06d5-441a-810f-3d3064436339 None admin] PATH_INFO: `/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/f3fb1d091b27472081549f4166ca172f/roles/8fc2e732d1b54ac193720d2652101798` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:58.373166 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db614265-06d5-441a-810f-3d3064436339 None admin] RBAC: Authorizing `identity:create_grant(project_id=0946df6ba381401e8e4958d11c63cb2b, user_id=f3fb1d091b27472081549f4166ca172f, role_id=8fc2e732d1b54ac193720d2652101798)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:58.375636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db614265-06d5-441a-810f-3d3064436339 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:58.399021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 291/592] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:01:58 2022] PUT /identity/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/f3fb1d091b27472081549f4166ca172f/roles/8fc2e732d1b54ac193720d2652101798 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:01:58.399984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db614265-06d5-441a-810f-3d3064436339 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:58.423808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e9bd5-468c-4ce3-af5f-b2542ba1dafd None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:58.444525 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:58.468654 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16167e27-6821-49e6-aa73-02b308571219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:58.469505 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16167e27-6821-49e6-aa73-02b308571219 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:58.469827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16167e27-6821-49e6-aa73-02b308571219 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:58.470069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16167e27-6821-49e6-aa73-02b308571219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:58.483560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16167e27-6821-49e6-aa73-02b308571219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:58.485079 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16167e27-6821-49e6-aa73-02b308571219 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-16167e27-6821-49e6-aa73-02b308571219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:58.504450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:58.506962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:58.508942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:58.508942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:58.508942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:58.508942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:58.508942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 302/593] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:58.508942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16167e27-6821-49e6-aa73-02b308571219 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:58.560428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:58.570324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db614265-06d5-441a-810f-3d3064436339 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:58.611247 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4085542-812f-4edf-a6b8-40fa5b9050c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:58.612370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4085542-812f-4edf-a6b8-40fa5b9050c9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:58.612655 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4085542-812f-4edf-a6b8-40fa5b9050c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:58.612929 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4085542-812f-4edf-a6b8-40fa5b9050c9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:58.630286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4085542-812f-4edf-a6b8-40fa5b9050c9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:58.633025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4085542-812f-4edf-a6b8-40fa5b9050c9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:58.656908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16167e27-6821-49e6-aa73-02b308571219 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-f4085542-812f-4edf-a6b8-40fa5b9050c9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:01:58.661779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:58.662831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:58.663779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:58.663779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:58.663779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:01:58.663779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:01:58.663779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:01:58.663779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:01:58.663779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:01:58.663779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:01:58.663779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 12:01:58.663779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:58.665155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 292/594] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:01:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:58.671997 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304698ca-a8b8-439f-9627-626ce6639894 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:58.671997 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304698ca-a8b8-439f-9627-626ce6639894 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:58.671997 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304698ca-a8b8-439f-9627-626ce6639894 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:58.671997 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 293/595] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:01:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:01:58.672602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304698ca-a8b8-439f-9627-626ce6639894 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:58.719896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526538e-7548-468e-91bf-7548dcc74e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:58.721733 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526538e-7548-468e-91bf-7548dcc74e38 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:58.722556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526538e-7548-468e-91bf-7548dcc74e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:58.723439 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526538e-7548-468e-91bf-7548dcc74e38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:58.736776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526538e-7548-468e-91bf-7548dcc74e38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:58.739593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526538e-7548-468e-91bf-7548dcc74e38 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-9526538e-7548-468e-91bf-7548dcc74e38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:01:58.775815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:58.776806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:58.777715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:01:58.777715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:01:58.777715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:01:58.777715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:01:58.777715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:01:58.777715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:01:58.777715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:58.777715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:58.779044 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 303/596] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:58.780029 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526538e-7548-468e-91bf-7548dcc74e38 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:58.819697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:58.859111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304698ca-a8b8-439f-9627-626ce6639894 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:58.930943 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05350b-5e09-4e83-9483-78ac4b02ea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:58.931870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05350b-5e09-4e83-9483-78ac4b02ea60 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:58.932303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05350b-5e09-4e83-9483-78ac4b02ea60 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:58.932700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05350b-5e09-4e83-9483-78ac4b02ea60 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:58.933967 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05350b-5e09-4e83-9483-78ac4b02ea60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:58.934356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05350b-5e09-4e83-9483-78ac4b02ea60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:58.936835 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05350b-5e09-4e83-9483-78ac4b02ea60 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:58.949784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526538e-7548-468e-91bf-7548dcc74e38 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:58.956667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 294/597] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:58.961256 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de991c-0215-459c-a04d-4b65c357eb51 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:58.962104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de991c-0215-459c-a04d-4b65c357eb51 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:58.962943 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de991c-0215-459c-a04d-4b65c357eb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:58.994434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-47de991c-0215-459c-a04d-4b65c357eb51 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:01:58.996822 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-47de991c-0215-459c-a04d-4b65c357eb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:01:58.998165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb10251-35dd-492f-b8e6-661ef2e8138d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:58.999034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb10251-35dd-492f-b8e6-661ef2e8138d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:58.999380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb10251-35dd-492f-b8e6-661ef2e8138d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:58.999713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb10251-35dd-492f-b8e6-661ef2e8138d None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:59.000653 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb10251-35dd-492f-b8e6-661ef2e8138d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:59.001034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb10251-35dd-492f-b8e6-661ef2e8138d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:59.002706 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb10251-35dd-492f-b8e6-661ef2e8138d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:59.017443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:59.030901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 304/598] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Jul 21 12:01:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:59.030901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb10251-35dd-492f-b8e6-661ef2e8138d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:59.113021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 295/599] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:01:59.114183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de991c-0215-459c-a04d-4b65c357eb51 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:59.159697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:59.181555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb10251-35dd-492f-b8e6-661ef2e8138d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:59.243945 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3797a5-95df-43a9-b674-783348aeecaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:59.245362 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3797a5-95df-43a9-b674-783348aeecaf None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:59.246019 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3797a5-95df-43a9-b674-783348aeecaf None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:59.246727 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3797a5-95df-43a9-b674-783348aeecaf None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:59.248656 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3797a5-95df-43a9-b674-783348aeecaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:59.250306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3797a5-95df-43a9-b674-783348aeecaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:59.253470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3797a5-95df-43a9-b674-783348aeecaf None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:59.280519 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 305/600] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:01:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:01:59.282816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3797a5-95df-43a9-b674-783348aeecaf None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:59.307753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de991c-0215-459c-a04d-4b65c357eb51 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:59.356643 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f65c9-0c97-4d8f-b5d5-f9c3a559e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:59.358246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f65c9-0c97-4d8f-b5d5-f9c3a559e615 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:59.358246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f65c9-0c97-4d8f-b5d5-f9c3a559e615 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:59.358246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f65c9-0c97-4d8f-b5d5-f9c3a559e615 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:59.366556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f65c9-0c97-4d8f-b5d5-f9c3a559e615 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:59.368442 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f65c9-0c97-4d8f-b5d5-f9c3a559e615 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-175f65c9-0c97-4d8f-b5d5-f9c3a559e615 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:01:59.395146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:59.396912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:59.398621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:01:59.398621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:01:59.398621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:01:59.398621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:01:59.398621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:01:59.398621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:01:59.398621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:01:59.398621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:59.398621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 296/601] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:01:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:59.400843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f65c9-0c97-4d8f-b5d5-f9c3a559e615 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:59.407635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:59.481103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3797a5-95df-43a9-b674-783348aeecaf None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:59.539902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea042d-c3bc-407e-984d-614f55523483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:59.541214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea042d-c3bc-407e-984d-614f55523483 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:59.541657 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea042d-c3bc-407e-984d-614f55523483 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:59.541941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea042d-c3bc-407e-984d-614f55523483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:59.561284 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea042d-c3bc-407e-984d-614f55523483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:59.563816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea042d-c3bc-407e-984d-614f55523483 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:59.572916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:59.585549 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f65c9-0c97-4d8f-b5d5-f9c3a559e615 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-5eea042d-c3bc-407e-984d-614f55523483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:01:59.593465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:59.594857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:59.595867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:01:59.595867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:01:59.595867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:01:59.595867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:01:59.604456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 306/602] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:59.604456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea042d-c3bc-407e-984d-614f55523483 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:59.651597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc8ac0-c640-4b6b-bc02-3d9e8f2ffd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:59.653034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc8ac0-c640-4b6b-bc02-3d9e8f2ffd59 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:59.653502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc8ac0-c640-4b6b-bc02-3d9e8f2ffd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:59.653979 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc8ac0-c640-4b6b-bc02-3d9e8f2ffd59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:59.674299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc8ac0-c640-4b6b-bc02-3d9e8f2ffd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-f5fc8ac0-c640-4b6b-bc02-3d9e8f2ffd59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:01:59.687367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:01:59.689180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:01:59.691544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:01:59.691544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:01:59.691544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:01:59.691544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:01:59.691544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:01:59.691544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:01:59.691544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:01:59.691544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:01:59.691544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:01:59.691544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:01:59.691544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:01:59.691544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:01:59.691544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 297/603] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:01:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:01:59.691544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc8ac0-c640-4b6b-bc02-3d9e8f2ffd59 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:59.781419 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea042d-c3bc-407e-984d-614f55523483 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:59.819861 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:01:59.828300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9818d55-f13e-4f77-bfb2-f680f70e6aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:59.829370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9818d55-f13e-4f77-bfb2-f680f70e6aab None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:59.829663 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9818d55-f13e-4f77-bfb2-f680f70e6aab None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:59.829936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9818d55-f13e-4f77-bfb2-f680f70e6aab None admin] PATH_INFO: `/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/10611bf25b9e4604ad769a6902f7f457/roles/8fc2e732d1b54ac193720d2652101798` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:59.847881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9818d55-f13e-4f77-bfb2-f680f70e6aab None admin] RBAC: Authorizing `identity:create_grant(project_id=0946df6ba381401e8e4958d11c63cb2b, user_id=10611bf25b9e4604ad769a6902f7f457, role_id=8fc2e732d1b54ac193720d2652101798)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:59.849370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9818d55-f13e-4f77-bfb2-f680f70e6aab None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:59.866877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 307/604] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:01:59 2022] PUT /identity/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/10611bf25b9e4604ad769a6902f7f457/roles/8fc2e732d1b54ac193720d2652101798 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:01:59.867775 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9818d55-f13e-4f77-bfb2-f680f70e6aab None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:01:59.900306 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc8ac0-c640-4b6b-bc02-3d9e8f2ffd59 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:01:59.961124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dc60e-1566-4215-9eff-55789f33b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:01:59.963065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dc60e-1566-4215-9eff-55789f33b551 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:01:59.963918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dc60e-1566-4215-9eff-55789f33b551 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:01:59.964701 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dc60e-1566-4215-9eff-55789f33b551 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:01:59.966573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dc60e-1566-4215-9eff-55789f33b551 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:01:59.967449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dc60e-1566-4215-9eff-55789f33b551 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:01:59.970573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dc60e-1566-4215-9eff-55789f33b551 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:01:59.977775 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:00.006917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 298/605] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:01:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:00.008964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dc60e-1566-4215-9eff-55789f33b551 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:00.077248 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9818d55-f13e-4f77-bfb2-f680f70e6aab None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:00.157218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b6c59-23dc-4738-bfe3-79efc96d107b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:00.159409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b6c59-23dc-4738-bfe3-79efc96d107b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:00.159949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b6c59-23dc-4738-bfe3-79efc96d107b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:00.160786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b6c59-23dc-4738-bfe3-79efc96d107b None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:00.163110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b6c59-23dc-4738-bfe3-79efc96d107b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:00.163544 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b6c59-23dc-4738-bfe3-79efc96d107b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:00.167406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b6c59-23dc-4738-bfe3-79efc96d107b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:00.168423 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dc60e-1566-4215-9eff-55789f33b551 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:00.193109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 308/606] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:00.194150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b6c59-23dc-4738-bfe3-79efc96d107b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:00.206397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:00.223978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24aad-456d-492b-9482-a382040a207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:00.225246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24aad-456d-492b-9482-a382040a207b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:00.225573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24aad-456d-492b-9482-a382040a207b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:00.226551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24aad-456d-492b-9482-a382040a207b None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:00.227552 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a24aad-456d-492b-9482-a382040a207b None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:00.228064 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a24aad-456d-492b-9482-a382040a207b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:00.229916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a24aad-456d-492b-9482-a382040a207b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:00.249529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 299/607] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:02:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:00.249860 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24aad-456d-492b-9482-a382040a207b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:00.357760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b6c59-23dc-4738-bfe3-79efc96d107b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:00.371259 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:00.397679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24aad-456d-492b-9482-a382040a207b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:00.406820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6da35-09e3-4f4d-aa10-633ad260b0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:00.407799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6da35-09e3-4f4d-aa10-633ad260b0e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:00.408086 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6da35-09e3-4f4d-aa10-633ad260b0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:00.408360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6da35-09e3-4f4d-aa10-633ad260b0e6 None admin] PATH_INFO: `/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/2af1aad6bd5c486192345b3747ed3e23/roles/8fc2e732d1b54ac193720d2652101798` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:00.427929 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6da35-09e3-4f4d-aa10-633ad260b0e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0946df6ba381401e8e4958d11c63cb2b, user_id=2af1aad6bd5c486192345b3747ed3e23, role_id=8fc2e732d1b54ac193720d2652101798)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:00.429407 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6da35-09e3-4f4d-aa10-633ad260b0e6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:00.453948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 309/608] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:02:00 2022] PUT /identity/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/2af1aad6bd5c486192345b3747ed3e23/roles/8fc2e732d1b54ac193720d2652101798 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:02:00.455231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6da35-09e3-4f4d-aa10-633ad260b0e6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:00.472991 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8aeed-32c6-4957-be74-e2f50ba94fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:00.475663 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8aeed-32c6-4957-be74-e2f50ba94fdc None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:00.476635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8aeed-32c6-4957-be74-e2f50ba94fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:00.477324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8aeed-32c6-4957-be74-e2f50ba94fdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:00.499644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8aeed-32c6-4957-be74-e2f50ba94fdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:00.501209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8aeed-32c6-4957-be74-e2f50ba94fdc None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-10a8aeed-32c6-4957-be74-e2f50ba94fdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:00.539808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:00.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:00.543468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:00.543468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:00.543468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:00.543468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:00.543468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:00.543468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:00.543468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:00.543468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:00.543468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 300/609] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:00.551821 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8aeed-32c6-4957-be74-e2f50ba94fdc None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:00.658364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6da35-09e3-4f4d-aa10-633ad260b0e6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:00.659062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:00.724336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0b597-8a55-451c-9bd7-428dbbeacfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:00.725228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b597-8a55-451c-9bd7-428dbbeacfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:00.725511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b597-8a55-451c-9bd7-428dbbeacfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:00.725789 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b597-8a55-451c-9bd7-428dbbeacfd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:00.740560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8aeed-32c6-4957-be74-e2f50ba94fdc None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:00.741846 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0b597-8a55-451c-9bd7-428dbbeacfd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:00.743387 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0b597-8a55-451c-9bd7-428dbbeacfd2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c8e0b597-8a55-451c-9bd7-428dbbeacfd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:00.771152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:00.772109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:00.772990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:00.772990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:00.772990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:00.772990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:00.774131 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 310/610] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:00.776334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cd1b1-4554-40e4-82f7-7e2bfe38b233 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:00.776820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cd1b1-4554-40e4-82f7-7e2bfe38b233 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:00.778088 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cd1b1-4554-40e4-82f7-7e2bfe38b233 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:00.781618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 311/611] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:00.783585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cd1b1-4554-40e4-82f7-7e2bfe38b233 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:00.803658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e92fe-cd25-4a4d-b13d-9729d2603cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:00.804778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e92fe-cd25-4a4d-b13d-9729d2603cca None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:00.805176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e92fe-cd25-4a4d-b13d-9729d2603cca None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:00.805608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e92fe-cd25-4a4d-b13d-9729d2603cca None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:00.807183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e92fe-cd25-4a4d-b13d-9729d2603cca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:00.807682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:00.807790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e92fe-cd25-4a4d-b13d-9729d2603cca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:00.810753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e92fe-cd25-4a4d-b13d-9729d2603cca None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:00.836390 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 301/612] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:00.846459 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d748b72-f8db-415a-b034-9f650dce87fe None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:00.846857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d748b72-f8db-415a-b034-9f650dce87fe None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:00.847364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d748b72-f8db-415a-b034-9f650dce87fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:00.875004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7d748b72-f8db-415a-b034-9f650dce87fe None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:00.876860 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7d748b72-f8db-415a-b034-9f650dce87fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:00.946774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cd1b1-4554-40e4-82f7-7e2bfe38b233 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:00.992670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 302/613] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:02:00.994166 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d748b72-f8db-415a-b034-9f650dce87fe None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:01.032859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779c696-b7dc-4633-92d6-a2a6dd5e0a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:01.033980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779c696-b7dc-4633-92d6-a2a6dd5e0a0c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:01.034738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779c696-b7dc-4633-92d6-a2a6dd5e0a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:01.035207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779c696-b7dc-4633-92d6-a2a6dd5e0a0c None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:01.036526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779c696-b7dc-4633-92d6-a2a6dd5e0a0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:01.037045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779c696-b7dc-4633-92d6-a2a6dd5e0a0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:01.039663 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779c696-b7dc-4633-92d6-a2a6dd5e0a0c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:01.058200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:01.076345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 312/614] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:01.083046 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779c696-b7dc-4633-92d6-a2a6dd5e0a0c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:01.150855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d748b72-f8db-415a-b034-9f650dce87fe None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:01.161614 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:01.187995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e29d8-b1aa-4ddb-a320-c60a45175d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:01.188912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e29d8-b1aa-4ddb-a320-c60a45175d2a None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:01.189193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e29d8-b1aa-4ddb-a320-c60a45175d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:01.189467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e29d8-b1aa-4ddb-a320-c60a45175d2a None admin] PATH_INFO: `/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/88cfd88c19fd4c979e921e3d8cd9cc3c/roles/8fc2e732d1b54ac193720d2652101798` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:01.198370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779c696-b7dc-4633-92d6-a2a6dd5e0a0c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:01.207571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e29d8-b1aa-4ddb-a320-c60a45175d2a None admin] RBAC: Authorizing `identity:create_grant(project_id=0946df6ba381401e8e4958d11c63cb2b, user_id=88cfd88c19fd4c979e921e3d8cd9cc3c, role_id=8fc2e732d1b54ac193720d2652101798)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:01.208665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e29d8-b1aa-4ddb-a320-c60a45175d2a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:01.230763 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 303/615] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:02:00 2022] PUT /identity/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/88cfd88c19fd4c979e921e3d8cd9cc3c/roles/8fc2e732d1b54ac193720d2652101798 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:02:01.232138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e29d8-b1aa-4ddb-a320-c60a45175d2a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:01.272340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e543c-5854-4202-8124-81a1dce4fa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:01.273180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e543c-5854-4202-8124-81a1dce4fa4f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:01.273467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e543c-5854-4202-8124-81a1dce4fa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:01.273747 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e543c-5854-4202-8124-81a1dce4fa4f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:01.289115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e543c-5854-4202-8124-81a1dce4fa4f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:01.290849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e543c-5854-4202-8124-81a1dce4fa4f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-847e543c-5854-4202-8124-81a1dce4fa4f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:01.342973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:01.344210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:01.345325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:01.345325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:01.345325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:01.345325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:01.345325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:01.345325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:01.345325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:01.345325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:01.345325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 12:02:01.345325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:01.345325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 313/616] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:02:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:01.362968 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e543c-5854-4202-8124-81a1dce4fa4f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:01.461942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:01.489593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e29d8-b1aa-4ddb-a320-c60a45175d2a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:01.534918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e543c-5854-4202-8124-81a1dce4fa4f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:01.555716 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda5d26-7dc0-4d3e-b453-602dbf10dc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:01.557258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda5d26-7dc0-4d3e-b453-602dbf10dc84 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:01.557904 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda5d26-7dc0-4d3e-b453-602dbf10dc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:01.558403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda5d26-7dc0-4d3e-b453-602dbf10dc84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:01.569289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:01.576295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70315c-924d-4a21-9cff-912a706b4fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:01.578057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70315c-924d-4a21-9cff-912a706b4fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:01.578057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70315c-924d-4a21-9cff-912a706b4fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:01.578365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70315c-924d-4a21-9cff-912a706b4fe3 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:01.579153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70315c-924d-4a21-9cff-912a706b4fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:01.579748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70315c-924d-4a21-9cff-912a706b4fe3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:01.581669 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70315c-924d-4a21-9cff-912a706b4fe3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:01.585216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda5d26-7dc0-4d3e-b453-602dbf10dc84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ddda5d26-7dc0-4d3e-b453-602dbf10dc84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:01.600507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:01.602564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:01.604537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:01.604537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:01.604537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:01.604537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:01.604537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:01.604537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:01.604537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:01.604537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:01.604537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:01.604537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:01.604537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:01.604537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:01.608869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 304/617] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:02:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:01.618216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda5d26-7dc0-4d3e-b453-602dbf10dc84 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:01.637613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 314/618] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jul 21 12:02:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:01.649447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70315c-924d-4a21-9cff-912a706b4fe3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:01.812793 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda5d26-7dc0-4d3e-b453-602dbf10dc84 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:01.850840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70315c-924d-4a21-9cff-912a706b4fe3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:01.875301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a282b9f-a631-4610-a269-65f92c8d1401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:01.875996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a282b9f-a631-4610-a269-65f92c8d1401 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:01.876278 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a282b9f-a631-4610-a269-65f92c8d1401 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:01.876571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a282b9f-a631-4610-a269-65f92c8d1401 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:01.877336 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a282b9f-a631-4610-a269-65f92c8d1401 None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:01.877755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a282b9f-a631-4610-a269-65f92c8d1401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:01.879236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a282b9f-a631-4610-a269-65f92c8d1401 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:01.901427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 305/619] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:02:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:01.907025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a282b9f-a631-4610-a269-65f92c8d1401 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:01.927345 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:01.928912 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6751baf-2987-4ff4-b978-692750468632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:01.929743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6751baf-2987-4ff4-b978-692750468632 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:01.930027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6751baf-2987-4ff4-b978-692750468632 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:01.930304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6751baf-2987-4ff4-b978-692750468632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:01.955070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6751baf-2987-4ff4-b978-692750468632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:01.957695 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6751baf-2987-4ff4-b978-692750468632 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c6751baf-2987-4ff4-b978-692750468632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:01.997542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:01.999073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:02.000224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:02.000224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:02.000224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:02.000224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:02.001355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 315/620] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:02.003771 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6751baf-2987-4ff4-b978-692750468632 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:02.056564 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:02.115421 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6751baf-2987-4ff4-b978-692750468632 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:02.154954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6298cf7-ed07-40d0-8646-e504d310b544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:02.155688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6298cf7-ed07-40d0-8646-e504d310b544 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:02.156045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6298cf7-ed07-40d0-8646-e504d310b544 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:02.156395 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6298cf7-ed07-40d0-8646-e504d310b544 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:02.157219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6298cf7-ed07-40d0-8646-e504d310b544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:02.157628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6298cf7-ed07-40d0-8646-e504d310b544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:02.159398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6298cf7-ed07-40d0-8646-e504d310b544 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:02.166710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a282b9f-a631-4610-a269-65f92c8d1401 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:02.177407 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 316/621] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:02.178781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6298cf7-ed07-40d0-8646-e504d310b544 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:02.285667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46a3f8-fc58-472e-a151-0583448de7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:02.286484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a3f8-fc58-472e-a151-0583448de7fd None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:02.286806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a3f8-fc58-472e-a151-0583448de7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:02.287082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a3f8-fc58-472e-a151-0583448de7fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:02.301225 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:02.304124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46a3f8-fc58-472e-a151-0583448de7fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:02.304744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6298cf7-ed07-40d0-8646-e504d310b544 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:02.307499 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46a3f8-fc58-472e-a151-0583448de7fd None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:02.343866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c83ac-99a4-47fc-a388-0888475bd225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:02.344677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c83ac-99a4-47fc-a388-0888475bd225 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:02.344960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c83ac-99a4-47fc-a388-0888475bd225 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:02.345233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c83ac-99a4-47fc-a388-0888475bd225 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-6f46a3f8-fc58-472e-a151-0583448de7fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:02.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:02.346426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:02.347337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:02.347337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:02.347337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:02.347337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:02.350851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 306/622] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:02.352562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45803ebb-5b82-458d-be59-f6ba7070f25a None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:02.352925 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45803ebb-5b82-458d-be59-f6ba7070f25a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:02.353234 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45803ebb-5b82-458d-be59-f6ba7070f25a None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:02.355158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 307/623] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:02.360579 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45803ebb-5b82-458d-be59-f6ba7070f25a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:02.362402 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c83ac-99a4-47fc-a388-0888475bd225 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:02.364302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c83ac-99a4-47fc-a388-0888475bd225 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f69c83ac-99a4-47fc-a388-0888475bd225 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:02.392514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:02.393451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:02.394318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:02.394318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:02.394318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:02.394318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:02.394318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:02.394318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:02.394318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:02.394318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:02.396906 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 317/624] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:02.398410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc946768-ad01-4b2a-84e4-b54de36f9009 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:02.398933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc946768-ad01-4b2a-84e4-b54de36f9009 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:02.399398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc946768-ad01-4b2a-84e4-b54de36f9009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:02.418925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-bc946768-ad01-4b2a-84e4-b54de36f9009 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:02.420627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bc946768-ad01-4b2a-84e4-b54de36f9009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:02.435138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:02.480789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45803ebb-5b82-458d-be59-f6ba7070f25a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:02.515250 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 318/625] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:02:02.516650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc946768-ad01-4b2a-84e4-b54de36f9009 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:02.520614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b5d3a-d342-49f3-83ae-92268b86cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:02.520835 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b5d3a-d342-49f3-83ae-92268b86cd78 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:02.521107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b5d3a-d342-49f3-83ae-92268b86cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:02.521373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b5d3a-d342-49f3-83ae-92268b86cd78 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:02.522131 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b5d3a-d342-49f3-83ae-92268b86cd78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:02.522461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b5d3a-d342-49f3-83ae-92268b86cd78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:02.524767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b5d3a-d342-49f3-83ae-92268b86cd78 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:02.541884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 308/626] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:02.543476 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b5d3a-d342-49f3-83ae-92268b86cd78 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:02.656603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b5d3a-d342-49f3-83ae-92268b86cd78 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:02.657892 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc946768-ad01-4b2a-84e4-b54de36f9009 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:02.675141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:02.678786 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:02.695074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc2418-605a-4b63-8a95-ba379632c863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:02.695899 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc2418-605a-4b63-8a95-ba379632c863 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:02.696193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc2418-605a-4b63-8a95-ba379632c863 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:02.696473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc2418-605a-4b63-8a95-ba379632c863 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:02.703140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb3f3e-ec9a-4cbb-8968-40a3d970dc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:02.704216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb3f3e-ec9a-4cbb-8968-40a3d970dc21 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:02.704722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb3f3e-ec9a-4cbb-8968-40a3d970dc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:02.705188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb3f3e-ec9a-4cbb-8968-40a3d970dc21 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:02.705664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc2418-605a-4b63-8a95-ba379632c863 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:02.706409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb3f3e-ec9a-4cbb-8968-40a3d970dc21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:02.706976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb3f3e-ec9a-4cbb-8968-40a3d970dc21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:02.707180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc2418-605a-4b63-8a95-ba379632c863 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:02.708823 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb3f3e-ec9a-4cbb-8968-40a3d970dc21 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-1abc2418-605a-4b63-8a95-ba379632c863 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:02.722584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:02.723642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:02.724565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:02.724565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:02.724565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:02.724565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:02.724565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:02.724565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:02.724565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:02.724565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:02.724565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:02:02.724565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:02.725967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 319/627] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:02.727278 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb3f3e-ec9a-4cbb-8968-40a3d970dc21 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:02.730718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 309/628] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jul 21 12:02:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:02.735159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc2418-605a-4b63-8a95-ba379632c863 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:02.844419 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb3f3e-ec9a-4cbb-8968-40a3d970dc21 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:02.845233 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc2418-605a-4b63-8a95-ba379632c863 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:02.882691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4b7a2-a1df-432f-87ba-582cfb3540cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:02.883230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd397e0a-5b8d-4ca8-9708-a7faf2b454dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:02.883462 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4b7a2-a1df-432f-87ba-582cfb3540cf None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:02.883679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4b7a2-a1df-432f-87ba-582cfb3540cf None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:02.883960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4b7a2-a1df-432f-87ba-582cfb3540cf None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:02.884832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4b7a2-a1df-432f-87ba-582cfb3540cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:02.885044 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd397e0a-5b8d-4ca8-9708-a7faf2b454dc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:02.885142 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4b7a2-a1df-432f-87ba-582cfb3540cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:02.885592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd397e0a-5b8d-4ca8-9708-a7faf2b454dc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:02.886050 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd397e0a-5b8d-4ca8-9708-a7faf2b454dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:02.886618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4b7a2-a1df-432f-87ba-582cfb3540cf None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:02.899058 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd397e0a-5b8d-4ca8-9708-a7faf2b454dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-cd397e0a-5b8d-4ca8-9708-a7faf2b454dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:02.907672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:02.908652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:02.909477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:02.909477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:02.909477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:02.909477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:02.909477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:02.909477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:02.909477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:02.909477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:02.909477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:02.909477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:02.909477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:02.909477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:02.911060 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 310/629] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jul 21 12:02:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:02.912040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4b7a2-a1df-432f-87ba-582cfb3540cf None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:02.912740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 320/630] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:02:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:02.918944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd397e0a-5b8d-4ca8-9708-a7faf2b454dc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:02.935060 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:02.959087 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:03.044409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd397e0a-5b8d-4ca8-9708-a7faf2b454dc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:03.046615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4b7a2-a1df-432f-87ba-582cfb3540cf None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:03.084275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1024f-f10f-4e4d-a888-d120d1d4104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:03.085397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1024f-f10f-4e4d-a888-d120d1d4104c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:03.085884 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1024f-f10f-4e4d-a888-d120d1d4104c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:03.086349 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1024f-f10f-4e4d-a888-d120d1d4104c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:03.087087 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be016e49-391b-4e4e-a26a-6d7a965ad688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:03.088085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be016e49-391b-4e4e-a26a-6d7a965ad688 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:03.088370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be016e49-391b-4e4e-a26a-6d7a965ad688 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:03.088649 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be016e49-391b-4e4e-a26a-6d7a965ad688 None admin] PATH_INFO: `/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/2dd659c33e0f49dc8edf30bd47737e70/roles/8fc2e732d1b54ac193720d2652101798` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:03.105172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be016e49-391b-4e4e-a26a-6d7a965ad688 None admin] RBAC: Authorizing `identity:create_grant(project_id=0946df6ba381401e8e4958d11c63cb2b, user_id=2dd659c33e0f49dc8edf30bd47737e70, role_id=8fc2e732d1b54ac193720d2652101798)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:03.106633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be016e49-391b-4e4e-a26a-6d7a965ad688 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:03.126860 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 311/631] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:02:02 2022] PUT /identity/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/2dd659c33e0f49dc8edf30bd47737e70/roles/8fc2e732d1b54ac193720d2652101798 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:02:03.127890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be016e49-391b-4e4e-a26a-6d7a965ad688 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:03.173900 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1024f-f10f-4e4d-a888-d120d1d4104c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:03.175858 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1024f-f10f-4e4d-a888-d120d1d4104c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:03.190036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:03.302640 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 321/632] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:02:03.309172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:03.312526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1024f-f10f-4e4d-a888-d120d1d4104c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:03.343382 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be016e49-391b-4e4e-a26a-6d7a965ad688 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:03.420196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5146ed-1b62-44d9-b578-03e3d224b5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:03.427045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5146ed-1b62-44d9-b578-03e3d224b5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:03.427045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5146ed-1b62-44d9-b578-03e3d224b5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:03.427045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5146ed-1b62-44d9-b578-03e3d224b5d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:03.427045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5146ed-1b62-44d9-b578-03e3d224b5d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:03.427045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5146ed-1b62-44d9-b578-03e3d224b5d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:03.427045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5146ed-1b62-44d9-b578-03e3d224b5d3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:03.442766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 312/633] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:02:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:03.451867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5146ed-1b62-44d9-b578-03e3d224b5d3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:03.508297 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1024f-f10f-4e4d-a888-d120d1d4104c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:03.523078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:03.581680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00c348-ef18-4ffb-82b5-73a2baee3102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:03.584302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00c348-ef18-4ffb-82b5-73a2baee3102 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:03.584621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00c348-ef18-4ffb-82b5-73a2baee3102 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:03.584874 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00c348-ef18-4ffb-82b5-73a2baee3102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:03.598447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5146ed-1b62-44d9-b578-03e3d224b5d3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:03.609273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00c348-ef18-4ffb-82b5-73a2baee3102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:03.613948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00c348-ef18-4ffb-82b5-73a2baee3102 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:03.643336 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c567589-f7bd-4bda-a528-35df574c0e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:03.644179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567589-f7bd-4bda-a528-35df574c0e53 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:03.644468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567589-f7bd-4bda-a528-35df574c0e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:03.644750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567589-f7bd-4bda-a528-35df574c0e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:03.658771 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c567589-f7bd-4bda-a528-35df574c0e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:03.660270 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c567589-f7bd-4bda-a528-35df574c0e53 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-0b00c348-ef18-4ffb-82b5-73a2baee3102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:03.662681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:03.663966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:03.665693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:03.665693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:03.665693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:03.665693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:03.668109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 322/634] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:03.675006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6bcc4-2a82-4471-ac7a-41b02faf763e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:03.675006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6bcc4-2a82-4471-ac7a-41b02faf763e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:03.675006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6bcc4-2a82-4471-ac7a-41b02faf763e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:03.679225 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 323/635] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:03.683035 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f04310-eef9-4d70-b1fc-d7a48b52cf91 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:03.684391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f04310-eef9-4d70-b1fc-d7a48b52cf91 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:03.684391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f04310-eef9-4d70-b1fc-d7a48b52cf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-5c567589-f7bd-4bda-a528-35df574c0e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:03.697046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:03.698833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:03.701963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:03.701963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:03.701963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:03.701963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:03.701963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 313/636] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:03.701963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c567589-f7bd-4bda-a528-35df574c0e53 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:03.703352 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:03.722355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-e3f04310-eef9-4d70-b1fc-d7a48b52cf91 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:03.724983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e3f04310-eef9-4d70-b1fc-d7a48b52cf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:03.841264 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c567589-f7bd-4bda-a528-35df574c0e53 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:03.851197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 324/637] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:02:03.852347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f04310-eef9-4d70-b1fc-d7a48b52cf91 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:03.888568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccd78e-b7eb-4253-ac88-409e13a2db0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:03.890070 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccd78e-b7eb-4253-ac88-409e13a2db0c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:03.890535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccd78e-b7eb-4253-ac88-409e13a2db0c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:03.890984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccd78e-b7eb-4253-ac88-409e13a2db0c None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:03.891880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccd78e-b7eb-4253-ac88-409e13a2db0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:03.892340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccd78e-b7eb-4253-ac88-409e13a2db0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:03.894022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccd78e-b7eb-4253-ac88-409e13a2db0c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:03.907702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 314/638] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:03.914644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a756c2-2d64-4069-8e5c-c80fa2b9ba4a None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:03.914644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a756c2-2d64-4069-8e5c-c80fa2b9ba4a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:03.914644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a756c2-2d64-4069-8e5c-c80fa2b9ba4a None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:03.915207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 315/639] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:03.916254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a756c2-2d64-4069-8e5c-c80fa2b9ba4a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:03.963103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:03.975113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f04310-eef9-4d70-b1fc-d7a48b52cf91 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:03.999189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:04.017501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d74da-af43-40d1-9fcb-bd43ba4efc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:04.018213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d74da-af43-40d1-9fcb-bd43ba4efc83 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:04.018520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d74da-af43-40d1-9fcb-bd43ba4efc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:04.018816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d74da-af43-40d1-9fcb-bd43ba4efc83 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:04.019522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d74da-af43-40d1-9fcb-bd43ba4efc83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:04.019824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d74da-af43-40d1-9fcb-bd43ba4efc83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:04.021226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d74da-af43-40d1-9fcb-bd43ba4efc83 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:04.035679 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 325/640] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:04.037029 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c3ee5-6ef7-42e0-ad91-468b76d8d079 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:04.037314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c3ee5-6ef7-42e0-ad91-468b76d8d079 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:04.037592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c3ee5-6ef7-42e0-ad91-468b76d8d079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:04.056593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-482c3ee5-6ef7-42e0-ad91-468b76d8d079 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:04.057796 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-482c3ee5-6ef7-42e0-ad91-468b76d8d079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:04.088047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a756c2-2d64-4069-8e5c-c80fa2b9ba4a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:04.130684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa49da7-c9a7-4cb7-8b7b-05c80033d280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:04.131935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa49da7-c9a7-4cb7-8b7b-05c80033d280 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:04.132420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa49da7-c9a7-4cb7-8b7b-05c80033d280 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:04.132906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa49da7-c9a7-4cb7-8b7b-05c80033d280 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:04.145900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa49da7-c9a7-4cb7-8b7b-05c80033d280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-6aa49da7-c9a7-4cb7-8b7b-05c80033d280 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:04.154311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:04.155488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:04.156414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:04.156414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:04.156414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:04.156414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:04.156414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:04.156414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:04.156414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:04.156414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:04.156414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:04.156414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:04.156414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:04.156414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:04.158511 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 316/641] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:02:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:04.159522 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa49da7-c9a7-4cb7-8b7b-05c80033d280 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:04.186109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 326/642] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:02:04.187644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c3ee5-6ef7-42e0-ad91-468b76d8d079 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:04.306535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa49da7-c9a7-4cb7-8b7b-05c80033d280 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:04.316734 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:04.338932 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c3ee5-6ef7-42e0-ad91-468b76d8d079 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:04.355225 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:04.379144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48786923-8cf7-40e1-999c-80ecc307d825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:04.379958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48786923-8cf7-40e1-999c-80ecc307d825 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:04.380238 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48786923-8cf7-40e1-999c-80ecc307d825 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:04.380514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48786923-8cf7-40e1-999c-80ecc307d825 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:04.380790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b522c-9818-4b29-bb08-4129053be269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:04.382106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b522c-9818-4b29-bb08-4129053be269 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:04.382892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b522c-9818-4b29-bb08-4129053be269 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:04.383374 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b522c-9818-4b29-bb08-4129053be269 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:04.388880 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48786923-8cf7-40e1-999c-80ecc307d825 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:04.390505 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48786923-8cf7-40e1-999c-80ecc307d825 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:04.399219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b522c-9818-4b29-bb08-4129053be269 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:04.402084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b522c-9818-4b29-bb08-4129053be269 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-48786923-8cf7-40e1-999c-80ecc307d825 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:04.406178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:04.407935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:04.409802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:04.409802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:04.409802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:04.409802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:04.409802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:04.409802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:04.409802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:04.409802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:04.409802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 12:02:04.409802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:04.409802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 327/643] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:02:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:04.409802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48786923-8cf7-40e1-999c-80ecc307d825 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-013b522c-9818-4b29-bb08-4129053be269 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:04.425165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:04.427197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:04.429118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:04.429118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:04.429118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:04.429118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:04.429118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:04.429118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:04.429118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:04.429118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:04.429118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 317/644] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:04.429118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b522c-9818-4b29-bb08-4129053be269 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:04.595592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48786923-8cf7-40e1-999c-80ecc307d825 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:04.611427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b522c-9818-4b29-bb08-4129053be269 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:04.639024 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44938838-e4cf-4e11-b649-ecdef8a6df42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:04.640060 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44938838-e4cf-4e11-b649-ecdef8a6df42 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:04.640481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44938838-e4cf-4e11-b649-ecdef8a6df42 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:04.641072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44938838-e4cf-4e11-b649-ecdef8a6df42 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:04.641914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44938838-e4cf-4e11-b649-ecdef8a6df42 None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:04.642336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44938838-e4cf-4e11-b649-ecdef8a6df42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:04.644185 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44938838-e4cf-4e11-b649-ecdef8a6df42 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:04.659190 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 328/645] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:02:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:04.659190 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44938838-e4cf-4e11-b649-ecdef8a6df42 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:04.666613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:04.680426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123bca0-3d8c-4b1a-a14e-ecb0346dfe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:04.682282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123bca0-3d8c-4b1a-a14e-ecb0346dfe83 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:04.682831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123bca0-3d8c-4b1a-a14e-ecb0346dfe83 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:04.683410 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123bca0-3d8c-4b1a-a14e-ecb0346dfe83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:04.703289 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123bca0-3d8c-4b1a-a14e-ecb0346dfe83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-3123bca0-3d8c-4b1a-a14e-ecb0346dfe83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:04.718913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:04.719911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:04.720739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:04.720739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:04.720739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:04.720739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:04.720739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:04.720739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:04.720739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:04.720739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:04.720739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:04.720739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:04.720739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:04.720739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:04.721849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 318/646] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:02:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:04.722405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123bca0-3d8c-4b1a-a14e-ecb0346dfe83 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:04.799250 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:04.816069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44938838-e4cf-4e11-b649-ecdef8a6df42 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:04.868414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123bca0-3d8c-4b1a-a14e-ecb0346dfe83 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:04.879989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8cfa7-2e45-4955-86e6-f25a76b2b695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:04.881178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8cfa7-2e45-4955-86e6-f25a76b2b695 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:04.881674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8cfa7-2e45-4955-86e6-f25a76b2b695 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:04.882168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8cfa7-2e45-4955-86e6-f25a76b2b695 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:04.883845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8cfa7-2e45-4955-86e6-f25a76b2b695 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:04.884409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8cfa7-2e45-4955-86e6-f25a76b2b695 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:04.887070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8cfa7-2e45-4955-86e6-f25a76b2b695 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:04.911260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb287ec6-48e2-4cdf-b3fd-f31ccb5c5d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:04.912292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb287ec6-48e2-4cdf-b3fd-f31ccb5c5d26 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:04.912704 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb287ec6-48e2-4cdf-b3fd-f31ccb5c5d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:04.913100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb287ec6-48e2-4cdf-b3fd-f31ccb5c5d26 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:04.914120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb287ec6-48e2-4cdf-b3fd-f31ccb5c5d26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:04.914626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb287ec6-48e2-4cdf-b3fd-f31ccb5c5d26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:04.916532 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb287ec6-48e2-4cdf-b3fd-f31ccb5c5d26 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:04.928411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 329/647] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jul 21 12:02:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:04.928411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8cfa7-2e45-4955-86e6-f25a76b2b695 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:04.937301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 319/648] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:04.938257 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb287ec6-48e2-4cdf-b3fd-f31ccb5c5d26 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:05.034814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:05.086853 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb287ec6-48e2-4cdf-b3fd-f31ccb5c5d26 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:05.089304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:05.100495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8cfa7-2e45-4955-86e6-f25a76b2b695 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:05.140447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe67f-fadf-456c-ba9a-5569220aa936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:05.141153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe67f-fadf-456c-ba9a-5569220aa936 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:05.141431 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe67f-fadf-456c-ba9a-5569220aa936 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:05.141708 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe67f-fadf-456c-ba9a-5569220aa936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:05.144086 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd5e93-2a69-409e-8e9b-f48e980639ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:05.144772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd5e93-2a69-409e-8e9b-f48e980639ac None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:05.145051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd5e93-2a69-409e-8e9b-f48e980639ac None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:05.145328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd5e93-2a69-409e-8e9b-f48e980639ac None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:05.146099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd5e93-2a69-409e-8e9b-f48e980639ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:05.146400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd5e93-2a69-409e-8e9b-f48e980639ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:05.147816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd5e93-2a69-409e-8e9b-f48e980639ac None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:05.154286 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbe67f-fadf-456c-ba9a-5569220aa936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:05.155897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbe67f-fadf-456c-ba9a-5569220aa936 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:05.166961 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 320/649] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:02:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:05.166961 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd5e93-2a69-409e-8e9b-f48e980639ac None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-85cbe67f-fadf-456c-ba9a-5569220aa936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:05.183704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:05.184774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:05.185820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:05.185820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:05.185820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:05.185820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:05.186147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 330/650] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:05.187418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe67f-fadf-456c-ba9a-5569220aa936 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:05.290141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd5e93-2a69-409e-8e9b-f48e980639ac None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:05.334632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194ad09-ea96-4129-99ca-fed6cf9ac956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:05.335164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194ad09-ea96-4129-99ca-fed6cf9ac956 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:05.335451 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194ad09-ea96-4129-99ca-fed6cf9ac956 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:05.335734 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194ad09-ea96-4129-99ca-fed6cf9ac956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:05.366386 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe67f-fadf-456c-ba9a-5569220aa936 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:05.384236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:05.392419 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:05.431432 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a0267-9617-40c7-bae0-fafead93ac7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:05.432457 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0267-9617-40c7-bae0-fafead93ac7a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:05.432895 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0267-9617-40c7-bae0-fafead93ac7a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:05.433296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0267-9617-40c7-bae0-fafead93ac7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:05.434808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a0267-9617-40c7-bae0-fafead93ac7a None admin] RBAC: Adding query filter params (role.id=8fc2e732d1b54ac193720d2652101798, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=f3fb1d091b27472081549f4166ca172f) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:05.435178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a0267-9617-40c7-bae0-fafead93ac7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:05.437769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a0267-9617-40c7-bae0-fafead93ac7a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:05.445632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194ad09-ea96-4129-99ca-fed6cf9ac956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:05.447207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194ad09-ea96-4129-99ca-fed6cf9ac956 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:05.451038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 331/651] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:02:05 2022] GET /identity/v3/role_assignments?user.id=f3fb1d091b27472081549f4166ca172f&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=8fc2e732d1b54ac193720d2652101798 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:05.452136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a0267-9617-40c7-bae0-fafead93ac7a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:05.595227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a0267-9617-40c7-bae0-fafead93ac7a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:05.600796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 321/652] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:02:05.600796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194ad09-ea96-4129-99ca-fed6cf9ac956 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:05.651840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18998396-6e87-40c5-b1b8-b065975a5b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:05.652598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18998396-6e87-40c5-b1b8-b065975a5b68 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:05.652889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18998396-6e87-40c5-b1b8-b065975a5b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:05.653166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18998396-6e87-40c5-b1b8-b065975a5b68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:05.665697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18998396-6e87-40c5-b1b8-b065975a5b68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:05.667291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18998396-6e87-40c5-b1b8-b065975a5b68 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:05.676246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-18998396-6e87-40c5-b1b8-b065975a5b68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:05.688957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:05.690634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:05.692618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:05.692618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:05.692618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:05.692618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:05.692618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 332/653] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:05.692618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262c9ce-b32b-4a62-801e-6adfaa48a61f None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:05.692618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262c9ce-b32b-4a62-801e-6adfaa48a61f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:05.692618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262c9ce-b32b-4a62-801e-6adfaa48a61f None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:05.697322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 333/654] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:05.698395 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262c9ce-b32b-4a62-801e-6adfaa48a61f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:05.749119 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194ad09-ea96-4129-99ca-fed6cf9ac956 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:05.751267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:05.806807 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bc988-b1c8-4c70-bfcb-de9aa64a11b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:05.807936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bc988-b1c8-4c70-bfcb-de9aa64a11b2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:05.808385 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bc988-b1c8-4c70-bfcb-de9aa64a11b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:05.808872 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bc988-b1c8-4c70-bfcb-de9aa64a11b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:05.810271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bc988-b1c8-4c70-bfcb-de9aa64a11b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:05.810893 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bc988-b1c8-4c70-bfcb-de9aa64a11b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:05.813480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bc988-b1c8-4c70-bfcb-de9aa64a11b2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:05.837556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 322/655] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:05.839116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede069f-efa5-414d-8230-a6bbe0286236 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:05.839406 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede069f-efa5-414d-8230-a6bbe0286236 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:05.839682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede069f-efa5-414d-8230-a6bbe0286236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:05.868548 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fede069f-efa5-414d-8230-a6bbe0286236 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:05.870593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fede069f-efa5-414d-8230-a6bbe0286236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:05.887706 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262c9ce-b32b-4a62-801e-6adfaa48a61f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:05.930182 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf9775-bdec-4df7-affa-f6f2105cd391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:05.931031 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf9775-bdec-4df7-affa-f6f2105cd391 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:05.931316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf9775-bdec-4df7-affa-f6f2105cd391 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:05.931577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf9775-bdec-4df7-affa-f6f2105cd391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:05.944637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf9775-bdec-4df7-affa-f6f2105cd391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:05.946164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf9775-bdec-4df7-affa-f6f2105cd391 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-bddf9775-bdec-4df7-affa-f6f2105cd391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:05.968821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:05.969802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:05.970766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:05.970766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:05.970766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:05.970766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:05.971577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 334/656] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:05.972466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf9775-bdec-4df7-affa-f6f2105cd391 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:06.000102 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 323/657] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:02:06.000102 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede069f-efa5-414d-8230-a6bbe0286236 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:06.089330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:06.115712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:06.140560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede069f-efa5-414d-8230-a6bbe0286236 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:06.161518 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf9775-bdec-4df7-affa-f6f2105cd391 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:06.183518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd8e79-5f34-4943-9b0c-e5a2bed783b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:06.184522 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd8e79-5f34-4943-9b0c-e5a2bed783b2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:06.184522 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd8e79-5f34-4943-9b0c-e5a2bed783b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:06.184769 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd8e79-5f34-4943-9b0c-e5a2bed783b2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:06.193107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd8e79-5f34-4943-9b0c-e5a2bed783b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:06.194570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd8e79-5f34-4943-9b0c-e5a2bed783b2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-dddd8e79-5f34-4943-9b0c-e5a2bed783b2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:06.212403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:06.213594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:06.214765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:06.214765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:06.214765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:06.214765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:06.214765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:06.214765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:06.214765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:06.214765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:06.214765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 12:02:06.214765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:06.214765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 324/658] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:02:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:06.214765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd8e79-5f34-4943-9b0c-e5a2bed783b2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:06.219517 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf4ea4-9ae5-4b71-8017-7a7b67c9ba87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:06.220510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf4ea4-9ae5-4b71-8017-7a7b67c9ba87 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:06.220810 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf4ea4-9ae5-4b71-8017-7a7b67c9ba87 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:06.221086 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf4ea4-9ae5-4b71-8017-7a7b67c9ba87 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:06.222218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf4ea4-9ae5-4b71-8017-7a7b67c9ba87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:06.222699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf4ea4-9ae5-4b71-8017-7a7b67c9ba87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:06.224377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf4ea4-9ae5-4b71-8017-7a7b67c9ba87 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:06.242066 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 335/659] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:06.243224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf4ea4-9ae5-4b71-8017-7a7b67c9ba87 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:06.370372 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf4ea4-9ae5-4b71-8017-7a7b67c9ba87 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:06.385075 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd8e79-5f34-4943-9b0c-e5a2bed783b2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:06.406028 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:06.413077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b34cf7-8414-40df-be84-76f66590770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:06.414121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b34cf7-8414-40df-be84-76f66590770c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:06.414599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b34cf7-8414-40df-be84-76f66590770c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:06.414931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b34cf7-8414-40df-be84-76f66590770c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:06.431893 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b34cf7-8414-40df-be84-76f66590770c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:06.432134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ea3f8-bd53-4a39-b2b0-426b099f4d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:06.432788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ea3f8-bd53-4a39-b2b0-426b099f4d3b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:06.433060 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ea3f8-bd53-4a39-b2b0-426b099f4d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:06.433340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ea3f8-bd53-4a39-b2b0-426b099f4d3b None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:06.434167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ea3f8-bd53-4a39-b2b0-426b099f4d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:06.434441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ea3f8-bd53-4a39-b2b0-426b099f4d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:06.435808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ea3f8-bd53-4a39-b2b0-426b099f4d3b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-45b34cf7-8414-40df-be84-76f66590770c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:06.441339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:06.443016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:06.443870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:06.443870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:06.443870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:06.443870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:06.443870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:06.443870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:06.443870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:06.443870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:06.443870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:06.443870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:06.443870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:06.443870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:06.446000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 336/660] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:02:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:06.446937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b34cf7-8414-40df-be84-76f66590770c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:06.450781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:06.463079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 325/661] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:06.464794 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ea3f8-bd53-4a39-b2b0-426b099f4d3b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:06.588210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b34cf7-8414-40df-be84-76f66590770c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:06.593056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ea3f8-bd53-4a39-b2b0-426b099f4d3b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:06.638604 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779736c-7529-464d-a89a-e20bd8ad5825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:06.639849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b1aa8-487c-43e0-b9a3-342d93c92056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:06.640522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779736c-7529-464d-a89a-e20bd8ad5825 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:06.640692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b1aa8-487c-43e0-b9a3-342d93c92056 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:06.640911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b1aa8-487c-43e0-b9a3-342d93c92056 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:06.641182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b1aa8-487c-43e0-b9a3-342d93c92056 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:06.641889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779736c-7529-464d-a89a-e20bd8ad5825 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:06.642618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779736c-7529-464d-a89a-e20bd8ad5825 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:06.645486 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779736c-7529-464d-a89a-e20bd8ad5825 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:06.646299 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779736c-7529-464d-a89a-e20bd8ad5825 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:06.649666 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b1aa8-487c-43e0-b9a3-342d93c92056 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:06.650082 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779736c-7529-464d-a89a-e20bd8ad5825 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:06.651156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b1aa8-487c-43e0-b9a3-342d93c92056 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-2e4b1aa8-487c-43e0-b9a3-342d93c92056 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:06.674167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:06.678098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:06.679305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:06.679305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:06.679305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:06.679305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:06.679305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:06.679305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:06.679305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:06.679305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:06.679305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 12:02:06.679305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:06.680268 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 337/662] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jul 21 12:02:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:06.680268 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779736c-7529-464d-a89a-e20bd8ad5825 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:06.683927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 326/663] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:02:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:06.684976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b1aa8-487c-43e0-b9a3-342d93c92056 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:06.735907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:06.756341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:06.805374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779736c-7529-464d-a89a-e20bd8ad5825 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:06.825264 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b1aa8-487c-43e0-b9a3-342d93c92056 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:06.851646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752f16e-11df-431f-bf3e-85bae4d2d92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:06.852319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752f16e-11df-431f-bf3e-85bae4d2d92a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:06.852602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752f16e-11df-431f-bf3e-85bae4d2d92a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:06.852887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752f16e-11df-431f-bf3e-85bae4d2d92a None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:06.853657 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752f16e-11df-431f-bf3e-85bae4d2d92a None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:06.853956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752f16e-11df-431f-bf3e-85bae4d2d92a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:06.855381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752f16e-11df-431f-bf3e-85bae4d2d92a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:06.869976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 338/664] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:02:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:06.869976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752f16e-11df-431f-bf3e-85bae4d2d92a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:06.888727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7df2f-6a39-42c7-86f7-65e58d2db311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:06.890213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7df2f-6a39-42c7-86f7-65e58d2db311 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:06.890801 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7df2f-6a39-42c7-86f7-65e58d2db311 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:06.891277 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7df2f-6a39-42c7-86f7-65e58d2db311 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:06.904362 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7df2f-6a39-42c7-86f7-65e58d2db311 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:06.906992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7df2f-6a39-42c7-86f7-65e58d2db311 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ccc7df2f-6a39-42c7-86f7-65e58d2db311 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:06.933722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:06.935905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:06.939617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:06.939617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:06.939617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:06.939617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:06.939617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:06.939617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:06.939617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:06.939617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:06.939617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 327/665] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:06.939617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7df2f-6a39-42c7-86f7-65e58d2db311 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:07.019009 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752f16e-11df-431f-bf3e-85bae4d2d92a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:07.054364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:07.059111 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:07.066646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7df2f-6a39-42c7-86f7-65e58d2db311 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:07.080629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca11e44-9fec-461e-87e9-c3fdc4496756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:07.081760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca11e44-9fec-461e-87e9-c3fdc4496756 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:07.082261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca11e44-9fec-461e-87e9-c3fdc4496756 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:07.082780 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca11e44-9fec-461e-87e9-c3fdc4496756 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:07.124398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92a28d-a773-4e45-9897-e0b179fcb956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:07.125544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92a28d-a773-4e45-9897-e0b179fcb956 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:07.126025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92a28d-a773-4e45-9897-e0b179fcb956 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:07.126500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92a28d-a773-4e45-9897-e0b179fcb956 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:07.128168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92a28d-a773-4e45-9897-e0b179fcb956 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:07.128706 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92a28d-a773-4e45-9897-e0b179fcb956 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:07.131438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92a28d-a773-4e45-9897-e0b179fcb956 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:07.170415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 328/666] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Jul 21 12:02:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:07.170415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92a28d-a773-4e45-9897-e0b179fcb956 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:07.180909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca11e44-9fec-461e-87e9-c3fdc4496756 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:07.182988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca11e44-9fec-461e-87e9-c3fdc4496756 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:07.318260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 339/667] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:02:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:02:07.318260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca11e44-9fec-461e-87e9-c3fdc4496756 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:07.345514 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92a28d-a773-4e45-9897-e0b179fcb956 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:07.346504 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:07.407250 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c96620-f64d-4c9a-8619-6d2c5dd5bcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:07.408397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c96620-f64d-4c9a-8619-6d2c5dd5bcf9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:07.408723 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c96620-f64d-4c9a-8619-6d2c5dd5bcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:07.409216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c96620-f64d-4c9a-8619-6d2c5dd5bcf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:07.430862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c96620-f64d-4c9a-8619-6d2c5dd5bcf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:07.433648 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c96620-f64d-4c9a-8619-6d2c5dd5bcf9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:07.446343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca11e44-9fec-461e-87e9-c3fdc4496756 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-05c96620-f64d-4c9a-8619-6d2c5dd5bcf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:07.466844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:07.468818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:07.474392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:07.474392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:07.474392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:07.474392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:07.474392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 329/668] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:07.474392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c96620-f64d-4c9a-8619-6d2c5dd5bcf9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:07.474392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:07.524857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f023b-1c39-45da-bcf9-6d93adcea8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:07.526272 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f023b-1c39-45da-bcf9-6d93adcea8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:07.526776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f023b-1c39-45da-bcf9-6d93adcea8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:07.527641 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f023b-1c39-45da-bcf9-6d93adcea8a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:07.529328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f023b-1c39-45da-bcf9-6d93adcea8a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:07.529901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f023b-1c39-45da-bcf9-6d93adcea8a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:07.532707 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f023b-1c39-45da-bcf9-6d93adcea8a8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:07.556704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 340/669] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:07.560291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f023b-1c39-45da-bcf9-6d93adcea8a8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:07.598420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c96620-f64d-4c9a-8619-6d2c5dd5bcf9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:07.653623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c14649-b273-43d4-896d-303d8502204b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:07.654587 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14649-b273-43d4-896d-303d8502204b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:07.655015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14649-b273-43d4-896d-303d8502204b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:07.655438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14649-b273-43d4-896d-303d8502204b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:07.716490 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:07.749462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f023b-1c39-45da-bcf9-6d93adcea8a8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:07.770615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c14649-b273-43d4-896d-303d8502204b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:07.772584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c14649-b273-43d4-896d-303d8502204b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:07.776142 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:07.793967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee6b2c-e24d-4888-adf7-e34caa717ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:07.794817 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee6b2c-e24d-4888-adf7-e34caa717ede None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:07.795228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee6b2c-e24d-4888-adf7-e34caa717ede None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:07.795509 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee6b2c-e24d-4888-adf7-e34caa717ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:07.807902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee6b2c-e24d-4888-adf7-e34caa717ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:07.809440 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee6b2c-e24d-4888-adf7-e34caa717ede None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-51ee6b2c-e24d-4888-adf7-e34caa717ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:07.829461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:07.831543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:07.833472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:07.833472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:07.833472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:07.833472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:07.833472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 341/670] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:07.834942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee6b2c-e24d-4888-adf7-e34caa717ede None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:07.908863 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 330/671] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:02:07.909641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c14649-b273-43d4-896d-303d8502204b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:07.978326 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee6b2c-e24d-4888-adf7-e34caa717ede None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:08.022770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4be2d-d53b-483e-8b61-bc9ae16d5f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:08.023915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4be2d-d53b-483e-8b61-bc9ae16d5f7c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:08.024383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4be2d-d53b-483e-8b61-bc9ae16d5f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:08.024926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4be2d-d53b-483e-8b61-bc9ae16d5f7c None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:08.026276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4be2d-d53b-483e-8b61-bc9ae16d5f7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:08.026860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4be2d-d53b-483e-8b61-bc9ae16d5f7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:08.029468 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4be2d-d53b-483e-8b61-bc9ae16d5f7c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:08.032493 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:08.037767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c14649-b273-43d4-896d-303d8502204b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:08.040606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:08.055596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 342/672] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:08.058029 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c1b13-7ff1-4158-8cab-687c77e38406 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:08.058612 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c1b13-7ff1-4158-8cab-687c77e38406 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:08.059115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c1b13-7ff1-4158-8cab-687c77e38406 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:08.061885 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 343/673] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:08.063593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c1b13-7ff1-4158-8cab-687c77e38406 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:08.077665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d391b96-b4fc-454a-b51a-09f502d0cfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:08.078337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d391b96-b4fc-454a-b51a-09f502d0cfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:08.078615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d391b96-b4fc-454a-b51a-09f502d0cfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:08.078919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d391b96-b4fc-454a-b51a-09f502d0cfc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:08.079770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d391b96-b4fc-454a-b51a-09f502d0cfc7 None admin] RBAC: Adding query filter params (role.id=8fc2e732d1b54ac193720d2652101798, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=10611bf25b9e4604ad769a6902f7f457) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:08.080080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d391b96-b4fc-454a-b51a-09f502d0cfc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:08.081544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d391b96-b4fc-454a-b51a-09f502d0cfc7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:08.088730 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 331/674] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:02:07 2022] GET /identity/v3/role_assignments?user.id=10611bf25b9e4604ad769a6902f7f457&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=8fc2e732d1b54ac193720d2652101798 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:08.089758 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d391b96-b4fc-454a-b51a-09f502d0cfc7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:08.198219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c1b13-7ff1-4158-8cab-687c77e38406 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:08.214256 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d391b96-b4fc-454a-b51a-09f502d0cfc7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:08.241833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72b096-b337-4e16-9bbf-7a5777cf03f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:08.242629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72b096-b337-4e16-9bbf-7a5777cf03f8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:08.242940 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72b096-b337-4e16-9bbf-7a5777cf03f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:08.243215 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72b096-b337-4e16-9bbf-7a5777cf03f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:08.243991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72b096-b337-4e16-9bbf-7a5777cf03f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:08.244300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72b096-b337-4e16-9bbf-7a5777cf03f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:08.245719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72b096-b337-4e16-9bbf-7a5777cf03f8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:08.262863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 344/675] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:08.263563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72b096-b337-4e16-9bbf-7a5777cf03f8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:08.285337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06d8ba-145c-453b-9e8c-cd8966188de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:08.286811 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06d8ba-145c-453b-9e8c-cd8966188de9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:08.287245 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06d8ba-145c-453b-9e8c-cd8966188de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:08.287741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06d8ba-145c-453b-9e8c-cd8966188de9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:08.305756 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06d8ba-145c-453b-9e8c-cd8966188de9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:08.307496 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06d8ba-145c-453b-9e8c-cd8966188de9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ea06d8ba-145c-453b-9e8c-cd8966188de9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:08.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:08.339806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:08.341693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:08.341693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:08.341693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:08.341693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:08.342903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 332/676] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:08.350686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d917f4-4581-4e42-b55a-b3d3ff3d7122 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:08.350686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d917f4-4581-4e42-b55a-b3d3ff3d7122 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:08.350686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d917f4-4581-4e42-b55a-b3d3ff3d7122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:08.368622 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-82d917f4-4581-4e42-b55a-b3d3ff3d7122 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:08.371003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-82d917f4-4581-4e42-b55a-b3d3ff3d7122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:08.372082 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:08.400087 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:08.445638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72b096-b337-4e16-9bbf-7a5777cf03f8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:08.471046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 333/677] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:02:08.471782 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d917f4-4581-4e42-b55a-b3d3ff3d7122 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:08.506583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f5920-f838-4468-85e2-5601fa99f2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:08.507452 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f5920-f838-4468-85e2-5601fa99f2eb None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:08.507581 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f5920-f838-4468-85e2-5601fa99f2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:08.507888 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f5920-f838-4468-85e2-5601fa99f2eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:08.518303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f5920-f838-4468-85e2-5601fa99f2eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:08.519864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f5920-f838-4468-85e2-5601fa99f2eb None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-2c9f5920-f838-4468-85e2-5601fa99f2eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:08.535391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:08.537304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:08.539856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:08.539856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:08.539856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:08.539856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:08.539856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:08.539856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:08.539856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:08.539856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:08.539856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 12:02:08.539856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:08.539856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 345/678] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:02:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:08.539856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f5920-f838-4468-85e2-5601fa99f2eb None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:08.608064 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d917f4-4581-4e42-b55a-b3d3ff3d7122 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:08.648781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b4516-166f-474e-af2a-6998674ac2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:08.649611 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b4516-166f-474e-af2a-6998674ac2cd None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:08.649893 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b4516-166f-474e-af2a-6998674ac2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:08.650166 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b4516-166f-474e-af2a-6998674ac2cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:08.658802 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b4516-166f-474e-af2a-6998674ac2cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:08.660289 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b4516-166f-474e-af2a-6998674ac2cd None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-7d8b4516-166f-474e-af2a-6998674ac2cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:08.677053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:08.678051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:08.679804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:08.679804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:08.679804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:08.679804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:08.679804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:08.679804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:08.679804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:08.679804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:08.683219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 334/679] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:08.684050 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b4516-166f-474e-af2a-6998674ac2cd None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:08.700332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:08.727039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f5920-f838-4468-85e2-5601fa99f2eb None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:08.746100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:08.772785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ab154-33e9-4c6a-8daa-288ae1333b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:08.773465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ab154-33e9-4c6a-8daa-288ae1333b02 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:08.773741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ab154-33e9-4c6a-8daa-288ae1333b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:08.774021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ab154-33e9-4c6a-8daa-288ae1333b02 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:08.775363 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ab154-33e9-4c6a-8daa-288ae1333b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:08.775665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ab154-33e9-4c6a-8daa-288ae1333b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:08.778140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ab154-33e9-4c6a-8daa-288ae1333b02 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:08.797165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 346/680] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:08.798366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ab154-33e9-4c6a-8daa-288ae1333b02 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:08.822686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b4516-166f-474e-af2a-6998674ac2cd None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:08.867747 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fa7a5-8ec0-4ead-960a-ac72573041c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:08.869125 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fa7a5-8ec0-4ead-960a-ac72573041c8 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:08.869619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fa7a5-8ec0-4ead-960a-ac72573041c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:08.870112 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fa7a5-8ec0-4ead-960a-ac72573041c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:08.891667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fa7a5-8ec0-4ead-960a-ac72573041c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-878fa7a5-8ec0-4ead-960a-ac72573041c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:08.904848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:08.905892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:08.907193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:08.907193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:08.907193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:08.907193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:08.907193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:08.907193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:08.907193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:08.907193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:08.907193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:08.907193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:08.907193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:02:08.907193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:08.907193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 335/681] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:02:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:08.907904 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fa7a5-8ec0-4ead-960a-ac72573041c8 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:08.948419 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ab154-33e9-4c6a-8daa-288ae1333b02 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:09.009649 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb528c8-ada0-44e5-9ff8-50afb3f6b2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:09.010800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb528c8-ada0-44e5-9ff8-50afb3f6b2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:09.011475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb528c8-ada0-44e5-9ff8-50afb3f6b2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:09.011924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb528c8-ada0-44e5-9ff8-50afb3f6b2b7 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:09.014281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb528c8-ada0-44e5-9ff8-50afb3f6b2b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:09.014814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb528c8-ada0-44e5-9ff8-50afb3f6b2b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:09.017616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb528c8-ada0-44e5-9ff8-50afb3f6b2b7 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:09.018112 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:09.058876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 347/682] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jul 21 12:02:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:09.060252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb528c8-ada0-44e5-9ff8-50afb3f6b2b7 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:09.075104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fa7a5-8ec0-4ead-960a-ac72573041c8 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:09.108962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:09.130340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6b361-31e6-4bdd-b642-3d9c20ab4646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:09.131301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6b361-31e6-4bdd-b642-3d9c20ab4646 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:09.131742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6b361-31e6-4bdd-b642-3d9c20ab4646 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:09.132199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6b361-31e6-4bdd-b642-3d9c20ab4646 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:09.133455 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6b361-31e6-4bdd-b642-3d9c20ab4646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:09.133893 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6b361-31e6-4bdd-b642-3d9c20ab4646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:09.136230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6b361-31e6-4bdd-b642-3d9c20ab4646 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:09.162965 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 336/683] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:09.162965 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6b361-31e6-4bdd-b642-3d9c20ab4646 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:09.225280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb528c8-ada0-44e5-9ff8-50afb3f6b2b7 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:09.267389 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee4020-41c2-4a04-98d7-abaf71179db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:09.268114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee4020-41c2-4a04-98d7-abaf71179db6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:09.268397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee4020-41c2-4a04-98d7-abaf71179db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:09.268677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee4020-41c2-4a04-98d7-abaf71179db6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:09.276824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee4020-41c2-4a04-98d7-abaf71179db6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:09.278326 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee4020-41c2-4a04-98d7-abaf71179db6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-85ee4020-41c2-4a04-98d7-abaf71179db6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:09.293506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:09.295459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:09.297597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:09.297597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:09.297597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:09.297597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:09.297597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:09.297597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:09.297597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:09.297597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:09.297597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 348/684] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:09.297597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee4020-41c2-4a04-98d7-abaf71179db6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:09.307146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6b361-31e6-4bdd-b642-3d9c20ab4646 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:09.343310 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:09.351458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8a382-37c1-44d6-be5e-4f696abb0e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:09.352457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8a382-37c1-44d6-be5e-4f696abb0e36 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:09.352826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8a382-37c1-44d6-be5e-4f696abb0e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:09.353182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8a382-37c1-44d6-be5e-4f696abb0e36 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:09.354061 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8a382-37c1-44d6-be5e-4f696abb0e36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:09.354469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8a382-37c1-44d6-be5e-4f696abb0e36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:09.356300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8a382-37c1-44d6-be5e-4f696abb0e36 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:09.373878 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 337/685] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:02:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:09.373878 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8a382-37c1-44d6-be5e-4f696abb0e36 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:09.431194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:09.449317 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee4020-41c2-4a04-98d7-abaf71179db6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:09.505112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f269def-c97d-474a-8713-46dfa3c93fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:09.506134 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f269def-c97d-474a-8713-46dfa3c93fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:09.506604 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f269def-c97d-474a-8713-46dfa3c93fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:09.507088 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f269def-c97d-474a-8713-46dfa3c93fa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:09.523639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8a382-37c1-44d6-be5e-4f696abb0e36 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:09.578597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28791370-b236-430c-9d87-8ab0c4a737f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:09.579885 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791370-b236-430c-9d87-8ab0c4a737f6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:09.580416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791370-b236-430c-9d87-8ab0c4a737f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:09.580970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791370-b236-430c-9d87-8ab0c4a737f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:09.582562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28791370-b236-430c-9d87-8ab0c4a737f6 None admin] RBAC: Adding query filter params (role.id=8fc2e732d1b54ac193720d2652101798, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=2af1aad6bd5c486192345b3747ed3e23) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:09.583138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28791370-b236-430c-9d87-8ab0c4a737f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:09.585588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28791370-b236-430c-9d87-8ab0c4a737f6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:09.594756 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 338/686] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:02:09 2022] GET /identity/v3/role_assignments?user.id=2af1aad6bd5c486192345b3747ed3e23&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=8fc2e732d1b54ac193720d2652101798 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:09.596151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28791370-b236-430c-9d87-8ab0c4a737f6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:09.621149 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f269def-c97d-474a-8713-46dfa3c93fa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:09.623999 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f269def-c97d-474a-8713-46dfa3c93fa1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:09.687520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:09.748161 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28791370-b236-430c-9d87-8ab0c4a737f6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:09.794562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:09.807866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 349/687] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:02:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:02:09.808900 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f269def-c97d-474a-8713-46dfa3c93fa1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:09.824199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad52954-dd6e-4fba-bc80-0682c4e2c0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:09.825851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad52954-dd6e-4fba-bc80-0682c4e2c0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:09.826518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad52954-dd6e-4fba-bc80-0682c4e2c0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:09.827159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad52954-dd6e-4fba-bc80-0682c4e2c0a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:09.828708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad52954-dd6e-4fba-bc80-0682c4e2c0a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:09.829343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad52954-dd6e-4fba-bc80-0682c4e2c0a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:09.832146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad52954-dd6e-4fba-bc80-0682c4e2c0a6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:09.856367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 339/688] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:09.858035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad52954-dd6e-4fba-bc80-0682c4e2c0a6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:09.980575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f269def-c97d-474a-8713-46dfa3c93fa1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:10.002382 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad52954-dd6e-4fba-bc80-0682c4e2c0a6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:10.021668 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:10.033737 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9308505-2412-475a-b4a8-2b3022a1debf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:10.035887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9308505-2412-475a-b4a8-2b3022a1debf None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:10.036699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9308505-2412-475a-b4a8-2b3022a1debf None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:10.037214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9308505-2412-475a-b4a8-2b3022a1debf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:10.051179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9308505-2412-475a-b4a8-2b3022a1debf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:10.051983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0acab2-ef78-4faa-b0ad-c73710977b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:10.052615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9308505-2412-475a-b4a8-2b3022a1debf None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:10.053598 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0acab2-ef78-4faa-b0ad-c73710977b33 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:10.054144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0acab2-ef78-4faa-b0ad-c73710977b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:10.054996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0acab2-ef78-4faa-b0ad-c73710977b33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:10.068456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0acab2-ef78-4faa-b0ad-c73710977b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:10.069942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0acab2-ef78-4faa-b0ad-c73710977b33 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c9308505-2412-475a-b4a8-2b3022a1debf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:10.076982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:10.077917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:10.078849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:10.078849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:10.078849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:10.078849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:10.085134 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 350/689] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:10.085134 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9308505-2412-475a-b4a8-2b3022a1debf None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-af0acab2-ef78-4faa-b0ad-c73710977b33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:10.099138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:10.100320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:10.101439 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:10.101439 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:10.101439 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:10.101439 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:10.108578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 340/690] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:10.108578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0acab2-ef78-4faa-b0ad-c73710977b33 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:10.146832 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:10.209787 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9308505-2412-475a-b4a8-2b3022a1debf None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:10.249849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bd9d2-2838-4a13-b725-f030c8b23468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:10.250576 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bd9d2-2838-4a13-b725-f030c8b23468 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:10.250916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bd9d2-2838-4a13-b725-f030c8b23468 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:10.251191 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bd9d2-2838-4a13-b725-f030c8b23468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:10.252062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bd9d2-2838-4a13-b725-f030c8b23468 None admin] RBAC: Adding query filter params (role.id=8fc2e732d1b54ac193720d2652101798, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=88cfd88c19fd4c979e921e3d8cd9cc3c) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:10.252381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bd9d2-2838-4a13-b725-f030c8b23468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:10.253862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bd9d2-2838-4a13-b725-f030c8b23468 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:10.255408 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0acab2-ef78-4faa-b0ad-c73710977b33 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:10.261191 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 351/691] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:02:10 2022] GET /identity/v3/role_assignments?user.id=88cfd88c19fd4c979e921e3d8cd9cc3c&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=8fc2e732d1b54ac193720d2652101798 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:10.262309 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bd9d2-2838-4a13-b725-f030c8b23468 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:10.333421 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2807a5-4ec6-4db2-b0e5-a73b159b425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:10.334138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2807a5-4ec6-4db2-b0e5-a73b159b425a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:10.334498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2807a5-4ec6-4db2-b0e5-a73b159b425a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:10.335495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2807a5-4ec6-4db2-b0e5-a73b159b425a None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:10.335840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2807a5-4ec6-4db2-b0e5-a73b159b425a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:10.336227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2807a5-4ec6-4db2-b0e5-a73b159b425a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:10.337780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2807a5-4ec6-4db2-b0e5-a73b159b425a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:10.382797 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 341/692] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:10.384147 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2807a5-4ec6-4db2-b0e5-a73b159b425a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:10.437194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bd9d2-2838-4a13-b725-f030c8b23468 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:10.456372 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:10.467082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:10.514074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401140-90d5-4487-b25a-dda3e8e41018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:10.514805 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401140-90d5-4487-b25a-dda3e8e41018 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:10.515081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401140-90d5-4487-b25a-dda3e8e41018 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:10.515355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401140-90d5-4487-b25a-dda3e8e41018 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:10.516112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be401140-90d5-4487-b25a-dda3e8e41018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:10.516422 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be401140-90d5-4487-b25a-dda3e8e41018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:10.517854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be401140-90d5-4487-b25a-dda3e8e41018 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:10.555395 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 352/693] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:10.570258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401140-90d5-4487-b25a-dda3e8e41018 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:10.590626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2807a5-4ec6-4db2-b0e5-a73b159b425a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:10.633441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c10edb-5fdf-4420-9219-1df37cc6ae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:10.634494 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c10edb-5fdf-4420-9219-1df37cc6ae47 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:10.634840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c10edb-5fdf-4420-9219-1df37cc6ae47 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:10.635115 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c10edb-5fdf-4420-9219-1df37cc6ae47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:10.645859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c10edb-5fdf-4420-9219-1df37cc6ae47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:10.648084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c10edb-5fdf-4420-9219-1df37cc6ae47 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-46c10edb-5fdf-4420-9219-1df37cc6ae47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:10.665178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:10.666200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:10.667219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:10.667219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:10.667219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:10.667219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:10.667219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:10.667219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:10.667219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:10.667219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:10.667219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:02:10.667219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:10.671013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 342/694] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jul 21 12:02:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:10.674055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c10edb-5fdf-4420-9219-1df37cc6ae47 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:10.784113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401140-90d5-4487-b25a-dda3e8e41018 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:10.851588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:10.892225 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c10edb-5fdf-4420-9219-1df37cc6ae47 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:10.895957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce99e35-03b1-48c5-a411-fdaebc5dd55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:10.897338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce99e35-03b1-48c5-a411-fdaebc5dd55d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:10.897834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce99e35-03b1-48c5-a411-fdaebc5dd55d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:10.898328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce99e35-03b1-48c5-a411-fdaebc5dd55d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:10.921735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce99e35-03b1-48c5-a411-fdaebc5dd55d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:10.924566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce99e35-03b1-48c5-a411-fdaebc5dd55d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-8ce99e35-03b1-48c5-a411-fdaebc5dd55d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:10.981361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:10.982403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:10.983488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:10.983488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:10.983488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:10.983488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:10.983488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:10.983488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:10.983488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:10.983488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:10.988035 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 353/695] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:10.994219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce99e35-03b1-48c5-a411-fdaebc5dd55d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:11.020894 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee57d5-285a-4cfb-8e46-e1dcd9718493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:11.021952 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee57d5-285a-4cfb-8e46-e1dcd9718493 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:11.022402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee57d5-285a-4cfb-8e46-e1dcd9718493 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:11.022856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee57d5-285a-4cfb-8e46-e1dcd9718493 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:11.024272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee57d5-285a-4cfb-8e46-e1dcd9718493 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:11.028445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee57d5-285a-4cfb-8e46-e1dcd9718493 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:11.031135 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee57d5-285a-4cfb-8e46-e1dcd9718493 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:11.069395 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:11.095376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 343/696] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jul 21 12:02:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:11.114403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee57d5-285a-4cfb-8e46-e1dcd9718493 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:11.219334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce99e35-03b1-48c5-a411-fdaebc5dd55d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:11.300855 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9cd40-97ec-4921-a0c3-9bee9a59c19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:11.301987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9cd40-97ec-4921-a0c3-9bee9a59c19d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:11.302479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9cd40-97ec-4921-a0c3-9bee9a59c19d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:11.302995 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9cd40-97ec-4921-a0c3-9bee9a59c19d None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:11.304508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9cd40-97ec-4921-a0c3-9bee9a59c19d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:11.305053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9cd40-97ec-4921-a0c3-9bee9a59c19d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:11.307811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9cd40-97ec-4921-a0c3-9bee9a59c19d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:11.330869 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 354/697] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:11.339971 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9cd40-97ec-4921-a0c3-9bee9a59c19d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:11.408332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee57d5-285a-4cfb-8e46-e1dcd9718493 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:11.484013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e787a1-fb92-4977-b12c-440622611078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:11.484706 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e787a1-fb92-4977-b12c-440622611078 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:11.484983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e787a1-fb92-4977-b12c-440622611078 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:11.485570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e787a1-fb92-4977-b12c-440622611078 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:11.518324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:11.528490 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:11.546494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9cd40-97ec-4921-a0c3-9bee9a59c19d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:11.610014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e787a1-fb92-4977-b12c-440622611078 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:11.611968 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e787a1-fb92-4977-b12c-440622611078 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:11.616411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9d9ae-de5e-4d0b-92c3-8ba41272efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:11.617090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9d9ae-de5e-4d0b-92c3-8ba41272efdc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:11.617371 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9d9ae-de5e-4d0b-92c3-8ba41272efdc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:11.617646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9d9ae-de5e-4d0b-92c3-8ba41272efdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:11.618504 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9d9ae-de5e-4d0b-92c3-8ba41272efdc None admin] RBAC: Adding query filter params (role.id=8fc2e732d1b54ac193720d2652101798, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=2dd659c33e0f49dc8edf30bd47737e70) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:11.618841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9d9ae-de5e-4d0b-92c3-8ba41272efdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:11.620295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9d9ae-de5e-4d0b-92c3-8ba41272efdc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:11.634860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 355/698] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:02:11 2022] GET /identity/v3/role_assignments?user.id=2dd659c33e0f49dc8edf30bd47737e70&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=8fc2e732d1b54ac193720d2652101798 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:11.636487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0637d-bbb5-4bc3-891b-849faa00e981 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:11.636773 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0637d-bbb5-4bc3-891b-849faa00e981 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:11.637053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0637d-bbb5-4bc3-891b-849faa00e981 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:11.639055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 356/699] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:11.656829 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad8a23-13fc-44bf-be4a-86ed22e9ef53 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:11.657110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad8a23-13fc-44bf-be4a-86ed22e9ef53 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:11.657387 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad8a23-13fc-44bf-be4a-86ed22e9ef53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:11.675801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5dad8a23-13fc-44bf-be4a-86ed22e9ef53 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:11.676945 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5dad8a23-13fc-44bf-be4a-86ed22e9ef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:11.758836 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 357/700] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:02:11.766931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 344/701] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:02:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 12:02:11.776224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad8a23-13fc-44bf-be4a-86ed22e9ef53 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:11.795356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e787a1-fb92-4977-b12c-440622611078 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:11.897356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:11.972517 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:11.995748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad8a23-13fc-44bf-be4a-86ed22e9ef53 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:12.015866 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e787a1-fb92-4977-b12c-440622611078 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:12.038806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b185c-9200-4a98-8a78-fcf37c8eab61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:12.039848 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b185c-9200-4a98-8a78-fcf37c8eab61 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:12.040236 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b185c-9200-4a98-8a78-fcf37c8eab61 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:12.040615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b185c-9200-4a98-8a78-fcf37c8eab61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:12.056160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b185c-9200-4a98-8a78-fcf37c8eab61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:12.057817 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b185c-9200-4a98-8a78-fcf37c8eab61 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-144b185c-9200-4a98-8a78-fcf37c8eab61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:12.082368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:12.084379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:12.086628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:12.086628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:12.086628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:12.086628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:12.086628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 358/702] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:12.091935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9629e81-54b0-4347-a928-a87e1657029a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:12.092189 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b185c-9200-4a98-8a78-fcf37c8eab61 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:12.093833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9629e81-54b0-4347-a928-a87e1657029a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:12.094603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9629e81-54b0-4347-a928-a87e1657029a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:12.095389 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9629e81-54b0-4347-a928-a87e1657029a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:12.115147 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9629e81-54b0-4347-a928-a87e1657029a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:12.118369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9629e81-54b0-4347-a928-a87e1657029a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-f9629e81-54b0-4347-a928-a87e1657029a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:12.153874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:12.155762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:12.157483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:12.157483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:12.157483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:12.157483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:12.160882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 345/703] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:12.168766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9629e81-54b0-4347-a928-a87e1657029a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:12.254343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b185c-9200-4a98-8a78-fcf37c8eab61 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:12.284746 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:12.288705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9629e81-54b0-4347-a928-a87e1657029a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:12.329937 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3b699-4a36-4fa0-a8b5-1d57e5915374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:12.330765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3b699-4a36-4fa0-a8b5-1d57e5915374 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:12.331116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3b699-4a36-4fa0-a8b5-1d57e5915374 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:12.331457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3b699-4a36-4fa0-a8b5-1d57e5915374 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:12.331611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3351b-d7ef-4ca3-b3e3-5b92577374d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:12.332306 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3b699-4a36-4fa0-a8b5-1d57e5915374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:12.332683 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3b699-4a36-4fa0-a8b5-1d57e5915374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:12.333551 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3351b-d7ef-4ca3-b3e3-5b92577374d8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:12.334221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3b699-4a36-4fa0-a8b5-1d57e5915374 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:12.334527 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3351b-d7ef-4ca3-b3e3-5b92577374d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:12.335254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3351b-d7ef-4ca3-b3e3-5b92577374d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:12.337263 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3351b-d7ef-4ca3-b3e3-5b92577374d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:12.338145 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3351b-d7ef-4ca3-b3e3-5b92577374d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:12.341395 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3351b-d7ef-4ca3-b3e3-5b92577374d8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:12.344877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:12.351201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 346/704] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:12.359452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3b699-4a36-4fa0-a8b5-1d57e5915374 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:12.368561 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 359/705] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:12.374842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3351b-d7ef-4ca3-b3e3-5b92577374d8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:12.546031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3b699-4a36-4fa0-a8b5-1d57e5915374 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:12.579373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3351b-d7ef-4ca3-b3e3-5b92577374d8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:12.584277 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f00081-d6be-4aa4-bfb2-9359c9338919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:12.585055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f00081-d6be-4aa4-bfb2-9359c9338919 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:12.585400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f00081-d6be-4aa4-bfb2-9359c9338919 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:12.585736 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f00081-d6be-4aa4-bfb2-9359c9338919 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:12.586525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f00081-d6be-4aa4-bfb2-9359c9338919 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:12.588148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f00081-d6be-4aa4-bfb2-9359c9338919 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:12.618803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 347/706] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:02:12 2022] POST /identity/v3/users => generated 254 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:02:12.621678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccb4a2-2e37-4f61-ada3-93dbe89b0c63 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:12.622179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccb4a2-2e37-4f61-ada3-93dbe89b0c63 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:12.622702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccb4a2-2e37-4f61-ada3-93dbe89b0c63 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:12.632923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 348/707] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:12 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:12.641118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332464e-cef7-4651-acad-fa6ce40f359e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:12.641623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332464e-cef7-4651-acad-fa6ce40f359e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:12.642132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332464e-cef7-4651-acad-fa6ce40f359e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:12.685378 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2242bf3-cd80-4bab-9ce6-bf3d1b137489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:12.686922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242bf3-cd80-4bab-9ce6-bf3d1b137489 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:12.687420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242bf3-cd80-4bab-9ce6-bf3d1b137489 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:12.689911 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242bf3-cd80-4bab-9ce6-bf3d1b137489 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:12.696866 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c332464e-cef7-4651-acad-fa6ce40f359e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:12.704211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c332464e-cef7-4651-acad-fa6ce40f359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:12.713158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2242bf3-cd80-4bab-9ce6-bf3d1b137489 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:12.716434 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2242bf3-cd80-4bab-9ce6-bf3d1b137489 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:12.729421 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c2242bf3-cd80-4bab-9ce6-bf3d1b137489 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:12.752539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:12.754738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:12.756819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:12.756819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:12.756819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:12.756819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:12.756819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:12.756819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:12.756819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:12.756819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:12.756819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 360/708] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:12.764599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2242bf3-cd80-4bab-9ce6-bf3d1b137489 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:12.879382 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:12.879626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 349/709] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:02:12.921763 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332464e-cef7-4651-acad-fa6ce40f359e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:12.926648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2242bf3-cd80-4bab-9ce6-bf3d1b137489 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:12.963767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a169c5-33a4-48d2-b710-6d7087fa9a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:12.964456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a169c5-33a4-48d2-b710-6d7087fa9a1c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:12.964742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a169c5-33a4-48d2-b710-6d7087fa9a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:12.965022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a169c5-33a4-48d2-b710-6d7087fa9a1c None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:12.965846 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a169c5-33a4-48d2-b710-6d7087fa9a1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:12.966151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a169c5-33a4-48d2-b710-6d7087fa9a1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:12.968384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a169c5-33a4-48d2-b710-6d7087fa9a1c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:12.983847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 361/710] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:12.992703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a169c5-33a4-48d2-b710-6d7087fa9a1c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:13.103515 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a169c5-33a4-48d2-b710-6d7087fa9a1c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:13.119297 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:13.134603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332464e-cef7-4651-acad-fa6ce40f359e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:13.145155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09916fc8-59a6-4e54-ac6c-b66905131f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:13.145834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09916fc8-59a6-4e54-ac6c-b66905131f9f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:13.146119 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09916fc8-59a6-4e54-ac6c-b66905131f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:13.146396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09916fc8-59a6-4e54-ac6c-b66905131f9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:13.147349 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09916fc8-59a6-4e54-ac6c-b66905131f9f None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=f3fb1d091b27472081549f4166ca172f) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:13.147668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09916fc8-59a6-4e54-ac6c-b66905131f9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:13.149287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09916fc8-59a6-4e54-ac6c-b66905131f9f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:13.156335 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 362/711] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:02:12 2022] GET /identity/v3/role_assignments?user.id=f3fb1d091b27472081549f4166ca172f&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:13.157543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc4186-8621-4d52-800d-6bb63f7b22a3 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:13.157902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc4186-8621-4d52-800d-6bb63f7b22a3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:13.158105 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc4186-8621-4d52-800d-6bb63f7b22a3 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:13.159748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 363/712] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:13.165592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27795-8474-4f69-802f-2f89cf9045bf None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:13.165928 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27795-8474-4f69-802f-2f89cf9045bf None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:13.166158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27795-8474-4f69-802f-2f89cf9045bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:13.185524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c3a27795-8474-4f69-802f-2f89cf9045bf None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:13.187026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c3a27795-8474-4f69-802f-2f89cf9045bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:13.207375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee3300-468f-4dd6-9833-3f7ca63df8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:13.208224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee3300-468f-4dd6-9833-3f7ca63df8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:13.208509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee3300-468f-4dd6-9833-3f7ca63df8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:13.208776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee3300-468f-4dd6-9833-3f7ca63df8a4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:13.209461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee3300-468f-4dd6-9833-3f7ca63df8a4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:13.210916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee3300-468f-4dd6-9833-3f7ca63df8a4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ebee3300-468f-4dd6-9833-3f7ca63df8a4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:13.245561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:13.246891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:13.248184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 350/713] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Jul 21 12:02:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:13.263864 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee3300-468f-4dd6-9833-3f7ca63df8a4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:13.293893 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:13.329007 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 364/714] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 12:02:13.360701 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a27795-8474-4f69-802f-2f89cf9045bf None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:13.493413 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee3300-468f-4dd6-9833-3f7ca63df8a4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:13.533913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386247d-b250-4cc4-963f-f2b863b09cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:13.535070 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386247d-b250-4cc4-963f-f2b863b09cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:13.535551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386247d-b250-4cc4-963f-f2b863b09cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:13.536030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386247d-b250-4cc4-963f-f2b863b09cc9 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:13.536977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386247d-b250-4cc4-963f-f2b863b09cc9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:13.537482 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386247d-b250-4cc4-963f-f2b863b09cc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:13.539202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386247d-b250-4cc4-963f-f2b863b09cc9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:13.543495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a27795-8474-4f69-802f-2f89cf9045bf None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:13.545699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 351/715] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jul 21 12:02:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:13.556159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386247d-b250-4cc4-963f-f2b863b09cc9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:13.588937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:13.649254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8320df4-f78a-49d7-a500-ff7e0173fa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:13.650219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8320df4-f78a-49d7-a500-ff7e0173fa02 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:13.650515 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8320df4-f78a-49d7-a500-ff7e0173fa02 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:13.650826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8320df4-f78a-49d7-a500-ff7e0173fa02 None admin] PATH_INFO: `/v3/services/network` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:13.651525 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8320df4-f78a-49d7-a500-ff7e0173fa02 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:13.652974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8320df4-f78a-49d7-a500-ff7e0173fa02 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-e8320df4-f78a-49d7-a500-ff7e0173fa02 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:13.688575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:13.689661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:13.690502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:13.690502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:13.690502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:13.690502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:13.690502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:13.690502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:13.690502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:13.690502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:13.690502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:13.690502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:13.690502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:13.690502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:13.690502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 12:02:13.690502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:13.698901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 365/716] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:13 2022] GET /identity/v3/services/network => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:13.699120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8320df4-f78a-49d7-a500-ff7e0173fa02 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:13.725869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:13.798714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386247d-b250-4cc4-963f-f2b863b09cc9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:13.874145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29af75-9e8a-4cf7-a434-a8bcb952a9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:13.875085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29af75-9e8a-4cf7-a434-a8bcb952a9fd None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:13.875374 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29af75-9e8a-4cf7-a434-a8bcb952a9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:13.875655 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29af75-9e8a-4cf7-a434-a8bcb952a9fd None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:13.876903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29af75-9e8a-4cf7-a434-a8bcb952a9fd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:13.877304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29af75-9e8a-4cf7-a434-a8bcb952a9fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:13.884937 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29af75-9e8a-4cf7-a434-a8bcb952a9fd None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:13.903719 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 352/717] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jul 21 12:02:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:13.919160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8320df4-f78a-49d7-a500-ff7e0173fa02 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:13.975142 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d405bef-37ef-4f1d-a5c3-1bc59f06edb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:13.975842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d405bef-37ef-4f1d-a5c3-1bc59f06edb9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:13.976184 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d405bef-37ef-4f1d-a5c3-1bc59f06edb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:13.976509 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d405bef-37ef-4f1d-a5c3-1bc59f06edb9 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:13.977733 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d405bef-37ef-4f1d-a5c3-1bc59f06edb9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:13.978098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d405bef-37ef-4f1d-a5c3-1bc59f06edb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:13.979824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d405bef-37ef-4f1d-a5c3-1bc59f06edb9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:13.988044 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 366/718] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jul 21 12:02:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:13.994783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29af75-9e8a-4cf7-a434-a8bcb952a9fd None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:14.160040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29af75-9e8a-4cf7-a434-a8bcb952a9fd None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:14.204760 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68003ae-5dd4-4913-93ca-a235e909dc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:14.206169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68003ae-5dd4-4913-93ca-a235e909dc75 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:14.207004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68003ae-5dd4-4913-93ca-a235e909dc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:14.207721 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68003ae-5dd4-4913-93ca-a235e909dc75 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:14.209403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68003ae-5dd4-4913-93ca-a235e909dc75 None admin] RBAC: Adding query filter params (type=network) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:14.210237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68003ae-5dd4-4913-93ca-a235e909dc75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:14.212785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68003ae-5dd4-4913-93ca-a235e909dc75 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:14.222501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:14.226866 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 353/719] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jul 21 12:02:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:15.133223 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094c43a-4602-4880-94a6-e5c41c04b51b None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:15.133769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094c43a-4602-4880-94a6-e5c41c04b51b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:15.134199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094c43a-4602-4880-94a6-e5c41c04b51b None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:15.137299 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 367/720] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:15.144611 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c18d94-9af9-4fff-a0e4-cc58151fc678 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:15.145163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c18d94-9af9-4fff-a0e4-cc58151fc678 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:15.145581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c18d94-9af9-4fff-a0e4-cc58151fc678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:15.182350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b7c18d94-9af9-4fff-a0e4-cc58151fc678 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:15.184416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b7c18d94-9af9-4fff-a0e4-cc58151fc678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:15.340672 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 354/721] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:02:15.417697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094c43a-4602-4880-94a6-e5c41c04b51b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:15.465764 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:15.503257 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46f6ee-9a8f-4c70-abd6-bb9ee534adde None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:15.503935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46f6ee-9a8f-4c70-abd6-bb9ee534adde None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:15.504418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46f6ee-9a8f-4c70-abd6-bb9ee534adde None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:15.506304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 355/722] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:15.513386 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44755d6-d4a2-47fb-9974-0497bf571b22 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:15.514632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44755d6-d4a2-47fb-9974-0497bf571b22 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:15.516438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44755d6-d4a2-47fb-9974-0497bf571b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:15.552277 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d44755d6-d4a2-47fb-9974-0497bf571b22 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:15.553552 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d44755d6-d4a2-47fb-9974-0497bf571b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:15.588603 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094c43a-4602-4880-94a6-e5c41c04b51b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:15.671562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 356/723] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:02:15.674075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732f74f-d529-4161-81bb-4c172428e237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:15.674926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732f74f-d529-4161-81bb-4c172428e237 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:15.675211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732f74f-d529-4161-81bb-4c172428e237 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:15.675481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732f74f-d529-4161-81bb-4c172428e237 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:15.694404 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44755d6-d4a2-47fb-9974-0497bf571b22 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:15.706723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732f74f-d529-4161-81bb-4c172428e237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-9732f74f-d529-4161-81bb-4c172428e237 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:15.707606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:15.708674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:15.709602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:15.709602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:15.709602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:15.709602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:15.709602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:15.709602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:15.709602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:15.709602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:15.709602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:15.709602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:15.709602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:02:15.709602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:15.709602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 368/724] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:02:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:15.718143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732f74f-d529-4161-81bb-4c172428e237 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:15.772789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:15.844409 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44755d6-d4a2-47fb-9974-0497bf571b22 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:15.874830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:15.877673 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732f74f-d529-4161-81bb-4c172428e237 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:15.926160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8274fd6-34a0-4eab-9f9e-bcb38b53991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:15.926810 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8274fd6-34a0-4eab-9f9e-bcb38b53991e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:15.927090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8274fd6-34a0-4eab-9f9e-bcb38b53991e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:15.927360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8274fd6-34a0-4eab-9f9e-bcb38b53991e None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:15.928128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8274fd6-34a0-4eab-9f9e-bcb38b53991e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:15.928447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8274fd6-34a0-4eab-9f9e-bcb38b53991e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:15.929816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8274fd6-34a0-4eab-9f9e-bcb38b53991e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:15.939759 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 369/725] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:02:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:15.948654 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8274fd6-34a0-4eab-9f9e-bcb38b53991e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:15.958430 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96231ef5-a457-42ba-9c88-9c34d375e693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:15.959308 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96231ef5-a457-42ba-9c88-9c34d375e693 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:15.959590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96231ef5-a457-42ba-9c88-9c34d375e693 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:15.959862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96231ef5-a457-42ba-9c88-9c34d375e693 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:15.980795 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96231ef5-a457-42ba-9c88-9c34d375e693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-96231ef5-a457-42ba-9c88-9c34d375e693 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:15.997244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:15.998418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:15.999535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:15.999535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:15.999535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:15.999535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:15.999535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:15.999535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:15.999535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:15.999535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:15.999535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:15.999535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:15.999535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:15.999535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:16.006899 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 357/726] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:02:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:16.012388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96231ef5-a457-42ba-9c88-9c34d375e693 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:16.130928 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8274fd6-34a0-4eab-9f9e-bcb38b53991e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:16.210199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2723ff1-5d60-462c-8bad-665d5ccfd4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:16.211540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2723ff1-5d60-462c-8bad-665d5ccfd4cd None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:16.211751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96231ef5-a457-42ba-9c88-9c34d375e693 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:16.213075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2723ff1-5d60-462c-8bad-665d5ccfd4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:16.213854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2723ff1-5d60-462c-8bad-665d5ccfd4cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:16.260151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2723ff1-5d60-462c-8bad-665d5ccfd4cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:16.262796 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2723ff1-5d60-462c-8bad-665d5ccfd4cd None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:16.268009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:16.296616 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8b8b9-6bc4-4bbf-8d9b-7e722a69290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:16.298473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8b8b9-6bc4-4bbf-8d9b-7e722a69290d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:16.299587 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8b8b9-6bc4-4bbf-8d9b-7e722a69290d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:16.300499 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8b8b9-6bc4-4bbf-8d9b-7e722a69290d None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:16.302510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8b8b9-6bc4-4bbf-8d9b-7e722a69290d None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:16.303366 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8b8b9-6bc4-4bbf-8d9b-7e722a69290d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:16.306335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8b8b9-6bc4-4bbf-8d9b-7e722a69290d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-e2723ff1-5d60-462c-8bad-665d5ccfd4cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:16.323006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:16.325535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:16.330264 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:16.330264 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:16.330264 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:16.330264 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:16.331914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 370/727] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:16.332735 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 358/728] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:02:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:16.332965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2723ff1-5d60-462c-8bad-665d5ccfd4cd None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:16.340304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8b8b9-6bc4-4bbf-8d9b-7e722a69290d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:16.375393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:16.531557 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2723ff1-5d60-462c-8bad-665d5ccfd4cd None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:16.546315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8b8b9-6bc4-4bbf-8d9b-7e722a69290d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:16.578251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ff3fe-b5f5-4d89-9b10-537863f8ef02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:16.580185 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ff3fe-b5f5-4d89-9b10-537863f8ef02 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:16.581070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ff3fe-b5f5-4d89-9b10-537863f8ef02 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:16.581559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ff3fe-b5f5-4d89-9b10-537863f8ef02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:16.595770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0b21a-c46e-4554-adf7-6d724439aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:16.596463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0b21a-c46e-4554-adf7-6d724439aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:16.596750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0b21a-c46e-4554-adf7-6d724439aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:16.597035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0b21a-c46e-4554-adf7-6d724439aaa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:16.597792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0b21a-c46e-4554-adf7-6d724439aaa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:16.598118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0b21a-c46e-4554-adf7-6d724439aaa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:16.600584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0b21a-c46e-4554-adf7-6d724439aaa7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:16.601601 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ff3fe-b5f5-4d89-9b10-537863f8ef02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:16.605070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ff3fe-b5f5-4d89-9b10-537863f8ef02 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:16.616099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 359/729] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:16.617633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ea31e-540c-404b-85cd-be3c31dcfaba None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:16.617927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ea31e-540c-404b-85cd-be3c31dcfaba None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:16.618206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ea31e-540c-404b-85cd-be3c31dcfaba None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:16.626289 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 360/730] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:16.626289 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ea31e-540c-404b-85cd-be3c31dcfaba None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-183ff3fe-b5f5-4d89-9b10-537863f8ef02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:16.661650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:16.663150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:16.664538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:16.664538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:16.664538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:16.664538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:16.673115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 371/731] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:16.675185 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6300b4-7ebe-4aa2-aaab-89d22eb0d676 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:16.675777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6300b4-7ebe-4aa2-aaab-89d22eb0d676 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:16.676271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6300b4-7ebe-4aa2-aaab-89d22eb0d676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:16.696318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8d6300b4-7ebe-4aa2-aaab-89d22eb0d676 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:16.696992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:16.699995 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8d6300b4-7ebe-4aa2-aaab-89d22eb0d676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:16.778772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:16.790334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ea31e-540c-404b-85cd-be3c31dcfaba None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:16.807048 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 372/732] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:02:16.808648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6300b4-7ebe-4aa2-aaab-89d22eb0d676 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:16.838401 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b1c59-943f-44c5-ae39-0b8be64bc8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:16.839725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b1c59-943f-44c5-ae39-0b8be64bc8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:16.840268 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b1c59-943f-44c5-ae39-0b8be64bc8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:16.840763 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b1c59-943f-44c5-ae39-0b8be64bc8b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:16.851487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b1c59-943f-44c5-ae39-0b8be64bc8b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:16.853415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b1c59-943f-44c5-ae39-0b8be64bc8b7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-7d3b1c59-943f-44c5-ae39-0b8be64bc8b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:16.872436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:16.873583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:16.874525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:16.874525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:16.874525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:16.874525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:16.874525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:16.874525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:16.874525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:16.874525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:16.874525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 12:02:16.874525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:16.874525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 361/733] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:02:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:16.875186 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b1c59-943f-44c5-ae39-0b8be64bc8b7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:16.993492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6300b4-7ebe-4aa2-aaab-89d22eb0d676 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:17.004146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b1c59-943f-44c5-ae39-0b8be64bc8b7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:17.006456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:17.036329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5089b-1e0f-4c8d-861e-d896277ae93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:17.037090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5089b-1e0f-4c8d-861e-d896277ae93e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:17.037384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5089b-1e0f-4c8d-861e-d896277ae93e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:17.037670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5089b-1e0f-4c8d-861e-d896277ae93e None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:17.038534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5089b-1e0f-4c8d-861e-d896277ae93e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:17.038921 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5089b-1e0f-4c8d-861e-d896277ae93e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:17.040391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5089b-1e0f-4c8d-861e-d896277ae93e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:17.052432 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c66da4-842b-4182-bbe9-03c7f61e7a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:17.053455 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c66da4-842b-4182-bbe9-03c7f61e7a81 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:17.053879 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c66da4-842b-4182-bbe9-03c7f61e7a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:17.054284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c66da4-842b-4182-bbe9-03c7f61e7a81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:17.060598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 373/734] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:17.060598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375245cc-d9b7-41e8-b350-b53a5df3b2dd None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:17.060598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375245cc-d9b7-41e8-b350-b53a5df3b2dd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:17.060598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375245cc-d9b7-41e8-b350-b53a5df3b2dd None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:17.060598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 374/735] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:17.060598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375245cc-d9b7-41e8-b350-b53a5df3b2dd None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:17.075639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c66da4-842b-4182-bbe9-03c7f61e7a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-55c66da4-842b-4182-bbe9-03c7f61e7a81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:17.083575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:17.084664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:17.085503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:17.085503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:17.085503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:17.085503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:17.085503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:17.085503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:17.085503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:17.085503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:17.085503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:17.085503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:17.085503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:02:17.085503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:17.085503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 362/736] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:02:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:17.086186 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c66da4-842b-4182-bbe9-03c7f61e7a81 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:17.132585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:17.202338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375245cc-d9b7-41e8-b350-b53a5df3b2dd None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:17.221405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c66da4-842b-4182-bbe9-03c7f61e7a81 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:17.246480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad87207-a3e7-4250-9276-4a6ec92098d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:17.247256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad87207-a3e7-4250-9276-4a6ec92098d6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:17.247494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad87207-a3e7-4250-9276-4a6ec92098d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:17.247766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad87207-a3e7-4250-9276-4a6ec92098d6 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:17.248664 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad87207-a3e7-4250-9276-4a6ec92098d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:17.248972 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad87207-a3e7-4250-9276-4a6ec92098d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:17.250428 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad87207-a3e7-4250-9276-4a6ec92098d6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:17.261594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a5bdd-f765-448a-974e-e3cf7de3fc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:17.262469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a5bdd-f765-448a-974e-e3cf7de3fc56 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:17.262789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a5bdd-f765-448a-974e-e3cf7de3fc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:17.263067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a5bdd-f765-448a-974e-e3cf7de3fc56 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:17.269880 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 375/737] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jul 21 12:02:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:17.271424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a1f7c-4d35-4781-ada4-857a94755123 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:17.271972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a5bdd-f765-448a-974e-e3cf7de3fc56 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:17.272122 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a1f7c-4d35-4781-ada4-857a94755123 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:17.272122 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a1f7c-4d35-4781-ada4-857a94755123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:17.273167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a5bdd-f765-448a-974e-e3cf7de3fc56 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-604a5bdd-f765-448a-974e-e3cf7de3fc56 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:17.289016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:17.290993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:17.292826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:17.292826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:17.292826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:17.292826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:17.292826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:17.292826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:17.292826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:17.292826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:17.292826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 12:02:17.292826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:17.293839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ad2a1f7c-4d35-4781-ada4-857a94755123 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:17.293973 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 363/738] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jul 21 12:02:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:17.294113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ad2a1f7c-4d35-4781-ada4-857a94755123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:17.294245 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a5bdd-f765-448a-974e-e3cf7de3fc56 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:17.321271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:17.375277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 376/739] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:02:17.376742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc7a68-f9e7-4a04-ba2e-730aff9f6c3a None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:17.377092 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc7a68-f9e7-4a04-ba2e-730aff9f6c3a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:17.377430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc7a68-f9e7-4a04-ba2e-730aff9f6c3a None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:17.382724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 377/740] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:17.382724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc7a68-f9e7-4a04-ba2e-730aff9f6c3a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:17.422630 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a5bdd-f765-448a-974e-e3cf7de3fc56 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:17.436502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:17.466810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fd6d5-d638-4e8d-8a32-aa4ccb30a115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:17.467502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fd6d5-d638-4e8d-8a32-aa4ccb30a115 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:17.467781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fd6d5-d638-4e8d-8a32-aa4ccb30a115 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:17.468051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fd6d5-d638-4e8d-8a32-aa4ccb30a115 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:17.468802 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fd6d5-d638-4e8d-8a32-aa4ccb30a115 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:17.469102 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fd6d5-d638-4e8d-8a32-aa4ccb30a115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:17.470479 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fd6d5-d638-4e8d-8a32-aa4ccb30a115 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:17.484151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 364/741] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:02:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:17.485818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fd6d5-d638-4e8d-8a32-aa4ccb30a115 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:17.520787 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc7a68-f9e7-4a04-ba2e-730aff9f6c3a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:17.559036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c0a69-4753-466c-84a9-0e3681f3dd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:17.560203 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c0a69-4753-466c-84a9-0e3681f3dd6f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:17.560203 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c0a69-4753-466c-84a9-0e3681f3dd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:17.560203 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c0a69-4753-466c-84a9-0e3681f3dd6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:17.603640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:17.623005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fd6d5-d638-4e8d-8a32-aa4ccb30a115 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:17.657977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c0a69-4753-466c-84a9-0e3681f3dd6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:17.659678 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c0a69-4753-466c-84a9-0e3681f3dd6f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:17.663695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb1fef-2e70-42e2-a324-a00049f7b1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:17.664870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb1fef-2e70-42e2-a324-a00049f7b1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:17.665381 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb1fef-2e70-42e2-a324-a00049f7b1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:17.665871 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb1fef-2e70-42e2-a324-a00049f7b1f7 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:17.667443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb1fef-2e70-42e2-a324-a00049f7b1f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:17.667765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb1fef-2e70-42e2-a324-a00049f7b1f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:17.670048 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb1fef-2e70-42e2-a324-a00049f7b1f7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:17.703011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 365/742] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jul 21 12:02:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:17.704553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0832d-34aa-4d74-a70f-cedaf52bf0a1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:17.704848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0832d-34aa-4d74-a70f-cedaf52bf0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:17.705130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0832d-34aa-4d74-a70f-cedaf52bf0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:17.713917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:17.725357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-29f0832d-34aa-4d74-a70f-cedaf52bf0a1 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:17.726584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-29f0832d-34aa-4d74-a70f-cedaf52bf0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:17.796884 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 378/743] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:02:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:02:17.798131 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c0a69-4753-466c-84a9-0e3681f3dd6f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:17.819953 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 366/744] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 12:02:17.820941 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0832d-34aa-4d74-a70f-cedaf52bf0a1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:17.919175 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:17.950105 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c0a69-4753-466c-84a9-0e3681f3dd6f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:17.968455 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0832d-34aa-4d74-a70f-cedaf52bf0a1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:17.988151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c022b-0b45-4006-8d16-c37f42a32a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:17.989309 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c022b-0b45-4006-8d16-c37f42a32a5d None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:17.989801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c022b-0b45-4006-8d16-c37f42a32a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:17.990304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c022b-0b45-4006-8d16-c37f42a32a5d None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:17.991696 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c022b-0b45-4006-8d16-c37f42a32a5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:17.994339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c022b-0b45-4006-8d16-c37f42a32a5d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:18.010050 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:18.019318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 379/745] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jul 21 12:02:17 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:02:18.020305 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c022b-0b45-4006-8d16-c37f42a32a5d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:18.029468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff99db1-61b9-4d6d-9330-35b5cbfdea88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:18.030923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff99db1-61b9-4d6d-9330-35b5cbfdea88 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:18.031195 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff99db1-61b9-4d6d-9330-35b5cbfdea88 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:18.031494 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff99db1-61b9-4d6d-9330-35b5cbfdea88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:18.046291 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff99db1-61b9-4d6d-9330-35b5cbfdea88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:18.047891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff99db1-61b9-4d6d-9330-35b5cbfdea88 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-cff99db1-61b9-4d6d-9330-35b5cbfdea88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:18.067727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:18.068696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:18.070111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:18.070111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:18.070111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:18.070111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:18.070111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 367/746] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:18.070409 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff99db1-61b9-4d6d-9330-35b5cbfdea88 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:18.163453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c022b-0b45-4006-8d16-c37f42a32a5d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:18.205665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1969c-cc4e-4db5-8df9-9e3438f56386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:18.206980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1969c-cc4e-4db5-8df9-9e3438f56386 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:18.207481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1969c-cc4e-4db5-8df9-9e3438f56386 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:18.207979 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1969c-cc4e-4db5-8df9-9e3438f56386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:18.209478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff99db1-61b9-4d6d-9330-35b5cbfdea88 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:18.236911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:18.256026 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38297c6a-30ce-4d1d-8b98-25090fe33e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:18.257286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38297c6a-30ce-4d1d-8b98-25090fe33e16 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:18.257722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38297c6a-30ce-4d1d-8b98-25090fe33e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:18.258385 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38297c6a-30ce-4d1d-8b98-25090fe33e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:18.276666 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38297c6a-30ce-4d1d-8b98-25090fe33e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:18.278406 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38297c6a-30ce-4d1d-8b98-25090fe33e16 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-38297c6a-30ce-4d1d-8b98-25090fe33e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:18.306441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:18.307464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:18.308342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:18.308342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:18.308342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:18.308342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:18.308571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 368/747] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:18.310036 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38297c6a-30ce-4d1d-8b98-25090fe33e16 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:18.329592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:18.332769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1969c-cc4e-4db5-8df9-9e3438f56386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:18.334836 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1969c-cc4e-4db5-8df9-9e3438f56386 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:18.437843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38297c6a-30ce-4d1d-8b98-25090fe33e16 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:18.489857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bd654-349d-44f5-893d-eddc3434c002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:18.490997 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bd654-349d-44f5-893d-eddc3434c002 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:18.490997 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bd654-349d-44f5-893d-eddc3434c002 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:18.491337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bd654-349d-44f5-893d-eddc3434c002 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:18.491855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bd654-349d-44f5-893d-eddc3434c002 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:18.493392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bd654-349d-44f5-893d-eddc3434c002 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:18.499306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 380/748] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:02:18 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 12:02:18.500175 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1969c-cc4e-4db5-8df9-9e3438f56386 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:18.530691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 369/749] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jul 21 12:02:18 2022] POST /identity/v3/services => generated 240 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:02:18.530691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bd654-349d-44f5-893d-eddc3434c002 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:18.599640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:18.661404 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:18.668849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1969c-cc4e-4db5-8df9-9e3438f56386 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:18.702089 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bd654-349d-44f5-893d-eddc3434c002 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:18.741163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bb90c-cbaf-4d96-8d13-ca2db574572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:18.742320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bb90c-cbaf-4d96-8d13-ca2db574572f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:18.742596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bb90c-cbaf-4d96-8d13-ca2db574572f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:18.742909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bb90c-cbaf-4d96-8d13-ca2db574572f None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:18.743669 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bb90c-cbaf-4d96-8d13-ca2db574572f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:18.743982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bb90c-cbaf-4d96-8d13-ca2db574572f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:18.745389 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bb90c-cbaf-4d96-8d13-ca2db574572f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:18.758983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a1d41-9cd0-4b2d-8799-55b4111d30f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:18.759199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 381/750] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:18.760009 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bb90c-cbaf-4d96-8d13-ca2db574572f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:18.760415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a1d41-9cd0-4b2d-8799-55b4111d30f5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:18.760888 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a1d41-9cd0-4b2d-8799-55b4111d30f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:18.761349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a1d41-9cd0-4b2d-8799-55b4111d30f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:18.762300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a1d41-9cd0-4b2d-8799-55b4111d30f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:18.762848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a1d41-9cd0-4b2d-8799-55b4111d30f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:18.764610 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a1d41-9cd0-4b2d-8799-55b4111d30f5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:18.778943 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 370/751] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:18.780230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a1d41-9cd0-4b2d-8799-55b4111d30f5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:18.883437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bb90c-cbaf-4d96-8d13-ca2db574572f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:18.923059 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206aff2-2116-4011-8f1d-2ffee8750589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:18.924401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206aff2-2116-4011-8f1d-2ffee8750589 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:18.925019 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206aff2-2116-4011-8f1d-2ffee8750589 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:18.925643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206aff2-2116-4011-8f1d-2ffee8750589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:18.930337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:18.942039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206aff2-2116-4011-8f1d-2ffee8750589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:18.944584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206aff2-2116-4011-8f1d-2ffee8750589 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:18.945783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a1d41-9cd0-4b2d-8799-55b4111d30f5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f206aff2-2116-4011-8f1d-2ffee8750589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:18.965196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:18.966168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:18.967163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:18.967163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:18.967163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:18.967163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:18.975919 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 382/752] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:18.977421 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206aff2-2116-4011-8f1d-2ffee8750589 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:18.995422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b0dcf-24fb-4fd0-bb08-d3bc71b1a100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:18.995422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b0dcf-24fb-4fd0-bb08-d3bc71b1a100 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:18.995422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b0dcf-24fb-4fd0-bb08-d3bc71b1a100 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:18.995422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b0dcf-24fb-4fd0-bb08-d3bc71b1a100 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:19.004399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b0dcf-24fb-4fd0-bb08-d3bc71b1a100 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:19.006243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b0dcf-24fb-4fd0-bb08-d3bc71b1a100 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:19.007636 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-4a4b0dcf-24fb-4fd0-bb08-d3bc71b1a100 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:19.023939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:19.025000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:19.025950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:19.025950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:19.025950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:19.025950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:19.025950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:19.025950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:19.025950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:19.025950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:19.025950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:02:19.025950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:19.029800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 371/753] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jul 21 12:02:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:19.031570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b0dcf-24fb-4fd0-bb08-d3bc71b1a100 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:19.127164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206aff2-2116-4011-8f1d-2ffee8750589 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:19.168788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26cbfb-1ca9-4a6d-8236-c1666f8c05d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:19.169496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26cbfb-1ca9-4a6d-8236-c1666f8c05d4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:19.169837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26cbfb-1ca9-4a6d-8236-c1666f8c05d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:19.170117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26cbfb-1ca9-4a6d-8236-c1666f8c05d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:19.179048 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26cbfb-1ca9-4a6d-8236-c1666f8c05d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:19.180732 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26cbfb-1ca9-4a6d-8236-c1666f8c05d4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:19.191679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b0dcf-24fb-4fd0-bb08-d3bc71b1a100 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-8e26cbfb-1ca9-4a6d-8236-c1666f8c05d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:19.198822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:19.200942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:19.202616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:19.202616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:19.202616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:19.202616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:19.202616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:19.202616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:19.202616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:19.202616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:19.205418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 383/754] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:19.206440 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26cbfb-1ca9-4a6d-8236-c1666f8c05d4 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:19.264045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e450c36-47b4-4db6-ada4-2bf139c27eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:19.266512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450c36-47b4-4db6-ada4-2bf139c27eef None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:19.267449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450c36-47b4-4db6-ada4-2bf139c27eef None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:19.268258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450c36-47b4-4db6-ada4-2bf139c27eef None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:19.270080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e450c36-47b4-4db6-ada4-2bf139c27eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:19.271067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e450c36-47b4-4db6-ada4-2bf139c27eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:19.274081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e450c36-47b4-4db6-ada4-2bf139c27eef None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:19.292159 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:19.302692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 372/755] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:19.302692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e450c36-47b4-4db6-ada4-2bf139c27eef None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:19.313477 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:19.365149 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26cbfb-1ca9-4a6d-8236-c1666f8c05d4 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:19.433984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e450c36-47b4-4db6-ada4-2bf139c27eef None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:19.449714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c288f-f6b0-41f1-afc2-becf44c28e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:19.451651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c288f-f6b0-41f1-afc2-becf44c28e5c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:19.451651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c288f-f6b0-41f1-afc2-becf44c28e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:19.451651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c288f-f6b0-41f1-afc2-becf44c28e5c None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:19.452038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c288f-f6b0-41f1-afc2-becf44c28e5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:19.452327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c288f-f6b0-41f1-afc2-becf44c28e5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:19.453895 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c288f-f6b0-41f1-afc2-becf44c28e5c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:19.481945 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 384/756] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jul 21 12:02:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:19.483324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c288f-f6b0-41f1-afc2-becf44c28e5c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:19.529709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5096ad4-eab2-41f5-9316-46fde9cacc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:19.530889 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5096ad4-eab2-41f5-9316-46fde9cacc28 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:19.531386 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5096ad4-eab2-41f5-9316-46fde9cacc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:19.531866 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5096ad4-eab2-41f5-9316-46fde9cacc28 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:19.533340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5096ad4-eab2-41f5-9316-46fde9cacc28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:19.533870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5096ad4-eab2-41f5-9316-46fde9cacc28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:19.536693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5096ad4-eab2-41f5-9316-46fde9cacc28 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:19.566884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 373/757] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:19.566884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5096ad4-eab2-41f5-9316-46fde9cacc28 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:19.658197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c288f-f6b0-41f1-afc2-becf44c28e5c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:19.691934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:19.715109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:19.724867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64009fb0-05ad-4c80-a9e8-ca2048a4b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:19.726495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64009fb0-05ad-4c80-a9e8-ca2048a4b050 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:19.727233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64009fb0-05ad-4c80-a9e8-ca2048a4b050 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:19.727870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64009fb0-05ad-4c80-a9e8-ca2048a4b050 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:19.740045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64009fb0-05ad-4c80-a9e8-ca2048a4b050 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:19.742978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64009fb0-05ad-4c80-a9e8-ca2048a4b050 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:19.759268 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5096ad4-eab2-41f5-9316-46fde9cacc28 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-64009fb0-05ad-4c80-a9e8-ca2048a4b050 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:19.769220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:19.771197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:19.772973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:19.772973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:19.772973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:19.772973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:19.772973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:19.772973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:19.772973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:19.772973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:19.776551 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 385/758] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:19.778265 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64009fb0-05ad-4c80-a9e8-ca2048a4b050 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:19.820481 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44968e38-20b4-479a-9072-22dcbaf87f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:19.821739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968e38-20b4-479a-9072-22dcbaf87f36 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:19.822207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968e38-20b4-479a-9072-22dcbaf87f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:19.822695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968e38-20b4-479a-9072-22dcbaf87f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:19.845394 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44968e38-20b4-479a-9072-22dcbaf87f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:19.847928 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44968e38-20b4-479a-9072-22dcbaf87f36 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-44968e38-20b4-479a-9072-22dcbaf87f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:19.880348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:19.882284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:19.884138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:19.884138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:19.884138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:19.884138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:19.884138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 374/759] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:19.891487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44968e38-20b4-479a-9072-22dcbaf87f36 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:19.966962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64009fb0-05ad-4c80-a9e8-ca2048a4b050 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:20.027302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9c847-7fdf-4f8f-be75-ad485e0caa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:20.028809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9c847-7fdf-4f8f-be75-ad485e0caa57 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:20.029522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9c847-7fdf-4f8f-be75-ad485e0caa57 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:20.030167 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9c847-7fdf-4f8f-be75-ad485e0caa57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:20.031878 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9c847-7fdf-4f8f-be75-ad485e0caa57 None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=2dd659c33e0f49dc8edf30bd47737e70) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:20.032592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9c847-7fdf-4f8f-be75-ad485e0caa57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:20.035431 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9c847-7fdf-4f8f-be75-ad485e0caa57 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:20.051935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 386/760] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:02:19 2022] GET /identity/v3/role_assignments?user.id=2dd659c33e0f49dc8edf30bd47737e70&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:20.053851 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9c847-7fdf-4f8f-be75-ad485e0caa57 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:20.083189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44968e38-20b4-479a-9072-22dcbaf87f36 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:20.146374 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:20.187474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35867421-ef9d-4166-bc89-2a69c3bcf1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:20.188184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35867421-ef9d-4166-bc89-2a69c3bcf1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:20.188471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35867421-ef9d-4166-bc89-2a69c3bcf1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:20.188762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35867421-ef9d-4166-bc89-2a69c3bcf1f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:20.189595 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35867421-ef9d-4166-bc89-2a69c3bcf1f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:20.189909 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35867421-ef9d-4166-bc89-2a69c3bcf1f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:20.191458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35867421-ef9d-4166-bc89-2a69c3bcf1f2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:20.195215 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:20.237432 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 375/761] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:20.247502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35867421-ef9d-4166-bc89-2a69c3bcf1f2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:20.251245 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9c847-7fdf-4f8f-be75-ad485e0caa57 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:20.322171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe544d8-ced1-4d99-add0-5a4b278cef79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:20.324266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe544d8-ced1-4d99-add0-5a4b278cef79 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:20.324956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe544d8-ced1-4d99-add0-5a4b278cef79 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:20.325587 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe544d8-ced1-4d99-add0-5a4b278cef79 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:20.327693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe544d8-ced1-4d99-add0-5a4b278cef79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:20.328417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe544d8-ced1-4d99-add0-5a4b278cef79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:20.331666 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe544d8-ced1-4d99-add0-5a4b278cef79 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:20.359267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 387/762] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:20.370735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe544d8-ced1-4d99-add0-5a4b278cef79 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:20.466146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35867421-ef9d-4166-bc89-2a69c3bcf1f2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:20.600309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e3f33-a31e-42fa-90e2-49430b520dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:20.601461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e3f33-a31e-42fa-90e2-49430b520dda None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:20.601926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e3f33-a31e-42fa-90e2-49430b520dda None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:20.602427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e3f33-a31e-42fa-90e2-49430b520dda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:20.604094 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e3f33-a31e-42fa-90e2-49430b520dda None admin] RBAC: Adding query filter params (role.id=8fc2e732d1b54ac193720d2652101798, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=9410b04623a04e90ac47c4a53cd3c4e6) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:20.604657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e3f33-a31e-42fa-90e2-49430b520dda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:20.607480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e3f33-a31e-42fa-90e2-49430b520dda None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:20.645354 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 376/763] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:02:20 2022] GET /identity/v3/role_assignments?user.id=9410b04623a04e90ac47c4a53cd3c4e6&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=8fc2e732d1b54ac193720d2652101798 => generated 259 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:20.650337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe544d8-ced1-4d99-add0-5a4b278cef79 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:20.683094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:20.741125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4054e51-6aa0-4c66-aef4-628023371777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:20.742547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054e51-6aa0-4c66-aef4-628023371777 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:20.743064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054e51-6aa0-4c66-aef4-628023371777 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:20.743580 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054e51-6aa0-4c66-aef4-628023371777 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:20.760135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4054e51-6aa0-4c66-aef4-628023371777 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:20.763441 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4054e51-6aa0-4c66-aef4-628023371777 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c4054e51-6aa0-4c66-aef4-628023371777 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:20.791672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:20.792633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:20.793524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:20.793524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:20.793524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:20.793524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:20.793524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:20.793524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:20.793524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:20.793524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:20.794427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 388/764] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:20.800507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e3f33-a31e-42fa-90e2-49430b520dda None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:20.822681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1722a-7f59-4a68-a82f-2287f5709537 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:20.823191 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1722a-7f59-4a68-a82f-2287f5709537 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:20.823683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1722a-7f59-4a68-a82f-2287f5709537 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:20.827206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 389/765] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:20.833840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc07f0f-3f18-4b39-af69-1b5c72366872 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:20.834331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc07f0f-3f18-4b39-af69-1b5c72366872 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:20.834844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc07f0f-3f18-4b39-af69-1b5c72366872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:20.881465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6dc07f0f-3f18-4b39-af69-1b5c72366872 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:20.884002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6dc07f0f-3f18-4b39-af69-1b5c72366872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:20.936397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:21.068581 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 390/766] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:21.100844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc07f0f-3f18-4b39-af69-1b5c72366872 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:21.137093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e3f33-a31e-42fa-90e2-49430b520dda None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:21.251032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d137b-91af-446e-8900-27cc0b7806b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:21.252041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d137b-91af-446e-8900-27cc0b7806b7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:21.252542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d137b-91af-446e-8900-27cc0b7806b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:21.253033 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d137b-91af-446e-8900-27cc0b7806b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:21.254588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d137b-91af-446e-8900-27cc0b7806b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:21.255160 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d137b-91af-446e-8900-27cc0b7806b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:21.257904 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d137b-91af-446e-8900-27cc0b7806b7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:21.314897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 377/767] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 515 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:21.328470 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d137b-91af-446e-8900-27cc0b7806b7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:21.398644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc07f0f-3f18-4b39-af69-1b5c72366872 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:21.411221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:21.510920 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d30d3-ff7b-44f3-88ea-175a5070f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:21.512367 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d30d3-ff7b-44f3-88ea-175a5070f523 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:21.512896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d30d3-ff7b-44f3-88ea-175a5070f523 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:21.513450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d30d3-ff7b-44f3-88ea-175a5070f523 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:21.514777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d30d3-ff7b-44f3-88ea-175a5070f523 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:21.517402 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d30d3-ff7b-44f3-88ea-175a5070f523 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-355d30d3-ff7b-44f3-88ea-175a5070f523 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:21.545054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:21.546091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 12:02:21.546964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:21.547952 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 391/768] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Jul 21 12:02:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:21.556852 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d30d3-ff7b-44f3-88ea-175a5070f523 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:21.642713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d137b-91af-446e-8900-27cc0b7806b7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:21.645563 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:21.685430 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ed31e-5eb4-4ebd-92e0-13ebad4a3dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:21.685430 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ed31e-5eb4-4ebd-92e0-13ebad4a3dba None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:21.685430 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ed31e-5eb4-4ebd-92e0-13ebad4a3dba None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:21.685430 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ed31e-5eb4-4ebd-92e0-13ebad4a3dba None admin] PATH_INFO: `/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/f3fb1d091b27472081549f4166ca172f/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:21.686716 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ed31e-5eb4-4ebd-92e0-13ebad4a3dba None admin] RBAC: Authorizing `identity:create_grant(project_id=0946df6ba381401e8e4958d11c63cb2b, user_id=f3fb1d091b27472081549f4166ca172f, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:21.688208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ed31e-5eb4-4ebd-92e0-13ebad4a3dba None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:21.715048 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 378/769] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:02:21 2022] PUT /identity/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/f3fb1d091b27472081549f4166ca172f/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:02:21.716768 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7a21b-8e90-4660-aea1-23cc6cc3980e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:21.717105 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7a21b-8e90-4660-aea1-23cc6cc3980e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:21.717389 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7a21b-8e90-4660-aea1-23cc6cc3980e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:21.719173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 379/770] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:21.733651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09126e5e-7e69-4a51-90f1-a359dbbf5c27 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:21.733990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09126e5e-7e69-4a51-90f1-a359dbbf5c27 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:21.734216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09126e5e-7e69-4a51-90f1-a359dbbf5c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:21.759050 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d30d3-ff7b-44f3-88ea-175a5070f523 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:21.768870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-09126e5e-7e69-4a51-90f1-a359dbbf5c27 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:21.770090 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-09126e5e-7e69-4a51-90f1-a359dbbf5c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:21.833413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f62bf-b5b0-4ee3-8b1f-e600dc871a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:21.834779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f62bf-b5b0-4ee3-8b1f-e600dc871a62 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:21.835284 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f62bf-b5b0-4ee3-8b1f-e600dc871a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:21.835772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f62bf-b5b0-4ee3-8b1f-e600dc871a62 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:21.837086 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f62bf-b5b0-4ee3-8b1f-e600dc871a62 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:21.837695 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f62bf-b5b0-4ee3-8b1f-e600dc871a62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:21.840669 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f62bf-b5b0-4ee3-8b1f-e600dc871a62 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:21.850883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 392/771] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jul 21 12:02:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:21.863463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f62bf-b5b0-4ee3-8b1f-e600dc871a62 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:21.884279 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 380/772] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:21.907252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09126e5e-7e69-4a51-90f1-a359dbbf5c27 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:21.957813 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:22.140963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f62bf-b5b0-4ee3-8b1f-e600dc871a62 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:22.204830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda427b6-d7f4-417d-996a-b18a65da3bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:22.205688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda427b6-d7f4-417d-996a-b18a65da3bfb None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:22.206090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda427b6-d7f4-417d-996a-b18a65da3bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:22.206423 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda427b6-d7f4-417d-996a-b18a65da3bfb None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:22.207264 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda427b6-d7f4-417d-996a-b18a65da3bfb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:22.207651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda427b6-d7f4-417d-996a-b18a65da3bfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:22.209364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda427b6-d7f4-417d-996a-b18a65da3bfb None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:22.217981 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 393/773] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jul 21 12:02:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:22.224456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda427b6-d7f4-417d-996a-b18a65da3bfb None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:22.287083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:22.306064 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09126e5e-7e69-4a51-90f1-a359dbbf5c27 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:22.388627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80965cc-0dac-4eb3-81b4-8d4e548783bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:22.389458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80965cc-0dac-4eb3-81b4-8d4e548783bb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:22.389739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80965cc-0dac-4eb3-81b4-8d4e548783bb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:22.390010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80965cc-0dac-4eb3-81b4-8d4e548783bb None admin] PATH_INFO: `/v3/services/network` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:22.394711 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80965cc-0dac-4eb3-81b4-8d4e548783bb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:22.394711 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80965cc-0dac-4eb3-81b4-8d4e548783bb None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-f80965cc-0dac-4eb3-81b4-8d4e548783bb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:22.404995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:22.407437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:22.409375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 381/774] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:21 2022] GET /identity/v3/services/network => generated 88 bytes in 500 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:22.412618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80965cc-0dac-4eb3-81b4-8d4e548783bb None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:22.484105 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:22.506296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda427b6-d7f4-417d-996a-b18a65da3bfb None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:22.520084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80965cc-0dac-4eb3-81b4-8d4e548783bb None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:22.556836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45163259-2822-4cab-91ae-8d6c77a79fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:22.557529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45163259-2822-4cab-91ae-8d6c77a79fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:22.557864 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45163259-2822-4cab-91ae-8d6c77a79fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:22.558146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45163259-2822-4cab-91ae-8d6c77a79fa0 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:22.558912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45163259-2822-4cab-91ae-8d6c77a79fa0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:22.559225 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45163259-2822-4cab-91ae-8d6c77a79fa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:22.560647 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45163259-2822-4cab-91ae-8d6c77a79fa0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:22.566104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 382/775] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jul 21 12:02:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:22.571813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45163259-2822-4cab-91ae-8d6c77a79fa0 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:22.593588 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed188aa2-085f-4a54-9180-41a94119cb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:22.594394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed188aa2-085f-4a54-9180-41a94119cb77 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:22.594703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed188aa2-085f-4a54-9180-41a94119cb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:22.594984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed188aa2-085f-4a54-9180-41a94119cb77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:22.595820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed188aa2-085f-4a54-9180-41a94119cb77 None admin] RBAC: Adding query filter params (interface=public, service_id=707b8a596aed410f937b5c878fbc8475, region_id=RegionOne) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:22.596142 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed188aa2-085f-4a54-9180-41a94119cb77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:22.597744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed188aa2-085f-4a54-9180-41a94119cb77 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:22.608046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:22.627169 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 394/776] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jul 21 12:02:22 2022] GET /identity/v3/endpoints?service_id=707b8a596aed410f937b5c878fbc8475&interface=public®ion_id=RegionOne => generated 194 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:22.642637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed188aa2-085f-4a54-9180-41a94119cb77 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:22.698684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45163259-2822-4cab-91ae-8d6c77a79fa0 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:22.750801 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bb8b3-c108-4b50-94ea-fe5fe8b9bec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:22.750801 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bb8b3-c108-4b50-94ea-fe5fe8b9bec9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:22.750801 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bb8b3-c108-4b50-94ea-fe5fe8b9bec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:22.750801 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bb8b3-c108-4b50-94ea-fe5fe8b9bec9 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:22.751210 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bb8b3-c108-4b50-94ea-fe5fe8b9bec9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:22.751210 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bb8b3-c108-4b50-94ea-fe5fe8b9bec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:22.753635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bb8b3-c108-4b50-94ea-fe5fe8b9bec9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:22.759140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 383/777] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jul 21 12:02:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:22.768429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bb8b3-c108-4b50-94ea-fe5fe8b9bec9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:22.853875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed188aa2-085f-4a54-9180-41a94119cb77 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:22.881657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:22.891531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04a3e4-a59f-4115-b1cf-08dbb38b49bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:22.892226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04a3e4-a59f-4115-b1cf-08dbb38b49bb None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:22.892510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04a3e4-a59f-4115-b1cf-08dbb38b49bb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:22.892785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04a3e4-a59f-4115-b1cf-08dbb38b49bb None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:22.893495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04a3e4-a59f-4115-b1cf-08dbb38b49bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:22.894907 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04a3e4-a59f-4115-b1cf-08dbb38b49bb None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:22.899875 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bb8b3-c108-4b50-94ea-fe5fe8b9bec9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:22.901155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 395/778] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jul 21 12:02:22 2022] GET /identity/v3/services => generated 772 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:22.902598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b701d3-a4b4-45c5-a7a7-b0e4fd460e0b None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:22.903091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b701d3-a4b4-45c5-a7a7-b0e4fd460e0b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:22.903382 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b701d3-a4b4-45c5-a7a7-b0e4fd460e0b None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:22.909316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 396/779] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:22.911351 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20201dc-49cf-4779-9db9-af0ad317864c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:22.911650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20201dc-49cf-4779-9db9-af0ad317864c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:22.911935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20201dc-49cf-4779-9db9-af0ad317864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:22.939675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b20201dc-49cf-4779-9db9-af0ad317864c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:22.941344 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b20201dc-49cf-4779-9db9-af0ad317864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:22.993638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad17c6-f94d-47f5-9fbd-69a7ae67f059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:22.994440 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad17c6-f94d-47f5-9fbd-69a7ae67f059 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:22.994936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad17c6-f94d-47f5-9fbd-69a7ae67f059 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:22.995041 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:22.995417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad17c6-f94d-47f5-9fbd-69a7ae67f059 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:22.996345 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad17c6-f94d-47f5-9fbd-69a7ae67f059 None admin] RBAC: Adding query filter params (interface=public, service_id=7eac82d411ff428294870c8e3ebf8f7c, region_id=RegionOne) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:22.996695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad17c6-f94d-47f5-9fbd-69a7ae67f059 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:22.998988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad17c6-f94d-47f5-9fbd-69a7ae67f059 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:23.020215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 384/780] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jul 21 12:02:22 2022] GET /identity/v3/endpoints?service_id=7eac82d411ff428294870c8e3ebf8f7c&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:23.027769 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad17c6-f94d-47f5-9fbd-69a7ae67f059 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:23.141909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 397/781] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:23.175656 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20201dc-49cf-4779-9db9-af0ad317864c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:23.294605 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad17c6-f94d-47f5-9fbd-69a7ae67f059 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:23.352073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20201dc-49cf-4779-9db9-af0ad317864c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:23.367440 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11197330-8c8a-4138-941c-17813175a043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:23.369221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11197330-8c8a-4138-941c-17813175a043 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:23.369866 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11197330-8c8a-4138-941c-17813175a043 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:23.371861 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11197330-8c8a-4138-941c-17813175a043 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:23.372831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11197330-8c8a-4138-941c-17813175a043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:23.375279 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11197330-8c8a-4138-941c-17813175a043 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:23.387964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 385/782] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jul 21 12:02:23 2022] GET /identity/v3/services => generated 772 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:23.415602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dd40b-87ae-4ac6-a806-bbb40ef7087c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:23.416831 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dd40b-87ae-4ac6-a806-bbb40ef7087c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:23.417322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dd40b-87ae-4ac6-a806-bbb40ef7087c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:23.417776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dd40b-87ae-4ac6-a806-bbb40ef7087c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:23.436966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36dd40b-87ae-4ac6-a806-bbb40ef7087c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-a36dd40b-87ae-4ac6-a806-bbb40ef7087c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:23.463925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:23.465691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:23.467376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:23.467376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:23.467376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:23.467376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:23.467376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:23.467376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:23.467376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:23.467376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:23.467376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:23.467376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:23.467376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:02:23.467376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:23.475437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 398/783] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:02:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:23.479864 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11197330-8c8a-4138-941c-17813175a043 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:23.520480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:23.653986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11197330-8c8a-4138-941c-17813175a043 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:23.704459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884d1a6-528d-4d96-9b97-c120520eb8a3 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:23.705004 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884d1a6-528d-4d96-9b97-c120520eb8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:23.705382 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884d1a6-528d-4d96-9b97-c120520eb8a3 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:23.708356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 399/784] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:23.715595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc41ae-6360-442f-9ed5-4bc7a6dddbf4 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:23.715908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc41ae-6360-442f-9ed5-4bc7a6dddbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:23.716183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc41ae-6360-442f-9ed5-4bc7a6dddbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:23.725596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8489c0-63cb-4528-8df6-51e459fce1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:23.726483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8489c0-63cb-4528-8df6-51e459fce1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:23.726803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8489c0-63cb-4528-8df6-51e459fce1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:23.727232 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8489c0-63cb-4528-8df6-51e459fce1f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:23.728668 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8489c0-63cb-4528-8df6-51e459fce1f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:23.729175 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8489c0-63cb-4528-8df6-51e459fce1f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:23.732021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8489c0-63cb-4528-8df6-51e459fce1f9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:23.737667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-cadc41ae-6360-442f-9ed5-4bc7a6dddbf4 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:23.739848 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-cadc41ae-6360-442f-9ed5-4bc7a6dddbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:23.750131 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 386/785] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:02:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:23.756084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8489c0-63cb-4528-8df6-51e459fce1f9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:23.759196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:23.865096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 400/786] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:23.893853 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc41ae-6360-442f-9ed5-4bc7a6dddbf4 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:23.951174 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:24.021867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8489c0-63cb-4528-8df6-51e459fce1f9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:24.071581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad209c-b1da-4c4e-8505-9e9b88f05929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:24.072632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad209c-b1da-4c4e-8505-9e9b88f05929 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:24.072912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad209c-b1da-4c4e-8505-9e9b88f05929 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:24.073185 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad209c-b1da-4c4e-8505-9e9b88f05929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:24.093226 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad209c-b1da-4c4e-8505-9e9b88f05929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:24.096291 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad209c-b1da-4c4e-8505-9e9b88f05929 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:24.097839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc41ae-6360-442f-9ed5-4bc7a6dddbf4 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-10ad209c-b1da-4c4e-8505-9e9b88f05929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:24.134206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:24.135206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:24.136100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:24.136100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:24.136100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:24.136100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:24.138617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 387/787] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:24.149796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad209c-b1da-4c4e-8505-9e9b88f05929 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:24.161226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873ebd8-a848-447f-93e4-645bed49fffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:24.164006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873ebd8-a848-447f-93e4-645bed49fffb None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:24.164536 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873ebd8-a848-447f-93e4-645bed49fffb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:24.165033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873ebd8-a848-447f-93e4-645bed49fffb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:24.185596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873ebd8-a848-447f-93e4-645bed49fffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-b873ebd8-a848-447f-93e4-645bed49fffb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:24.196157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:24.197147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:24.198252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:24.198252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:24.198252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:24.198252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:24.198252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:24.198252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:24.198252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:24.198252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:24.198252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:24.198252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:24.198252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:24.198252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:24.198252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 401/788] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:02:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:24.208223 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873ebd8-a848-447f-93e4-645bed49fffb None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:24.228259 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:24.361994 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad209c-b1da-4c4e-8505-9e9b88f05929 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:24.417551 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873ebd8-a848-447f-93e4-645bed49fffb None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:24.423034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:24.439738 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5babb57-5833-4443-b67d-4a524cb543f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:24.440441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5babb57-5833-4443-b67d-4a524cb543f3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:24.440724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5babb57-5833-4443-b67d-4a524cb543f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:24.441000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5babb57-5833-4443-b67d-4a524cb543f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:24.441765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5babb57-5833-4443-b67d-4a524cb543f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:24.442076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5babb57-5833-4443-b67d-4a524cb543f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:24.445656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5babb57-5833-4443-b67d-4a524cb543f3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:24.475270 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 388/789] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:24.483913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5babb57-5833-4443-b67d-4a524cb543f3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:24.489941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79c497-3768-4200-8bab-dd1dd7b70752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:24.491025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79c497-3768-4200-8bab-dd1dd7b70752 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:24.491523 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79c497-3768-4200-8bab-dd1dd7b70752 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:24.491983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79c497-3768-4200-8bab-dd1dd7b70752 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:24.493060 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79c497-3768-4200-8bab-dd1dd7b70752 None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:24.493587 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79c497-3768-4200-8bab-dd1dd7b70752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:24.495309 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79c497-3768-4200-8bab-dd1dd7b70752 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:24.505278 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 402/790] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:02:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:24.510546 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79c497-3768-4200-8bab-dd1dd7b70752 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:24.596868 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:24.636619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79c497-3768-4200-8bab-dd1dd7b70752 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:24.649011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5babb57-5833-4443-b67d-4a524cb543f3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:24.674736 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449abf7-0de1-4622-b271-265f50151758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:24.675979 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449abf7-0de1-4622-b271-265f50151758 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:24.676496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449abf7-0de1-4622-b271-265f50151758 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:24.676962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449abf7-0de1-4622-b271-265f50151758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:24.689636 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449abf7-0de1-4622-b271-265f50151758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:24.692265 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449abf7-0de1-4622-b271-265f50151758 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:24.696551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ee9c0-cba1-44eb-8691-c0c519690275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:24.697400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee9c0-cba1-44eb-8691-c0c519690275 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:24.697685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee9c0-cba1-44eb-8691-c0c519690275 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:24.697958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee9c0-cba1-44eb-8691-c0c519690275 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:24.708277 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ee9c0-cba1-44eb-8691-c0c519690275 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:24.709740 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ee9c0-cba1-44eb-8691-c0c519690275 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-4449abf7-0de1-4622-b271-265f50151758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:24.714766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:24.715978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:24.717074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:24.717074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:24.717074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:24.717074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:24.719485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 403/791] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:24.721115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31b36-ac9c-49c8-8a36-c190b497aaf8 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:24.721646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31b36-ac9c-49c8-8a36-c190b497aaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:24.722110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31b36-ac9c-49c8-8a36-c190b497aaf8 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:24.723975 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 404/792] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-a87ee9c0-cba1-44eb-8691-c0c519690275 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:24.730577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:24.731982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:24.732921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:24.732921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:24.732921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:24.732921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:24.732921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:24.732921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:24.732921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:24.732921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:24.732921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 12:02:24.732921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:24.732921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 389/793] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:02:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:24.735089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d31b36-ac9c-49c8-8a36-c190b497aaf8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:24.738314 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ee9c0-cba1-44eb-8691-c0c519690275 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:24.807022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:24.880355 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ee9c0-cba1-44eb-8691-c0c519690275 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:24.888285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d31b36-ac9c-49c8-8a36-c190b497aaf8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:24.909085 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:24.927693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04711a14-7194-4428-9737-2880f129f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:24.928492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711a14-7194-4428-9737-2880f129f077 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:24.928772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711a14-7194-4428-9737-2880f129f077 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:24.929043 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711a14-7194-4428-9737-2880f129f077 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:24.930021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04711a14-7194-4428-9737-2880f129f077 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:24.930331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04711a14-7194-4428-9737-2880f129f077 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:24.931813 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346dc07-b35d-4a4c-b97c-a1daecb4ab01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:24.931987 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04711a14-7194-4428-9737-2880f129f077 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:24.932909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346dc07-b35d-4a4c-b97c-a1daecb4ab01 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:24.933396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346dc07-b35d-4a4c-b97c-a1daecb4ab01 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:24.934004 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346dc07-b35d-4a4c-b97c-a1daecb4ab01 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:24.935287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346dc07-b35d-4a4c-b97c-a1daecb4ab01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:24.935846 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346dc07-b35d-4a4c-b97c-a1daecb4ab01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:24.937609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346dc07-b35d-4a4c-b97c-a1daecb4ab01 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:24.959059 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 390/794] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jul 21 12:02:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:24.960942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15539e0c-94e2-472e-bd01-4b81e6c21398 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:24.961516 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15539e0c-94e2-472e-bd01-4b81e6c21398 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:24.962057 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15539e0c-94e2-472e-bd01-4b81e6c21398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:24.962297 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 405/795] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:24.963365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346dc07-b35d-4a4c-b97c-a1daecb4ab01 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:24.983538 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-15539e0c-94e2-472e-bd01-4b81e6c21398 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:24.985103 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-15539e0c-94e2-472e-bd01-4b81e6c21398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:25.071094 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 391/796] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:25.072587 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15539e0c-94e2-472e-bd01-4b81e6c21398 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:25.103628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346dc07-b35d-4a4c-b97c-a1daecb4ab01 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:25.138864 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:25.142424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218e49f-d8e2-451a-ab82-25cd1338c09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:25.143394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218e49f-d8e2-451a-ab82-25cd1338c09b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:25.143678 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218e49f-d8e2-451a-ab82-25cd1338c09b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:25.143952 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218e49f-d8e2-451a-ab82-25cd1338c09b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:25.153201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218e49f-d8e2-451a-ab82-25cd1338c09b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:25.154737 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218e49f-d8e2-451a-ab82-25cd1338c09b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-2218e49f-d8e2-451a-ab82-25cd1338c09b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:25.171800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:25.173626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:25.174589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:25.174589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:25.174589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:25.174589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:25.174589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:25.174589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:25.174589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:25.174589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:25.174589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 12:02:25.174589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:25.174589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 406/797] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jul 21 12:02:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:25.175211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218e49f-d8e2-451a-ab82-25cd1338c09b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:25.230681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:25.236609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15539e0c-94e2-472e-bd01-4b81e6c21398 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:25.291208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65931c01-fc48-4d42-aa7b-54e880ce8b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:25.292399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931c01-fc48-4d42-aa7b-54e880ce8b8d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:25.292697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931c01-fc48-4d42-aa7b-54e880ce8b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:25.292978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931c01-fc48-4d42-aa7b-54e880ce8b8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:25.308242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65931c01-fc48-4d42-aa7b-54e880ce8b8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:25.309762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65931c01-fc48-4d42-aa7b-54e880ce8b8d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:25.326138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218e49f-d8e2-451a-ab82-25cd1338c09b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-65931c01-fc48-4d42-aa7b-54e880ce8b8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:25.335399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:25.336597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:25.338323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:25.338323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:25.338323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:25.338323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:25.338323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 392/798] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:25.338323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65931c01-fc48-4d42-aa7b-54e880ce8b8d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:25.400008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f2cb3-eb73-4dd0-89c1-b1268d81a3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:25.402801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f2cb3-eb73-4dd0-89c1-b1268d81a3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:25.404295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f2cb3-eb73-4dd0-89c1-b1268d81a3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:25.405053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f2cb3-eb73-4dd0-89c1-b1268d81a3c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:25.427800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f2cb3-eb73-4dd0-89c1-b1268d81a3c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-045f2cb3-eb73-4dd0-89c1-b1268d81a3c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:25.440867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:25.442444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:25.451617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:25.451617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:25.451617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:25.451617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:25.451617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:25.451617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:25.451617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:25.451617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:25.451617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:25.451617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:25.451617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:02:25.451617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:25.451617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 407/799] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:02:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:25.451617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f2cb3-eb73-4dd0-89c1-b1268d81a3c5 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:25.473732 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:25.495451 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65931c01-fc48-4d42-aa7b-54e880ce8b8d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:25.565753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8caa23-4713-43a0-b3bf-b816fdef716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:25.566853 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8caa23-4713-43a0-b3bf-b816fdef716a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:25.567437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8caa23-4713-43a0-b3bf-b816fdef716a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:25.568567 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8caa23-4713-43a0-b3bf-b816fdef716a None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:25.570632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8caa23-4713-43a0-b3bf-b816fdef716a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:25.571175 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8caa23-4713-43a0-b3bf-b816fdef716a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:25.575130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8caa23-4713-43a0-b3bf-b816fdef716a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:25.593639 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:25.599439 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f2cb3-eb73-4dd0-89c1-b1268d81a3c5 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:25.618015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 393/800] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jul 21 12:02:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:25.618015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22d539-9f3e-4f9b-9ff5-9dc4564a636b None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:25.618015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22d539-9f3e-4f9b-9ff5-9dc4564a636b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:25.618015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22d539-9f3e-4f9b-9ff5-9dc4564a636b None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:25.619589 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 394/801] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:25.620819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22d539-9f3e-4f9b-9ff5-9dc4564a636b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:25.649698 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06503f4-a8e6-4083-b5f1-afb2a695e383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:25.650712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06503f4-a8e6-4083-b5f1-afb2a695e383 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:25.650996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06503f4-a8e6-4083-b5f1-afb2a695e383 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:25.651267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06503f4-a8e6-4083-b5f1-afb2a695e383 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:25.652012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06503f4-a8e6-4083-b5f1-afb2a695e383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:25.652501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06503f4-a8e6-4083-b5f1-afb2a695e383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:25.654272 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06503f4-a8e6-4083-b5f1-afb2a695e383 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:25.674698 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 408/802] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:25.674698 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06503f4-a8e6-4083-b5f1-afb2a695e383 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:25.778056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22d539-9f3e-4f9b-9ff5-9dc4564a636b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:25.828599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba302da-5239-40ed-a9e3-5736824a2db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:25.829660 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba302da-5239-40ed-a9e3-5736824a2db5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:25.830113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba302da-5239-40ed-a9e3-5736824a2db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:25.830516 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba302da-5239-40ed-a9e3-5736824a2db5 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:25.831675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba302da-5239-40ed-a9e3-5736824a2db5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:25.832069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba302da-5239-40ed-a9e3-5736824a2db5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:25.833948 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba302da-5239-40ed-a9e3-5736824a2db5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:25.839520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06503f4-a8e6-4083-b5f1-afb2a695e383 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:25.845151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 395/803] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:02:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:25.849656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd235814-cf7c-49f8-a65a-afe4dcf9062e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:25.850695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd235814-cf7c-49f8-a65a-afe4dcf9062e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:25.851453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd235814-cf7c-49f8-a65a-afe4dcf9062e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:25.872396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fd235814-cf7c-49f8-a65a-afe4dcf9062e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:25.874043 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fd235814-cf7c-49f8-a65a-afe4dcf9062e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:25.877116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:25.915199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f4dae-da01-4b7a-a6e9-2e2501975f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:25.916700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f4dae-da01-4b7a-a6e9-2e2501975f9f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:25.917204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f4dae-da01-4b7a-a6e9-2e2501975f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:25.917678 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f4dae-da01-4b7a-a6e9-2e2501975f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:25.937057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f4dae-da01-4b7a-a6e9-2e2501975f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:25.939373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f4dae-da01-4b7a-a6e9-2e2501975f9f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:25.974703 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 396/804] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:25.974703 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd235814-cf7c-49f8-a65a-afe4dcf9062e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-3f8f4dae-da01-4b7a-a6e9-2e2501975f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:25.975129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:25.976683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:25.978370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:25.978370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:25.978370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:25.978370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:25.978370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 409/805] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:25.978370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f4dae-da01-4b7a-a6e9-2e2501975f9f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:26.007208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:26.141935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd235814-cf7c-49f8-a65a-afe4dcf9062e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:26.151399 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f4dae-da01-4b7a-a6e9-2e2501975f9f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:26.186135 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270296fd-ef9b-424f-b9e4-9db750718a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:26.186988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270296fd-ef9b-424f-b9e4-9db750718a38 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:26.187263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270296fd-ef9b-424f-b9e4-9db750718a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:26.187540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270296fd-ef9b-424f-b9e4-9db750718a38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:26.195421 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270296fd-ef9b-424f-b9e4-9db750718a38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:26.196905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270296fd-ef9b-424f-b9e4-9db750718a38 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:26.199554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:26.211687 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257c18c-5c76-4871-a161-aec52733d5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:26.212866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257c18c-5c76-4871-a161-aec52733d5dc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:26.213361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257c18c-5c76-4871-a161-aec52733d5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:26.213859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257c18c-5c76-4871-a161-aec52733d5dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-270296fd-ef9b-424f-b9e4-9db750718a38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:26.214896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:26.216327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:26.218733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:26.218733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:26.218733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:26.218733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:26.218733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:26.218733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:26.218733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:26.218733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:26.221111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 397/806] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:26.222075 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270296fd-ef9b-424f-b9e4-9db750718a38 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:26.237069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257c18c-5c76-4871-a161-aec52733d5dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:26.239756 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257c18c-5c76-4871-a161-aec52733d5dc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f257c18c-5c76-4871-a161-aec52733d5dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:26.273222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:26.275127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:26.277081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:26.277081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:26.277081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:26.277081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:26.277081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 410/807] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:26.277081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257c18c-5c76-4871-a161-aec52733d5dc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:26.348382 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:26.367550 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270296fd-ef9b-424f-b9e4-9db750718a38 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:26.402116 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257c18c-5c76-4871-a161-aec52733d5dc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:26.406280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcd3cb-fc94-4b92-b578-0497e03557ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:26.406991 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcd3cb-fc94-4b92-b578-0497e03557ef None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:26.407276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcd3cb-fc94-4b92-b578-0497e03557ef None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:26.407556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcd3cb-fc94-4b92-b578-0497e03557ef None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:26.408310 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcd3cb-fc94-4b92-b578-0497e03557ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:26.408621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcd3cb-fc94-4b92-b578-0497e03557ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:26.410016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcd3cb-fc94-4b92-b578-0497e03557ef None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:26.423544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 398/808] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:26.424441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcd3cb-fc94-4b92-b578-0497e03557ef None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:26.444099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e236c95-8b80-401e-9b73-4b951e7a18fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:26.444950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e236c95-8b80-401e-9b73-4b951e7a18fe None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:26.445232 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e236c95-8b80-401e-9b73-4b951e7a18fe None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:26.445509 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e236c95-8b80-401e-9b73-4b951e7a18fe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:26.446201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e236c95-8b80-401e-9b73-4b951e7a18fe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:26.447657 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e236c95-8b80-401e-9b73-4b951e7a18fe None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-5e236c95-8b80-401e-9b73-4b951e7a18fe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:26.461385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:26.462562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:26.463453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 411/809] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Jul 21 12:02:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:26.464475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e236c95-8b80-401e-9b73-4b951e7a18fe None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:26.521813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:26.574217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcd3cb-fc94-4b92-b578-0497e03557ef None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:26.599245 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e236c95-8b80-401e-9b73-4b951e7a18fe None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:26.613321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a57e97-873f-4ff9-8669-3e41f8d90faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:26.614001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a57e97-873f-4ff9-8669-3e41f8d90faf None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:26.614278 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a57e97-873f-4ff9-8669-3e41f8d90faf None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:26.614560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a57e97-873f-4ff9-8669-3e41f8d90faf None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:26.615387 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a57e97-873f-4ff9-8669-3e41f8d90faf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:26.615692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a57e97-873f-4ff9-8669-3e41f8d90faf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:26.617156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a57e97-873f-4ff9-8669-3e41f8d90faf None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:26.629366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:26.630348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 399/810] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:26.631540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b7a57-dfcf-4623-bfcb-4e4723030235 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:26.631767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b7a57-dfcf-4623-bfcb-4e4723030235 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:26.632069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b7a57-dfcf-4623-bfcb-4e4723030235 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:26.638895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 400/811] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:26.638895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b7a57-dfcf-4623-bfcb-4e4723030235 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:26.645555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9565f92-acc6-4288-a62d-b88409613a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:26.646730 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565f92-acc6-4288-a62d-b88409613a13 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:26.647221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565f92-acc6-4288-a62d-b88409613a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:26.647696 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565f92-acc6-4288-a62d-b88409613a13 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:26.649051 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9565f92-acc6-4288-a62d-b88409613a13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:26.649579 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9565f92-acc6-4288-a62d-b88409613a13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:26.651875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9565f92-acc6-4288-a62d-b88409613a13 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:26.665037 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 412/812] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:26.666206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9565f92-acc6-4288-a62d-b88409613a13 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:26.771388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b7a57-dfcf-4623-bfcb-4e4723030235 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:26.785477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9565f92-acc6-4288-a62d-b88409613a13 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:26.794698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:26.815664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237abdf4-4e52-4cee-8828-db931903ca9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:26.816477 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237abdf4-4e52-4cee-8828-db931903ca9a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:26.816762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237abdf4-4e52-4cee-8828-db931903ca9a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:26.817040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237abdf4-4e52-4cee-8828-db931903ca9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:26.824245 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdaa50-d457-43f7-a363-1c6d8cdbd8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:26.824915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdaa50-d457-43f7-a363-1c6d8cdbd8cd None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:26.825075 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237abdf4-4e52-4cee-8828-db931903ca9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:26.825231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdaa50-d457-43f7-a363-1c6d8cdbd8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:26.825530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdaa50-d457-43f7-a363-1c6d8cdbd8cd None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:26.826198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdaa50-d457-43f7-a363-1c6d8cdbd8cd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:26.826447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237abdf4-4e52-4cee-8828-db931903ca9a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:26.826600 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdaa50-d457-43f7-a363-1c6d8cdbd8cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:26.827894 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdaa50-d457-43f7-a363-1c6d8cdbd8cd None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:26.832996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 413/813] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jul 21 12:02:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:26.833817 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdaa50-d457-43f7-a363-1c6d8cdbd8cd None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-237abdf4-4e52-4cee-8828-db931903ca9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:26.850526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:26.851624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:26.852521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:26.852521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:26.852521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:26.852521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:26.852521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:26.852521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:26.852521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:26.852521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:26.858086 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 401/814] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:26.858086 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dc244-ef3b-4474-a1ea-1a140d785f9b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:26.858086 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dc244-ef3b-4474-a1ea-1a140d785f9b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:26.858086 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dc244-ef3b-4474-a1ea-1a140d785f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:26.878966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e00dc244-ef3b-4474-a1ea-1a140d785f9b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:26.880196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e00dc244-ef3b-4474-a1ea-1a140d785f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:26.893844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:26.962470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdaa50-d457-43f7-a363-1c6d8cdbd8cd None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:26.964875 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 402/815] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:26.965972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00dc244-ef3b-4474-a1ea-1a140d785f9b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:27.026996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b7915-94dc-4739-9804-97f6ad9e68e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:27.027919 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b7915-94dc-4739-9804-97f6ad9e68e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:27.028202 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b7915-94dc-4739-9804-97f6ad9e68e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:27.028470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b7915-94dc-4739-9804-97f6ad9e68e1 None admin] PATH_INFO: `/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/2dd659c33e0f49dc8edf30bd47737e70/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:27.030836 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b7915-94dc-4739-9804-97f6ad9e68e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0946df6ba381401e8e4958d11c63cb2b, user_id=2dd659c33e0f49dc8edf30bd47737e70, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:27.032315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b7915-94dc-4739-9804-97f6ad9e68e1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:27.048156 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 414/816] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:02:26 2022] PUT /identity/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/2dd659c33e0f49dc8edf30bd47737e70/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:02:27.049060 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b7915-94dc-4739-9804-97f6ad9e68e1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:27.136446 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00dc244-ef3b-4474-a1ea-1a140d785f9b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:27.154362 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:27.194040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97887813-8fec-4673-ab8c-37f6465bb504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:27.196123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97887813-8fec-4673-ab8c-37f6465bb504 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:27.196621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97887813-8fec-4673-ab8c-37f6465bb504 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:27.197654 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97887813-8fec-4673-ab8c-37f6465bb504 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:27.204209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b7915-94dc-4739-9804-97f6ad9e68e1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:27.221683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:27.221939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97887813-8fec-4673-ab8c-37f6465bb504 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:27.221939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97887813-8fec-4673-ab8c-37f6465bb504 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:27.249906 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec36617-61b4-46ce-be8a-b690f90ecc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:27.250581 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec36617-61b4-46ce-be8a-b690f90ecc50 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:27.250909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec36617-61b4-46ce-be8a-b690f90ecc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:27.251180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec36617-61b4-46ce-be8a-b690f90ecc50 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-97887813-8fec-4673-ab8c-37f6465bb504 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:27.251335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:27.252220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:27.253184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:27.253184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:27.253184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:27.253184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:27.253184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:27.253184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:27.253184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:27.253184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:27.253184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:02:27.253184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:27.253719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec36617-61b4-46ce-be8a-b690f90ecc50 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:27.253719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec36617-61b4-46ce-be8a-b690f90ecc50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:27.253719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec36617-61b4-46ce-be8a-b690f90ecc50 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:27.253906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 403/817] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jul 21 12:02:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:27.255285 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97887813-8fec-4673-ab8c-37f6465bb504 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:27.260973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 415/818] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jul 21 12:02:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:27.262403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec36617-61b4-46ce-be8a-b690f90ecc50 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:27.417692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97887813-8fec-4673-ab8c-37f6465bb504 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:27.434768 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec36617-61b4-46ce-be8a-b690f90ecc50 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:27.498252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c0c42-5367-49f9-adfc-d93e649a5653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:27.499327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c0c42-5367-49f9-adfc-d93e649a5653 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:27.499808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c0c42-5367-49f9-adfc-d93e649a5653 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:27.500581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c0c42-5367-49f9-adfc-d93e649a5653 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:27.502332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c0c42-5367-49f9-adfc-d93e649a5653 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:27.502945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c0c42-5367-49f9-adfc-d93e649a5653 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:27.505409 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c0c42-5367-49f9-adfc-d93e649a5653 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:27.520226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a2790-04cc-44a9-8094-f85f2e8a5478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:27.522079 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a2790-04cc-44a9-8094-f85f2e8a5478 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:27.522844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a2790-04cc-44a9-8094-f85f2e8a5478 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:27.523554 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a2790-04cc-44a9-8094-f85f2e8a5478 None admin] PATH_INFO: `/v3/services/network` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:27.524950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a2790-04cc-44a9-8094-f85f2e8a5478 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:27.528377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a2790-04cc-44a9-8094-f85f2e8a5478 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:27.528970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 404/819] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:27.530310 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c0c42-5367-49f9-adfc-d93e649a5653 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-5f7a2790-04cc-44a9-8094-f85f2e8a5478 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:27.555923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:27.557856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:27.559495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:27.559495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:27.559495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:27.559495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:27.559495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:27.559495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:27.559495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:27.559495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:27.559495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:27.559495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:27.559495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:27.559495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:27.559495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 12:02:27.559495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:27.564718 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 416/820] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:27 2022] GET /identity/v3/services/network => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:27.566473 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a2790-04cc-44a9-8094-f85f2e8a5478 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:27.593606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:27.636118 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:27.744571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a2790-04cc-44a9-8094-f85f2e8a5478 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:27.745796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c0c42-5367-49f9-adfc-d93e649a5653 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:27.815747 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d37f08-b419-44e2-ba09-03c60dfe6002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:27.816600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7769d-7d53-4b2e-aae3-8cd19b322fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:27.817342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d37f08-b419-44e2-ba09-03c60dfe6002 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:27.817342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d37f08-b419-44e2-ba09-03c60dfe6002 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:27.817585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d37f08-b419-44e2-ba09-03c60dfe6002 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:27.817829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7769d-7d53-4b2e-aae3-8cd19b322fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:27.818273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7769d-7d53-4b2e-aae3-8cd19b322fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:27.822718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7769d-7d53-4b2e-aae3-8cd19b322fc3 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:27.822896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d37f08-b419-44e2-ba09-03c60dfe6002 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:27.823004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7769d-7d53-4b2e-aae3-8cd19b322fc3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:27.823004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7769d-7d53-4b2e-aae3-8cd19b322fc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:27.823135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d37f08-b419-44e2-ba09-03c60dfe6002 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:27.823437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7769d-7d53-4b2e-aae3-8cd19b322fc3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:27.863578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 405/821] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jul 21 12:02:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:27.865469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7769d-7d53-4b2e-aae3-8cd19b322fc3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:27.878693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 417/822] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jul 21 12:02:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:02:27.878693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d37f08-b419-44e2-ba09-03c60dfe6002 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:28.121865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:28.136447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:28.155938 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7769d-7d53-4b2e-aae3-8cd19b322fc3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:28.157231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d37f08-b419-44e2-ba09-03c60dfe6002 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:28.205576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10407577-ce76-414d-b4a7-6bde96cc800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:28.206502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407577-ce76-414d-b4a7-6bde96cc800e None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:28.206953 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407577-ce76-414d-b4a7-6bde96cc800e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:28.207234 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407577-ce76-414d-b4a7-6bde96cc800e None admin] PATH_INFO: `/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/9410b04623a04e90ac47c4a53cd3c4e6/roles/8fc2e732d1b54ac193720d2652101798` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:28.209956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f35df5-dfa1-4610-a546-baf3fc5f317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:28.210718 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f35df5-dfa1-4610-a546-baf3fc5f317b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:28.211002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f35df5-dfa1-4610-a546-baf3fc5f317b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:28.211292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f35df5-dfa1-4610-a546-baf3fc5f317b None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:28.212022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f35df5-dfa1-4610-a546-baf3fc5f317b None admin] RBAC: Adding query filter params (name=network) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:28.212376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f35df5-dfa1-4610-a546-baf3fc5f317b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:28.213780 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f35df5-dfa1-4610-a546-baf3fc5f317b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:28.219463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 418/823] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jul 21 12:02:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:28.225177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f35df5-dfa1-4610-a546-baf3fc5f317b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:28.228388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10407577-ce76-414d-b4a7-6bde96cc800e None admin] RBAC: Authorizing `identity:create_grant(project_id=0946df6ba381401e8e4958d11c63cb2b, user_id=9410b04623a04e90ac47c4a53cd3c4e6, role_id=8fc2e732d1b54ac193720d2652101798)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:28.231638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10407577-ce76-414d-b4a7-6bde96cc800e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:28.261088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 406/824] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:02:27 2022] PUT /identity/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/9410b04623a04e90ac47c4a53cd3c4e6/roles/8fc2e732d1b54ac193720d2652101798 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:02:28.265956 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10407577-ce76-414d-b4a7-6bde96cc800e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:28.421455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f35df5-dfa1-4610-a546-baf3fc5f317b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:28.499680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b870db3-166a-4eee-89db-80821c0bd06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:28.500368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b870db3-166a-4eee-89db-80821c0bd06f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:28.500653 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b870db3-166a-4eee-89db-80821c0bd06f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:28.500931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b870db3-166a-4eee-89db-80821c0bd06f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:28.537825 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10407577-ce76-414d-b4a7-6bde96cc800e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:28.564826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:28.582897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c5316-c2b5-4fe2-8e71-60fa975df063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:28.583602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c5316-c2b5-4fe2-8e71-60fa975df063 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:28.583931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c5316-c2b5-4fe2-8e71-60fa975df063 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:28.584214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c5316-c2b5-4fe2-8e71-60fa975df063 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:28.584967 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c5316-c2b5-4fe2-8e71-60fa975df063 None admin] RBAC: Adding query filter params (type=network) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:28.585275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c5316-c2b5-4fe2-8e71-60fa975df063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:28.586781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c5316-c2b5-4fe2-8e71-60fa975df063 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:28.589609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:28.597616 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 407/825] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jul 21 12:02:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:28.602062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c5316-c2b5-4fe2-8e71-60fa975df063 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:28.689285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b870db3-166a-4eee-89db-80821c0bd06f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:28.692944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b870db3-166a-4eee-89db-80821c0bd06f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:28.765146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c5316-c2b5-4fe2-8e71-60fa975df063 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:28.880110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7d74c-334a-4b23-9ab3-82bbdd0e37f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:28.881159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7d74c-334a-4b23-9ab3-82bbdd0e37f7 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:28.881159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7d74c-334a-4b23-9ab3-82bbdd0e37f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:28.881418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7d74c-334a-4b23-9ab3-82bbdd0e37f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:28.882125 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7d74c-334a-4b23-9ab3-82bbdd0e37f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:28.883877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7d74c-334a-4b23-9ab3-82bbdd0e37f7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:28.904634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 419/826] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:02:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:02:28.910594 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b870db3-166a-4eee-89db-80821c0bd06f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:28.951216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 408/827] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jul 21 12:02:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:02:29.049188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:29.159420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b870db3-166a-4eee-89db-80821c0bd06f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:29.230507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e4743-3a56-4ed1-95c0-786ec4756744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:29.232343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e4743-3a56-4ed1-95c0-786ec4756744 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:29.233158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e4743-3a56-4ed1-95c0-786ec4756744 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:29.233874 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e4743-3a56-4ed1-95c0-786ec4756744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:29.263093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1616f-d38a-4900-8e20-e6f61231d913 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:29.263929 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1616f-d38a-4900-8e20-e6f61231d913 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:29.264436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1616f-d38a-4900-8e20-e6f61231d913 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:29.267265 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 409/828] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:29.268547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e4743-3a56-4ed1-95c0-786ec4756744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:29.271485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e4743-3a56-4ed1-95c0-786ec4756744 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:29.274318 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb78891-ef37-452e-822f-171c0052b4ba None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:29.274914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb78891-ef37-452e-822f-171c0052b4ba None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:29.275388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb78891-ef37-452e-822f-171c0052b4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:29.294517 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5fb78891-ef37-452e-822f-171c0052b4ba None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:29.296171 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5fb78891-ef37-452e-822f-171c0052b4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-554e4743-3a56-4ed1-95c0-786ec4756744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:29.319040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:29.320008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:29.320889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:29.320889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:29.320889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:29.320889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:29.321714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 420/829] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:29.327697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e4743-3a56-4ed1-95c0-786ec4756744 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:29.367386 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:29.390900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 410/830] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:29.415931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb78891-ef37-452e-822f-171c0052b4ba None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:29.471840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e4743-3a56-4ed1-95c0-786ec4756744 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:29.474094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:29.514198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d804-84fb-4060-a944-c95eb1a9b0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:29.515229 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d804-84fb-4060-a944-c95eb1a9b0fa None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:29.515707 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d804-84fb-4060-a944-c95eb1a9b0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:29.516151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d804-84fb-4060-a944-c95eb1a9b0fa None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:29.517099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d804-84fb-4060-a944-c95eb1a9b0fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:29.517628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d804-84fb-4060-a944-c95eb1a9b0fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:29.519310 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d804-84fb-4060-a944-c95eb1a9b0fa None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:29.534150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 421/831] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:29.542725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d804-84fb-4060-a944-c95eb1a9b0fa None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:29.546139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb78891-ef37-452e-822f-171c0052b4ba None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:29.588633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb43ac-f51c-4243-8a75-06d69654b014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:29.589679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb43ac-f51c-4243-8a75-06d69654b014 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:29.590027 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb43ac-f51c-4243-8a75-06d69654b014 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:29.590399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb43ac-f51c-4243-8a75-06d69654b014 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:29.604349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb43ac-f51c-4243-8a75-06d69654b014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-35eb43ac-f51c-4243-8a75-06d69654b014 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:29.612705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:29.613714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:29.614554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:29.614554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:29.614554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:29.614554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:29.614554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:29.614554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:29.614554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:29.614554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:29.614554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:29.614554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:29.614554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:02:29.614554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:29.619674 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 411/832] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:02:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:29.621001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb43ac-f51c-4243-8a75-06d69654b014 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:29.655927 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d804-84fb-4060-a944-c95eb1a9b0fa None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:29.674341 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:29.693489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9dc80-bcd8-440b-b621-795c06e380e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:29.694342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9dc80-bcd8-440b-b621-795c06e380e0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:29.694799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9dc80-bcd8-440b-b621-795c06e380e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:29.695074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9dc80-bcd8-440b-b621-795c06e380e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:29.703650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9dc80-bcd8-440b-b621-795c06e380e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:29.705995 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9dc80-bcd8-440b-b621-795c06e380e0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-84c9dc80-bcd8-440b-b621-795c06e380e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:29.720766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:29.721914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:29.723003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:29.723003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:29.723003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:29.723003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:29.723003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:29.723003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:29.723003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:29.723003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:29.726821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 422/833] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:29.728563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9dc80-bcd8-440b-b621-795c06e380e0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:29.742551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb43ac-f51c-4243-8a75-06d69654b014 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:29.757103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:29.782751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff2700-1791-46eb-8899-d7f10068245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:29.783685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff2700-1791-46eb-8899-d7f10068245c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:29.784158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff2700-1791-46eb-8899-d7f10068245c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:29.784569 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff2700-1791-46eb-8899-d7f10068245c None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:29.785586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff2700-1791-46eb-8899-d7f10068245c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:29.786045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff2700-1791-46eb-8899-d7f10068245c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:29.787604 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff2700-1791-46eb-8899-d7f10068245c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:29.802281 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 412/834] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:02:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:29.803629 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff2700-1791-46eb-8899-d7f10068245c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:29.848908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9dc80-bcd8-440b-b621-795c06e380e0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:29.886177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224320b-30e1-42f7-9e38-8bccba5025fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:29.886891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224320b-30e1-42f7-9e38-8bccba5025fe None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:29.887219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224320b-30e1-42f7-9e38-8bccba5025fe None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:29.887497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224320b-30e1-42f7-9e38-8bccba5025fe None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:29.888405 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224320b-30e1-42f7-9e38-8bccba5025fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:29.888717 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224320b-30e1-42f7-9e38-8bccba5025fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:29.890298 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224320b-30e1-42f7-9e38-8bccba5025fe None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:29.909470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 423/835] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:29.911127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224320b-30e1-42f7-9e38-8bccba5025fe None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:29.916700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff2700-1791-46eb-8899-d7f10068245c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:29.927875 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:29.966401 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c022ba-000a-44f4-9e11-3e4871cf3236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:29.967278 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c022ba-000a-44f4-9e11-3e4871cf3236 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:29.967911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c022ba-000a-44f4-9e11-3e4871cf3236 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:29.967911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c022ba-000a-44f4-9e11-3e4871cf3236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:29.982918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c022ba-000a-44f4-9e11-3e4871cf3236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:29.984412 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c022ba-000a-44f4-9e11-3e4871cf3236 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-31c022ba-000a-44f4-9e11-3e4871cf3236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:30.004919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:30.005966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:30.007049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:30.007049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:30.007049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:30.007049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:30.007049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 413/836] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:30.009317 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:30.016931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c022ba-000a-44f4-9e11-3e4871cf3236 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:30.035806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224320b-30e1-42f7-9e38-8bccba5025fe None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:30.103551 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49aa50f-f686-4d14-962d-74a66a6ae4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:30.105206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aa50f-f686-4d14-962d-74a66a6ae4dd None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:30.105962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aa50f-f686-4d14-962d-74a66a6ae4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:30.106984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aa50f-f686-4d14-962d-74a66a6ae4dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:30.109250 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49aa50f-f686-4d14-962d-74a66a6ae4dd None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=f3fb1d091b27472081549f4166ca172f) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:30.110104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49aa50f-f686-4d14-962d-74a66a6ae4dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:30.113447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49aa50f-f686-4d14-962d-74a66a6ae4dd None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:30.130699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c022ba-000a-44f4-9e11-3e4871cf3236 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:30.131396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 424/837] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:02:29 2022] GET /identity/v3/role_assignments?user.id=f3fb1d091b27472081549f4166ca172f&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:30.170906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055d2f8-c8f3-437b-8d82-f4a98ba2ce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:30.171603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055d2f8-c8f3-437b-8d82-f4a98ba2ce4f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:30.171921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055d2f8-c8f3-437b-8d82-f4a98ba2ce4f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:30.172157 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055d2f8-c8f3-437b-8d82-f4a98ba2ce4f None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:30.172974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055d2f8-c8f3-437b-8d82-f4a98ba2ce4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:30.173283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055d2f8-c8f3-437b-8d82-f4a98ba2ce4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:30.174741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055d2f8-c8f3-437b-8d82-f4a98ba2ce4f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:30.189990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 414/838] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:30.195970 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49aa50f-f686-4d14-962d-74a66a6ae4dd None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:30.339327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49aa50f-f686-4d14-962d-74a66a6ae4dd None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:30.405901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9038f-e926-48bd-bfcd-0b160996892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:30.407863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9038f-e926-48bd-bfcd-0b160996892a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:30.408646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9038f-e926-48bd-bfcd-0b160996892a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:30.409421 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9038f-e926-48bd-bfcd-0b160996892a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:30.424475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9038f-e926-48bd-bfcd-0b160996892a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:30.427692 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9038f-e926-48bd-bfcd-0b160996892a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-74d9038f-e926-48bd-bfcd-0b160996892a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:30.456379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:30.458183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:30.459830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:30.459830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:30.459830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:30.459830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:30.459830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:30.459830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:30.459830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:30.459830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:30.459830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 12:02:30.459830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:30.463994 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 425/839] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:02:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:30.472811 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055d2f8-c8f3-437b-8d82-f4a98ba2ce4f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:30.516530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:30.522066 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ecd40-6c06-4310-9122-7d770f313546 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:30.522343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ecd40-6c06-4310-9122-7d770f313546 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:30.522638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ecd40-6c06-4310-9122-7d770f313546 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:30.525767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 426/840] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:30.531420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1774bf-b421-4130-93e5-a8136d2ac83b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:30.531718 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1774bf-b421-4130-93e5-a8136d2ac83b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:30.531998 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1774bf-b421-4130-93e5-a8136d2ac83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:30.546089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:30.552845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5e1774bf-b421-4130-93e5-a8136d2ac83b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:30.554177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5e1774bf-b421-4130-93e5-a8136d2ac83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:30.642227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055d2f8-c8f3-437b-8d82-f4a98ba2ce4f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:30.647131 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 427/841] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:30.672362 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1774bf-b421-4130-93e5-a8136d2ac83b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:30.699126 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccbc46-7aae-4842-ba81-67a65cfab69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:30.700472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccbc46-7aae-4842-ba81-67a65cfab69c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:30.700975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccbc46-7aae-4842-ba81-67a65cfab69c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:30.701476 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccbc46-7aae-4842-ba81-67a65cfab69c None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:30.702558 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccbc46-7aae-4842-ba81-67a65cfab69c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:30.703101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccbc46-7aae-4842-ba81-67a65cfab69c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:30.704929 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccbc46-7aae-4842-ba81-67a65cfab69c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:30.726978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 415/842] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jul 21 12:02:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:30.733849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccbc46-7aae-4842-ba81-67a65cfab69c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:30.808511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1774bf-b421-4130-93e5-a8136d2ac83b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:30.834929 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:30.850577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1bf3d-fe8e-43f9-87ba-846a1b66a1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:30.851791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1bf3d-fe8e-43f9-87ba-846a1b66a1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:30.852243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1bf3d-fe8e-43f9-87ba-846a1b66a1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:30.852666 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1bf3d-fe8e-43f9-87ba-846a1b66a1a7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:30.853479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1bf3d-fe8e-43f9-87ba-846a1b66a1a7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:30.855208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1bf3d-fe8e-43f9-87ba-846a1b66a1a7 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:30.858775 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:30.861956 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccbc46-7aae-4842-ba81-67a65cfab69c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-8ca1bf3d-fe8e-43f9-87ba-846a1b66a1a7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:30.869954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:30.871228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:30.872099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:30.872099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:30.872099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:30.872099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:30.872099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:30.872099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:30.872099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:30.872099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:30.872099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:30.872099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:30.872099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:30.872099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:30.872099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 12:02:30.872099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:30.874957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 428/843] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:02:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:30.882115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1bf3d-fe8e-43f9-87ba-846a1b66a1a7 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:30.912438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c111-2b92-49f3-bc5b-c49e6262ae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:30.913553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c111-2b92-49f3-bc5b-c49e6262ae4d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:30.913855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c111-2b92-49f3-bc5b-c49e6262ae4d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:30.914131 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c111-2b92-49f3-bc5b-c49e6262ae4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:31.007344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1c111-2b92-49f3-bc5b-c49e6262ae4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:31.008844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1c111-2b92-49f3-bc5b-c49e6262ae4d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:31.021498 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1bf3d-fe8e-43f9-87ba-846a1b66a1a7 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:31.072146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29cd20-9355-481e-bbb3-396ece704685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:31.072841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29cd20-9355-481e-bbb3-396ece704685 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:31.073115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29cd20-9355-481e-bbb3-396ece704685 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:31.073388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29cd20-9355-481e-bbb3-396ece704685 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:31.074486 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29cd20-9355-481e-bbb3-396ece704685 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:31.074823 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29cd20-9355-481e-bbb3-396ece704685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:31.076367 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29cd20-9355-481e-bbb3-396ece704685 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:31.086078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 429/844] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:02:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:31.087308 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29cd20-9355-481e-bbb3-396ece704685 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:31.117194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:31.145852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 416/845] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:02:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:02:31.151507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c111-2b92-49f3-bc5b-c49e6262ae4d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:31.180145 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:31.251545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29cd20-9355-481e-bbb3-396ece704685 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:31.276514 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c111-2b92-49f3-bc5b-c49e6262ae4d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:31.318906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65bd28-3b0f-48f0-8371-cd4b1e0496b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:31.320124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65bd28-3b0f-48f0-8371-cd4b1e0496b5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:31.320647 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65bd28-3b0f-48f0-8371-cd4b1e0496b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:31.321104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65bd28-3b0f-48f0-8371-cd4b1e0496b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:31.321618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3d768-4180-491f-b17f-35a22469e334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:31.322977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3d768-4180-491f-b17f-35a22469e334 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:31.323979 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3d768-4180-491f-b17f-35a22469e334 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:31.324717 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3d768-4180-491f-b17f-35a22469e334 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:31.326349 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3d768-4180-491f-b17f-35a22469e334 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:31.327056 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3d768-4180-491f-b17f-35a22469e334 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:31.329772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3d768-4180-491f-b17f-35a22469e334 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:31.336102 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65bd28-3b0f-48f0-8371-cd4b1e0496b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:31.337904 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65bd28-3b0f-48f0-8371-cd4b1e0496b5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:31.343247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 430/846] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:02:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-aa65bd28-3b0f-48f0-8371-cd4b1e0496b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:31.359602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:31.360603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:31.361503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:31.361503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:31.361503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:31.361503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:31.364095 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 417/847] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:31.373690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3d768-4180-491f-b17f-35a22469e334 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:31.575507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3d768-4180-491f-b17f-35a22469e334 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:31.625602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:31.639711 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a8d81-067f-4db4-bc6d-e2548d95b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:31.640851 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a8d81-067f-4db4-bc6d-e2548d95b5fe None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:31.641335 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a8d81-067f-4db4-bc6d-e2548d95b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:31.641828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a8d81-067f-4db4-bc6d-e2548d95b5fe None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:31.643203 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a8d81-067f-4db4-bc6d-e2548d95b5fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:31.643744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a8d81-067f-4db4-bc6d-e2548d95b5fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:31.646387 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a8d81-067f-4db4-bc6d-e2548d95b5fe None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:31.659160 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f00a92-67e4-448c-968f-35a5c875c965 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:31.659915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f00a92-67e4-448c-968f-35a5c875c965 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:31.660246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f00a92-67e4-448c-968f-35a5c875c965 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:31.662030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 418/848] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:31.667982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6133a-a594-4b88-aef2-9df8d9895564 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:31.668328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6133a-a594-4b88-aef2-9df8d9895564 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:31.668682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6133a-a594-4b88-aef2-9df8d9895564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:31.671693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 431/849] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:31.681181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a8d81-067f-4db4-bc6d-e2548d95b5fe None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:31.688424 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8bc6133a-a594-4b88-aef2-9df8d9895564 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:31.689879 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8bc6133a-a594-4b88-aef2-9df8d9895564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:31.721372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:31.782908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 419/850] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:31.799257 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6133a-a594-4b88-aef2-9df8d9895564 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:31.857237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a8d81-067f-4db4-bc6d-e2548d95b5fe None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:31.914152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6133a-a594-4b88-aef2-9df8d9895564 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:31.914827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3a5b2-003d-4ef8-8a5d-f0028dce4600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:31.916224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3a5b2-003d-4ef8-8a5d-f0028dce4600 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:31.916692 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3a5b2-003d-4ef8-8a5d-f0028dce4600 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:31.917168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3a5b2-003d-4ef8-8a5d-f0028dce4600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:31.929254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3a5b2-003d-4ef8-8a5d-f0028dce4600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:31.931981 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3a5b2-003d-4ef8-8a5d-f0028dce4600 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:31.954437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aefe13-c539-4863-bec2-9f2cc0782689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:31.955313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aefe13-c539-4863-bec2-9f2cc0782689 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:31.955594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aefe13-c539-4863-bec2-9f2cc0782689 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:31.955872 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aefe13-c539-4863-bec2-9f2cc0782689 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-3bb3a5b2-003d-4ef8-8a5d-f0028dce4600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:31.959543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:31.960729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:31.961933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:31.961933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:31.961933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:31.961933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:31.961933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:31.961933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:31.961933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:31.961933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:31.962455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 432/851] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:31.970725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3a5b2-003d-4ef8-8a5d-f0028dce4600 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:31.976432 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aefe13-c539-4863-bec2-9f2cc0782689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-13aefe13-c539-4863-bec2-9f2cc0782689 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:31.987865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:31.989340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:31.994292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:31.994292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:31.994292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:31.994292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:31.994292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:31.994292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:31.994292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:31.994292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:31.994292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:31.994292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:31.994292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:02:31.994292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:31.998761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 420/852] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:02:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:32.008769 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aefe13-c539-4863-bec2-9f2cc0782689 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:32.053763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:32.065130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:32.117299 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3a5b2-003d-4ef8-8a5d-f0028dce4600 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:32.156347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f9db8-dd80-4ba9-b1bc-5a8884535368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:32.157619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f9db8-dd80-4ba9-b1bc-5a8884535368 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:32.158137 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f9db8-dd80-4ba9-b1bc-5a8884535368 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:32.158610 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f9db8-dd80-4ba9-b1bc-5a8884535368 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:32.159662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f9db8-dd80-4ba9-b1bc-5a8884535368 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:32.160201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f9db8-dd80-4ba9-b1bc-5a8884535368 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:32.160780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aefe13-c539-4863-bec2-9f2cc0782689 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:32.162101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f9db8-dd80-4ba9-b1bc-5a8884535368 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:32.181320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 433/853] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:32.182773 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f9db8-dd80-4ba9-b1bc-5a8884535368 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:32.211025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318eb591-5620-4773-86f4-5232668416be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:32.212215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318eb591-5620-4773-86f4-5232668416be None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:32.212726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318eb591-5620-4773-86f4-5232668416be None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:32.212969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318eb591-5620-4773-86f4-5232668416be None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:32.213926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318eb591-5620-4773-86f4-5232668416be None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:32.214251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318eb591-5620-4773-86f4-5232668416be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:32.216103 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318eb591-5620-4773-86f4-5232668416be None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:32.232395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 421/854] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:02:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:32.237333 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318eb591-5620-4773-86f4-5232668416be None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:32.301231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f9db8-dd80-4ba9-b1bc-5a8884535368 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:32.319255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:32.345472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67768e18-d30c-40aa-974f-121011766d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:32.346621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67768e18-d30c-40aa-974f-121011766d5a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:32.347553 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67768e18-d30c-40aa-974f-121011766d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:32.348042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67768e18-d30c-40aa-974f-121011766d5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:32.349120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67768e18-d30c-40aa-974f-121011766d5a None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=2dd659c33e0f49dc8edf30bd47737e70) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:32.349648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67768e18-d30c-40aa-974f-121011766d5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:32.351515 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67768e18-d30c-40aa-974f-121011766d5a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:32.363042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 434/855] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:02:32 2022] GET /identity/v3/role_assignments?user.id=2dd659c33e0f49dc8edf30bd47737e70&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:32.395870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:32.426692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318eb591-5620-4773-86f4-5232668416be None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:32.482032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6e0df-dd38-4289-a797-01442efb7ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:32.482993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6e0df-dd38-4289-a797-01442efb7ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:32.483221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6e0df-dd38-4289-a797-01442efb7ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:32.483505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6e0df-dd38-4289-a797-01442efb7ba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:32.497779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6e0df-dd38-4289-a797-01442efb7ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:32.499396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6e0df-dd38-4289-a797-01442efb7ba7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-a3f6e0df-dd38-4289-a797-01442efb7ba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:32.520426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:32.521399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:32.522293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:32.522293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:32.522293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:32.522293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:32.522293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 422/856] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:32.531864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67768e18-d30c-40aa-974f-121011766d5a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:32.681245 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67768e18-d30c-40aa-974f-121011766d5a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:32.725748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5f0cb-7abf-4896-b9ee-449e146a6bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:32.726445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5f0cb-7abf-4896-b9ee-449e146a6bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:32.726806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5f0cb-7abf-4896-b9ee-449e146a6bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:32.727080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5f0cb-7abf-4896-b9ee-449e146a6bf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:32.727834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5f0cb-7abf-4896-b9ee-449e146a6bf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:32.728137 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5f0cb-7abf-4896-b9ee-449e146a6bf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:32.729546 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5f0cb-7abf-4896-b9ee-449e146a6bf3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:32.744419 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 435/857] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:32.750087 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6e0df-dd38-4289-a797-01442efb7ba7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:32.797483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd64a1-afb9-41c5-8bc7-588e9ee9f6c8 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:32.797764 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd64a1-afb9-41c5-8bc7-588e9ee9f6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:32.798100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd64a1-afb9-41c5-8bc7-588e9ee9f6c8 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:32.799728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 436/858] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:02:32.811540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bab958-6f8a-42d4-a762-d654279ffaab None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:32.812457 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bab958-6f8a-42d4-a762-d654279ffaab None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:32.813007 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bab958-6f8a-42d4-a762-d654279ffaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:32.840083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-76bab958-6f8a-42d4-a762-d654279ffaab None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:32.842754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-76bab958-6f8a-42d4-a762-d654279ffaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:32.885324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6e0df-dd38-4289-a797-01442efb7ba7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:32.896911 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:32.923726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35e499-6c2a-4e29-ae3e-a2df161e6308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:32.924562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35e499-6c2a-4e29-ae3e-a2df161e6308 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:32.924887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35e499-6c2a-4e29-ae3e-a2df161e6308 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:32.925150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35e499-6c2a-4e29-ae3e-a2df161e6308 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:32.927369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:32.935704 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35e499-6c2a-4e29-ae3e-a2df161e6308 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:32.937734 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35e499-6c2a-4e29-ae3e-a2df161e6308 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ae35e499-6c2a-4e29-ae3e-a2df161e6308 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:32.954058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:32.955850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:32.957577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:32.957577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:32.957577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:32.957577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:32.957577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:32.957577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:32.957577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:32.957577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:32.957577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 12:02:32.957577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:32.960346 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 423/859] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jul 21 12:02:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:32.961339 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35e499-6c2a-4e29-ae3e-a2df161e6308 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:32.998558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 437/860] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:33.036717 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bab958-6f8a-42d4-a762-d654279ffaab None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:33.071751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35e499-6c2a-4e29-ae3e-a2df161e6308 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:33.109761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626c7bf-311e-4d47-bfad-10b4a7a31043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:33.110454 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626c7bf-311e-4d47-bfad-10b4a7a31043 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:33.110758 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626c7bf-311e-4d47-bfad-10b4a7a31043 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:33.111035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626c7bf-311e-4d47-bfad-10b4a7a31043 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:33.111912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626c7bf-311e-4d47-bfad-10b4a7a31043 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:33.112219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626c7bf-311e-4d47-bfad-10b4a7a31043 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:33.113690 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626c7bf-311e-4d47-bfad-10b4a7a31043 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:33.133327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 424/861] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jul 21 12:02:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:33.139220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626c7bf-311e-4d47-bfad-10b4a7a31043 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:33.197842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:33.233687 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bab958-6f8a-42d4-a762-d654279ffaab None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:33.252344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626c7bf-311e-4d47-bfad-10b4a7a31043 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:33.289734 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7411a4-4cb7-42c1-b776-092fb2d7269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:33.290674 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7411a4-4cb7-42c1-b776-092fb2d7269f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:33.291125 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7411a4-4cb7-42c1-b776-092fb2d7269f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:33.291536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7411a4-4cb7-42c1-b776-092fb2d7269f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:33.299546 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16147c-add0-4013-8ef6-a0852c73e32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:33.301063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16147c-add0-4013-8ef6-a0852c73e32f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:33.301672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16147c-add0-4013-8ef6-a0852c73e32f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:33.302317 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16147c-add0-4013-8ef6-a0852c73e32f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:33.303549 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16147c-add0-4013-8ef6-a0852c73e32f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:33.306212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16147c-add0-4013-8ef6-a0852c73e32f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-fa16147c-add0-4013-8ef6-a0852c73e32f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:33.330827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:33.331948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 12:02:33.332866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:33.343220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 438/862] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Jul 21 12:02:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:33.346592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16147c-add0-4013-8ef6-a0852c73e32f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:33.375056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7411a4-4cb7-42c1-b776-092fb2d7269f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:33.376859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7411a4-4cb7-42c1-b776-092fb2d7269f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:33.439939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:33.507217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 425/863] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:02:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 12:02:33.508931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7411a4-4cb7-42c1-b776-092fb2d7269f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:33.577870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:33.619909 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7411a4-4cb7-42c1-b776-092fb2d7269f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:33.656962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cff7a-120b-4412-946f-6aac93a73472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:33.658034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cff7a-120b-4412-946f-6aac93a73472 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:33.658458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cff7a-120b-4412-946f-6aac93a73472 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:33.658894 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cff7a-120b-4412-946f-6aac93a73472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:33.670422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cff7a-120b-4412-946f-6aac93a73472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:33.672194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cff7a-120b-4412-946f-6aac93a73472 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-303cff7a-120b-4412-946f-6aac93a73472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:33.691665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:33.692641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:33.693546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:33.693546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:33.693546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:33.693546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:33.700943 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 426/864] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:33.702227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cff7a-120b-4412-946f-6aac93a73472 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:33.706323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:33.720084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16147c-add0-4013-8ef6-a0852c73e32f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:33.783893 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abddc8e-97d9-4b1e-947c-25abd9fdbfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:33.785069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abddc8e-97d9-4b1e-947c-25abd9fdbfed None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:33.785614 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abddc8e-97d9-4b1e-947c-25abd9fdbfed None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:33.786171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abddc8e-97d9-4b1e-947c-25abd9fdbfed None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:33.787608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abddc8e-97d9-4b1e-947c-25abd9fdbfed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:33.788344 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abddc8e-97d9-4b1e-947c-25abd9fdbfed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:33.790988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abddc8e-97d9-4b1e-947c-25abd9fdbfed None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:33.806883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 439/865] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jul 21 12:02:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:33.810402 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abddc8e-97d9-4b1e-947c-25abd9fdbfed None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:33.817254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cff7a-120b-4412-946f-6aac93a73472 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:33.854644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119db351-0ca0-4537-ba34-0c02c8ec48b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:33.855669 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119db351-0ca0-4537-ba34-0c02c8ec48b6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:33.856173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119db351-0ca0-4537-ba34-0c02c8ec48b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:33.856698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119db351-0ca0-4537-ba34-0c02c8ec48b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:33.857605 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119db351-0ca0-4537-ba34-0c02c8ec48b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:33.858083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119db351-0ca0-4537-ba34-0c02c8ec48b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:33.859679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119db351-0ca0-4537-ba34-0c02c8ec48b6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:33.876988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 427/866] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:33.878575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa5c05-3216-4b49-a669-2e86789a7fd5 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:33.878907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa5c05-3216-4b49-a669-2e86789a7fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:33.879188 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa5c05-3216-4b49-a669-2e86789a7fd5 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:33.880589 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 428/867] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:33.881601 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa5c05-3216-4b49-a669-2e86789a7fd5 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:33.954005 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:33.970480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abddc8e-97d9-4b1e-947c-25abd9fdbfed None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:33.974200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:34.027956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbc7cb-b3b7-4251-809e-8300a8dc7b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:34.028691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc7cb-b3b7-4251-809e-8300a8dc7b6b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:34.028979 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc7cb-b3b7-4251-809e-8300a8dc7b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:34.029243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc7cb-b3b7-4251-809e-8300a8dc7b6b None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:34.030088 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbc7cb-b3b7-4251-809e-8300a8dc7b6b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:34.030366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbc7cb-b3b7-4251-809e-8300a8dc7b6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:34.030538 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa5c05-3216-4b49-a669-2e86789a7fd5 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:34.031809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbc7cb-b3b7-4251-809e-8300a8dc7b6b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:34.047076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 440/868] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jul 21 12:02:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:34.047076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada7314-5193-4312-a75a-7661bc25ef90 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:34.047076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada7314-5193-4312-a75a-7661bc25ef90 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:34.047076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada7314-5193-4312-a75a-7661bc25ef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:34.063887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4ada7314-5193-4312-a75a-7661bc25ef90 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:34.065206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4ada7314-5193-4312-a75a-7661bc25ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:34.103161 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f404a-3a90-4fc5-a9bf-6de0b1084076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:34.104085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f404a-3a90-4fc5-a9bf-6de0b1084076 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:34.104434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f404a-3a90-4fc5-a9bf-6de0b1084076 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:34.104774 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f404a-3a90-4fc5-a9bf-6de0b1084076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:34.112902 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f404a-3a90-4fc5-a9bf-6de0b1084076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:34.114531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f404a-3a90-4fc5-a9bf-6de0b1084076 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ad6f404a-3a90-4fc5-a9bf-6de0b1084076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:34.130150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:34.131156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:34.132035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:34.132035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:34.132035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:34.132035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:34.132035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:34.132035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:34.132035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:34.132035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:34.136635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 429/869] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:34.137821 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f404a-3a90-4fc5-a9bf-6de0b1084076 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:34.235224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 441/870] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:34.269285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada7314-5193-4312-a75a-7661bc25ef90 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:34.314176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f404a-3a90-4fc5-a9bf-6de0b1084076 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:34.344222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:34.364669 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0739d50-e528-4c2a-ae8f-a4135a5011b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:34.365950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0739d50-e528-4c2a-ae8f-a4135a5011b9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:34.366569 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0739d50-e528-4c2a-ae8f-a4135a5011b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:34.367106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0739d50-e528-4c2a-ae8f-a4135a5011b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:34.368492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0739d50-e528-4c2a-ae8f-a4135a5011b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:34.369016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0739d50-e528-4c2a-ae8f-a4135a5011b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:34.378714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0739d50-e528-4c2a-ae8f-a4135a5011b9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:34.403213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 430/871] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:34.409260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0739d50-e528-4c2a-ae8f-a4135a5011b9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:34.431514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:34.468957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada7314-5193-4312-a75a-7661bc25ef90 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:34.544609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248e51e-0b96-43f5-a9af-da32804fc921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:34.546233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248e51e-0b96-43f5-a9af-da32804fc921 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:34.547003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248e51e-0b96-43f5-a9af-da32804fc921 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:34.547702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248e51e-0b96-43f5-a9af-da32804fc921 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:34.549402 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248e51e-0b96-43f5-a9af-da32804fc921 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:34.552414 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248e51e-0b96-43f5-a9af-da32804fc921 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:34.581350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 442/872] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jul 21 12:02:34 2022] POST /identity/v3/services => generated 251 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:02:34.638627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0739d50-e528-4c2a-ae8f-a4135a5011b9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:34.718915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fabd0-fc71-45e0-b232-d4261681e47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:34.726717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fabd0-fc71-45e0-b232-d4261681e47d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:34.726717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fabd0-fc71-45e0-b232-d4261681e47d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:34.726717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fabd0-fc71-45e0-b232-d4261681e47d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:34.726717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fabd0-fc71-45e0-b232-d4261681e47d None admin] RBAC: Adding query filter params (role.id=8fc2e732d1b54ac193720d2652101798, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=9410b04623a04e90ac47c4a53cd3c4e6) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:34.726717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fabd0-fc71-45e0-b232-d4261681e47d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:34.726717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fabd0-fc71-45e0-b232-d4261681e47d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:34.740485 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 431/873] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:02:34 2022] GET /identity/v3/role_assignments?user.id=9410b04623a04e90ac47c4a53cd3c4e6&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=8fc2e732d1b54ac193720d2652101798 => generated 608 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:35.180109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09d93b-8b8b-47b1-87b2-e0cc9b13d0de None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:35.180389 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09d93b-8b8b-47b1-87b2-e0cc9b13d0de None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:35.180788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09d93b-8b8b-47b1-87b2-e0cc9b13d0de None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:35.182457 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 443/874] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:35.188797 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99a80-3c90-49db-8fbb-0d6098eea1e1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:35.189576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99a80-3c90-49db-8fbb-0d6098eea1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:35.189576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99a80-3c90-49db-8fbb-0d6098eea1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:35.208687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-dff99a80-3c90-49db-8fbb-0d6098eea1e1 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:35.209926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-dff99a80-3c90-49db-8fbb-0d6098eea1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:35.260086 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:35.309228 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 432/875] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:35.331962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09d93b-8b8b-47b1-87b2-e0cc9b13d0de None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:35.521181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09d93b-8b8b-47b1-87b2-e0cc9b13d0de None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:35.581592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df39391-fa34-4a9f-9df7-32ae9ac9b4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:35.582960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df39391-fa34-4a9f-9df7-32ae9ac9b4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:35.583444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df39391-fa34-4a9f-9df7-32ae9ac9b4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:35.583923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df39391-fa34-4a9f-9df7-32ae9ac9b4b9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:35.585133 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df39391-fa34-4a9f-9df7-32ae9ac9b4b9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:35.587742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df39391-fa34-4a9f-9df7-32ae9ac9b4b9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-4df39391-fa34-4a9f-9df7-32ae9ac9b4b9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:35.611063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:35.612117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:35.613616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 444/876] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jul 21 12:02:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:35.623860 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99a80-3c90-49db-8fbb-0d6098eea1e1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:35.783791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99a80-3c90-49db-8fbb-0d6098eea1e1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:35.851773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39f675-e35e-4046-8f28-35a685f7bc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:35.852941 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39f675-e35e-4046-8f28-35a685f7bc8e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:35.853420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39f675-e35e-4046-8f28-35a685f7bc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:35.853900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39f675-e35e-4046-8f28-35a685f7bc8e None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:35.855294 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39f675-e35e-4046-8f28-35a685f7bc8e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:35.855838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39f675-e35e-4046-8f28-35a685f7bc8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:35.858514 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39f675-e35e-4046-8f28-35a685f7bc8e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:35.868702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 433/877] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jul 21 12:02:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:35.878047 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df39391-fa34-4a9f-9df7-32ae9ac9b4b9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:35.901029 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:36.075986 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df39391-fa34-4a9f-9df7-32ae9ac9b4b9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:36.137654 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57711ee9-6852-4131-a4cd-dc89363b61ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:36.139342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57711ee9-6852-4131-a4cd-dc89363b61ea None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:36.140113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57711ee9-6852-4131-a4cd-dc89363b61ea None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:36.140891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57711ee9-6852-4131-a4cd-dc89363b61ea None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:36.142547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57711ee9-6852-4131-a4cd-dc89363b61ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:36.143405 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57711ee9-6852-4131-a4cd-dc89363b61ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:36.146234 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57711ee9-6852-4131-a4cd-dc89363b61ea None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:36.155960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 445/878] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jul 21 12:02:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:37.330517 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776afc3-a3bc-4524-a2d2-2f67d639564a None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:37.331357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776afc3-a3bc-4524-a2d2-2f67d639564a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:37.331491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776afc3-a3bc-4524-a2d2-2f67d639564a None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:37.334348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 434/879] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:37.343251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341852e-5742-41a6-a0fb-1e43de0f36a8 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:37.344023 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341852e-5742-41a6-a0fb-1e43de0f36a8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:37.344155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341852e-5742-41a6-a0fb-1e43de0f36a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:37.372396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4341852e-5742-41a6-a0fb-1e43de0f36a8 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:37.374871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4341852e-5742-41a6-a0fb-1e43de0f36a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:37.518990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 446/880] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:37 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:37.553911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776afc3-a3bc-4524-a2d2-2f67d639564a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:37.631716 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:37.752447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776afc3-a3bc-4524-a2d2-2f67d639564a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:37.818865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b1c0a-998e-4171-9cf0-ab51f334335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:37.820055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1c0a-998e-4171-9cf0-ab51f334335b None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:37.820547 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1c0a-998e-4171-9cf0-ab51f334335b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:37.821041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1c0a-998e-4171-9cf0-ab51f334335b None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:37.822411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b1c0a-998e-4171-9cf0-ab51f334335b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:37.825460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b1c0a-998e-4171-9cf0-ab51f334335b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:37.855123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 435/881] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jul 21 12:02:37 2022] POST /identity/v3/services => generated 269 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:02:37.998854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b2237-265d-46cd-b292-d0da22b4b10c None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:37.999227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b2237-265d-46cd-b292-d0da22b4b10c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:37.999687 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b2237-265d-46cd-b292-d0da22b4b10c None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:38.002552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 447/882] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:38.009578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c3871-6d7a-40a4-baab-1b74f39ed170 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:38.010066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c3871-6d7a-40a4-baab-1b74f39ed170 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:38.010566 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c3871-6d7a-40a4-baab-1b74f39ed170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:38.044028 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a80c3871-6d7a-40a4-baab-1b74f39ed170 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:38.046368 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a80c3871-6d7a-40a4-baab-1b74f39ed170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:38.131267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d95a4-5b7f-4069-9cfe-df3320df872f None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:38.131920 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d95a4-5b7f-4069-9cfe-df3320df872f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:38.132396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d95a4-5b7f-4069-9cfe-df3320df872f None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:38.133862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 448/883] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:38.142831 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f44c53-7310-4537-adea-03bfdef4249c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:38.143305 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f44c53-7310-4537-adea-03bfdef4249c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:38.143724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f44c53-7310-4537-adea-03bfdef4249c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:38.152095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:38.172624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-88f44c53-7310-4537-adea-03bfdef4249c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:38.174683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-88f44c53-7310-4537-adea-03bfdef4249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:38.197386 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 436/884] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:38.241968 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c3871-6d7a-40a4-baab-1b74f39ed170 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:38.285764 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:38.307962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 449/885] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:38.345828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f44c53-7310-4537-adea-03bfdef4249c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:38.436815 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c3871-6d7a-40a4-baab-1b74f39ed170 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:38.509370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f3b27-b954-4103-bcf9-1ac4c9c290f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:38.511104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f3b27-b954-4103-bcf9-1ac4c9c290f1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:38.511607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f3b27-b954-4103-bcf9-1ac4c9c290f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:38.512078 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f3b27-b954-4103-bcf9-1ac4c9c290f1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:38.513579 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f3b27-b954-4103-bcf9-1ac4c9c290f1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:38.516248 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f3b27-b954-4103-bcf9-1ac4c9c290f1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-430f3b27-b954-4103-bcf9-1ac4c9c290f1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:38.541534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:38.545020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:38.546942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 437/886] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:02:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:38.554250 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f3b27-b954-4103-bcf9-1ac4c9c290f1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:38.556302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f44c53-7310-4537-adea-03bfdef4249c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:38.618365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:38.628427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0ab79-6091-4ae3-aceb-894fbf58619d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:38.630571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0ab79-6091-4ae3-aceb-894fbf58619d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:38.631072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0ab79-6091-4ae3-aceb-894fbf58619d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:38.632273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0ab79-6091-4ae3-aceb-894fbf58619d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:38.653850 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0ab79-6091-4ae3-aceb-894fbf58619d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-bed0ab79-6091-4ae3-aceb-894fbf58619d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:38.670814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:38.672686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:38.674463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:38.674463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:38.674463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:38.674463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:38.674463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:38.674463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:38.674463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:38.674463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:38.674463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:38.674463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:38.674463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 12:02:38.674463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:38.679209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 450/887] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jul 21 12:02:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:38.682999 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0ab79-6091-4ae3-aceb-894fbf58619d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:38.746982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:38.770741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f3b27-b954-4103-bcf9-1ac4c9c290f1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:38.838004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd40b6-53ef-4f95-ae55-6255ae956209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:38.839656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd40b6-53ef-4f95-ae55-6255ae956209 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:38.840537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd40b6-53ef-4f95-ae55-6255ae956209 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:38.841378 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd40b6-53ef-4f95-ae55-6255ae956209 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:38.843067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd40b6-53ef-4f95-ae55-6255ae956209 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:38.843917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd40b6-53ef-4f95-ae55-6255ae956209 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:38.846979 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd40b6-53ef-4f95-ae55-6255ae956209 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:38.856832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 438/888] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:02:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:38.864859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd40b6-53ef-4f95-ae55-6255ae956209 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:38.874882 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0ab79-6091-4ae3-aceb-894fbf58619d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:38.936341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fbda1-1b07-49f1-82a0-3eeeff568f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:38.937472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fbda1-1b07-49f1-82a0-3eeeff568f61 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:38.938093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fbda1-1b07-49f1-82a0-3eeeff568f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:38.938579 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fbda1-1b07-49f1-82a0-3eeeff568f61 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:38.940045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fbda1-1b07-49f1-82a0-3eeeff568f61 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:38.940589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fbda1-1b07-49f1-82a0-3eeeff568f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:38.943439 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fbda1-1b07-49f1-82a0-3eeeff568f61 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:38.969019 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 451/889] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jul 21 12:02:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:38.970838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fbda1-1b07-49f1-82a0-3eeeff568f61 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:39.000903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd40b6-53ef-4f95-ae55-6255ae956209 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:39.044498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97909a3e-d795-451d-b7e6-80bd970bcd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:39.045987 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97909a3e-d795-451d-b7e6-80bd970bcd1c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:39.046266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97909a3e-d795-451d-b7e6-80bd970bcd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:39.046551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97909a3e-d795-451d-b7e6-80bd970bcd1c None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:39.047340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97909a3e-d795-451d-b7e6-80bd970bcd1c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:39.047650 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97909a3e-d795-451d-b7e6-80bd970bcd1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:39.049771 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97909a3e-d795-451d-b7e6-80bd970bcd1c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:39.058798 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 439/890] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:02:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:39.063398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97909a3e-d795-451d-b7e6-80bd970bcd1c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:39.074286 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:39.098554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:39.130140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fbda1-1b07-49f1-82a0-3eeeff568f61 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:39.192509 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b9a10-5ed9-4f5b-8d32-6b6f7f396603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:39.193931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b9a10-5ed9-4f5b-8d32-6b6f7f396603 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:39.194417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b9a10-5ed9-4f5b-8d32-6b6f7f396603 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:39.195127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b9a10-5ed9-4f5b-8d32-6b6f7f396603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:39.216805 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b9a10-5ed9-4f5b-8d32-6b6f7f396603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:39.217786 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97909a3e-d795-451d-b7e6-80bd970bcd1c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:39.219697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b9a10-5ed9-4f5b-8d32-6b6f7f396603 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-d10b9a10-5ed9-4f5b-8d32-6b6f7f396603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:39.256735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:39.260006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:39.263410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:39.263410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:39.263410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:39.263410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:39.264213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d1752-81ac-4c89-80a7-53f0cd2623e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:39.264213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d1752-81ac-4c89-80a7-53f0cd2623e2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:39.264213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d1752-81ac-4c89-80a7-53f0cd2623e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:39.264213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d1752-81ac-4c89-80a7-53f0cd2623e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:39.265626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 452/891] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:39.265712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d1752-81ac-4c89-80a7-53f0cd2623e2 None admin] RBAC: Adding query filter params (interface=public, service_id=ba81eda4d1f3474b98671c8f3950d80f, region_id=RegionOne) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:39.265712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d1752-81ac-4c89-80a7-53f0cd2623e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:39.265712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d1752-81ac-4c89-80a7-53f0cd2623e2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:39.268091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 440/892] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jul 21 12:02:39 2022] GET /identity/v3/endpoints?service_id=ba81eda4d1f3474b98671c8f3950d80f&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:39.270207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b9a10-5ed9-4f5b-8d32-6b6f7f396603 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:39.276671 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d1752-81ac-4c89-80a7-53f0cd2623e2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:39.401607 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b9a10-5ed9-4f5b-8d32-6b6f7f396603 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:39.410321 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:39.431117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:39.441866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d43261-e970-4dd5-bf1a-95632e9d582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:39.443009 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d43261-e970-4dd5-bf1a-95632e9d582c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:39.443498 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d43261-e970-4dd5-bf1a-95632e9d582c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:39.443972 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d43261-e970-4dd5-bf1a-95632e9d582c None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:39.444922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d43261-e970-4dd5-bf1a-95632e9d582c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:39.445435 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d43261-e970-4dd5-bf1a-95632e9d582c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:39.447162 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d43261-e970-4dd5-bf1a-95632e9d582c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:39.464419 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 453/893] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:39.472473 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d43261-e970-4dd5-bf1a-95632e9d582c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:39.480836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d1752-81ac-4c89-80a7-53f0cd2623e2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:39.524728 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5d53f-8711-4e43-8f99-cf24487de165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:39.525415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5d53f-8711-4e43-8f99-cf24487de165 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:39.525867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5d53f-8711-4e43-8f99-cf24487de165 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:39.526300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5d53f-8711-4e43-8f99-cf24487de165 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:39.527461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5d53f-8711-4e43-8f99-cf24487de165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:39.529407 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5d53f-8711-4e43-8f99-cf24487de165 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:39.544003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 441/894] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jul 21 12:02:39 2022] GET /identity/v3/services => generated 1268 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:02:39.589022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c4f69-1a99-4398-aa39-b23ac59b569a None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:39.589935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c4f69-1a99-4398-aa39-b23ac59b569a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:39.590818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c4f69-1a99-4398-aa39-b23ac59b569a None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:39.601146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 442/895] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:02:39.604267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf6bf6-e16b-4076-a8aa-cbc1db9c8e6f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:39.605261 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf6bf6-e16b-4076-a8aa-cbc1db9c8e6f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:39.606124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf6bf6-e16b-4076-a8aa-cbc1db9c8e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:39.640217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-03bf6bf6-e16b-4076-a8aa-cbc1db9c8e6f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:39.643342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-03bf6bf6-e16b-4076-a8aa-cbc1db9c8e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:39.673025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d43261-e970-4dd5-bf1a-95632e9d582c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:39.723290 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b752d-9c76-4cac-8d50-9a71ebb37615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:39.725178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b752d-9c76-4cac-8d50-9a71ebb37615 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:39.725663 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b752d-9c76-4cac-8d50-9a71ebb37615 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:39.726082 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b752d-9c76-4cac-8d50-9a71ebb37615 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:39.738973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b752d-9c76-4cac-8d50-9a71ebb37615 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:39.741284 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b752d-9c76-4cac-8d50-9a71ebb37615 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-765b752d-9c76-4cac-8d50-9a71ebb37615 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:39.764567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:39.766144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:39.767735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:39.767735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:39.767735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:39.767735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:39.767735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:39.767735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:39.767735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:39.767735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:39.767735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 12:02:39.767735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:39.771325 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 443/897] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:39.771572 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 454/897] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jul 21 12:02:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:39.780513 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf6bf6-e16b-4076-a8aa-cbc1db9c8e6f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:39.811372 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b752d-9c76-4cac-8d50-9a71ebb37615 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:39.859871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:39.927788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:39.998751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf6bf6-e16b-4076-a8aa-cbc1db9c8e6f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:40.030084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b752d-9c76-4cac-8d50-9a71ebb37615 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:40.087927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c1b15-c2e7-4d68-873b-f2055be7ecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:40.089319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c1b15-c2e7-4d68-873b-f2055be7ecac None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:40.089804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c1b15-c2e7-4d68-873b-f2055be7ecac None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:40.090296 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c1b15-c2e7-4d68-873b-f2055be7ecac None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:40.092034 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c1b15-c2e7-4d68-873b-f2055be7ecac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:40.092597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c1b15-c2e7-4d68-873b-f2055be7ecac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:40.095533 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c1b15-c2e7-4d68-873b-f2055be7ecac None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:40.104223 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12002e-058f-4293-b3d9-fa707c7fb2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:40.105833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12002e-058f-4293-b3d9-fa707c7fb2b9 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:40.106728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12002e-058f-4293-b3d9-fa707c7fb2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:40.107463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12002e-058f-4293-b3d9-fa707c7fb2b9 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:40.109105 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12002e-058f-4293-b3d9-fa707c7fb2b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:40.111998 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12002e-058f-4293-b3d9-fa707c7fb2b9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:40.134723 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 444/898] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jul 21 12:02:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:40.143313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c1b15-c2e7-4d68-873b-f2055be7ecac None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:40.147157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 455/899] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jul 21 12:02:39 2022] POST /identity/v3/services => generated 241 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:02:40.348063 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c1b15-c2e7-4d68-873b-f2055be7ecac None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:40.407258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:40.427428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cfc38-f422-4c79-a998-0a7958f497c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:40.429017 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cfc38-f422-4c79-a998-0a7958f497c9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:40.429774 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cfc38-f422-4c79-a998-0a7958f497c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:40.430524 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cfc38-f422-4c79-a998-0a7958f497c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:40.566415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cfc38-f422-4c79-a998-0a7958f497c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:40.569124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cfc38-f422-4c79-a998-0a7958f497c9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:40.715967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d60d3a-af90-4308-8aa2-e6dee88651e1 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:40.717380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d60d3a-af90-4308-8aa2-e6dee88651e1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:40.718136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d60d3a-af90-4308-8aa2-e6dee88651e1 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:40.721327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 456/900] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:40.730246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11622b-9361-4e7b-b6bf-08319b993386 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:40.731308 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11622b-9361-4e7b-b6bf-08319b993386 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:40.732049 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11622b-9361-4e7b-b6bf-08319b993386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:40.743511 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 445/901] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:02:40 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:02:40.749323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cfc38-f422-4c79-a998-0a7958f497c9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:40.761151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-bc11622b-9361-4e7b-b6bf-08319b993386 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:40.763831 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bc11622b-9361-4e7b-b6bf-08319b993386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:40.779744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:40.860824 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cfc38-f422-4c79-a998-0a7958f497c9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:40.891031 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 457/902] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:40.899727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211acb3-1911-405b-be88-ee5205822124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:40.900544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211acb3-1911-405b-be88-ee5205822124 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:40.900826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211acb3-1911-405b-be88-ee5205822124 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:40.901108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211acb3-1911-405b-be88-ee5205822124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:40.912933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211acb3-1911-405b-be88-ee5205822124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:40.914434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211acb3-1911-405b-be88-ee5205822124 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:40.926273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11622b-9361-4e7b-b6bf-08319b993386 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-d211acb3-1911-405b-be88-ee5205822124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:40.934074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:40.935890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:40.937563 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:40.937563 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:40.937563 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:40.937563 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:40.937563 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 446/903] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:40.941510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211acb3-1911-405b-be88-ee5205822124 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:40.967306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:41.032801 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:41.058680 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211acb3-1911-405b-be88-ee5205822124 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:41.109680 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6171117-0768-4b6c-b5ab-0a607f1524c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:41.112050 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6171117-0768-4b6c-b5ab-0a607f1524c1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:41.112979 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6171117-0768-4b6c-b5ab-0a607f1524c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:41.113694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6171117-0768-4b6c-b5ab-0a607f1524c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:41.116679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6171117-0768-4b6c-b5ab-0a607f1524c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:41.117490 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6171117-0768-4b6c-b5ab-0a607f1524c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:41.121104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6171117-0768-4b6c-b5ab-0a607f1524c1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:41.138038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11622b-9361-4e7b-b6bf-08319b993386 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:41.155045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 447/904] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:41.163140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6171117-0768-4b6c-b5ab-0a607f1524c1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:41.198997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6b197-3406-4bab-ba4c-a1b51a1017f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:41.200637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6b197-3406-4bab-ba4c-a1b51a1017f8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:41.201239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6b197-3406-4bab-ba4c-a1b51a1017f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:41.202147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6b197-3406-4bab-ba4c-a1b51a1017f8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:41.203370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6b197-3406-4bab-ba4c-a1b51a1017f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:41.206044 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6b197-3406-4bab-ba4c-a1b51a1017f8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c2a6b197-3406-4bab-ba4c-a1b51a1017f8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:41.230930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:41.232750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 12:02:41.234307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:41.239115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 458/905] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Jul 21 12:02:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:41.242900 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6b197-3406-4bab-ba4c-a1b51a1017f8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:41.376967 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6171117-0768-4b6c-b5ab-0a607f1524c1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:41.407241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:41.424638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6b197-3406-4bab-ba4c-a1b51a1017f8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:41.465024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c472c-d421-483b-ac4e-c751d409e34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:41.472468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c472c-d421-483b-ac4e-c751d409e34e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:41.473550 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c472c-d421-483b-ac4e-c751d409e34e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:41.474273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c472c-d421-483b-ac4e-c751d409e34e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:41.487124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c472c-d421-483b-ac4e-c751d409e34e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:41.490115 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c472c-d421-483b-ac4e-c751d409e34e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:41.495578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:41.499439 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032f4a8-119f-4405-a86b-e399140fcd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:41.501069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032f4a8-119f-4405-a86b-e399140fcd7f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:41.501850 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032f4a8-119f-4405-a86b-e399140fcd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:41.502565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032f4a8-119f-4405-a86b-e399140fcd7f None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:41.504195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032f4a8-119f-4405-a86b-e399140fcd7f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:41.505040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032f4a8-119f-4405-a86b-e399140fcd7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:41.508158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032f4a8-119f-4405-a86b-e399140fcd7f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:41.518689 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 459/906] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jul 21 12:02:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-f62c472c-d421-483b-ac4e-c751d409e34e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:41.520621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:41.522343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:41.524145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:41.524145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:41.524145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:41.524145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:41.524145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:41.524145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:41.524145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:41.524145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:41.527593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032f4a8-119f-4405-a86b-e399140fcd7f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:41.531090 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 448/907] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:41.533913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c472c-d421-483b-ac4e-c751d409e34e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:41.717389 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c472c-d421-483b-ac4e-c751d409e34e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:41.747310 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032f4a8-119f-4405-a86b-e399140fcd7f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:41.786251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f68dec-52cc-4157-8319-e0fa87bc16e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:41.787742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f68dec-52cc-4157-8319-e0fa87bc16e0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:41.788435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f68dec-52cc-4157-8319-e0fa87bc16e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:41.789972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f68dec-52cc-4157-8319-e0fa87bc16e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:41.791784 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f68dec-52cc-4157-8319-e0fa87bc16e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:41.792897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f68dec-52cc-4157-8319-e0fa87bc16e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:41.796773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f68dec-52cc-4157-8319-e0fa87bc16e0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:41.816038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0299c-973d-4064-854f-63e7eb2e5972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:41.817647 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0299c-973d-4064-854f-63e7eb2e5972 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:41.818402 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0299c-973d-4064-854f-63e7eb2e5972 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:41.819248 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0299c-973d-4064-854f-63e7eb2e5972 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:41.820853 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0299c-973d-4064-854f-63e7eb2e5972 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:41.821691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0299c-973d-4064-854f-63e7eb2e5972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:41.824008 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 449/908] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:41.829822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0299c-973d-4064-854f-63e7eb2e5972 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:41.832896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f68dec-52cc-4157-8319-e0fa87bc16e0 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:41.839923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 460/909] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jul 21 12:02:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:41.848952 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0299c-973d-4064-854f-63e7eb2e5972 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:41.871956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:41.983186 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:42.051153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0299c-973d-4064-854f-63e7eb2e5972 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:42.059841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f68dec-52cc-4157-8319-e0fa87bc16e0 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:42.124501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3216d6-f0eb-4f42-b4e4-479d7ed5a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:42.126105 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3216d6-f0eb-4f42-b4e4-479d7ed5a969 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:42.126840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3216d6-f0eb-4f42-b4e4-479d7ed5a969 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:42.127524 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3216d6-f0eb-4f42-b4e4-479d7ed5a969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:42.129301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3216d6-f0eb-4f42-b4e4-479d7ed5a969 None admin] RBAC: Adding query filter params (role.id=4aba4eb30dca482a9a29417a44a955d1, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=9410b04623a04e90ac47c4a53cd3c4e6) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:42.130064 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3216d6-f0eb-4f42-b4e4-479d7ed5a969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:42.131737 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ee411-7a33-45c0-b6ed-8094f89f7e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:42.132841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee411-7a33-45c0-b6ed-8094f89f7e3a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:42.133322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee411-7a33-45c0-b6ed-8094f89f7e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:42.133695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3216d6-f0eb-4f42-b4e4-479d7ed5a969 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:42.133866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee411-7a33-45c0-b6ed-8094f89f7e3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:42.135461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ee411-7a33-45c0-b6ed-8094f89f7e3a None admin] RBAC: Adding query filter params (interface=public, service_id=3c4ec314c05d4916b510c74e9f0034a2, region_id=RegionOne) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:42.136011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ee411-7a33-45c0-b6ed-8094f89f7e3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:42.139399 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ee411-7a33-45c0-b6ed-8094f89f7e3a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:42.145663 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 450/910] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:02:41 2022] GET /identity/v3/role_assignments?user.id=9410b04623a04e90ac47c4a53cd3c4e6&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=4aba4eb30dca482a9a29417a44a955d1 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:42.158712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 461/911] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jul 21 12:02:41 2022] GET /identity/v3/endpoints?service_id=3c4ec314c05d4916b510c74e9f0034a2&interface=public®ion_id=RegionOne => generated 194 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:42.163520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3216d6-f0eb-4f42-b4e4-479d7ed5a969 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:42.361039 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3216d6-f0eb-4f42-b4e4-479d7ed5a969 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:42.408291 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:42.431140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701d879-999f-402e-aa62-e020ce689adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:42.432121 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701d879-999f-402e-aa62-e020ce689adb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:42.432539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701d879-999f-402e-aa62-e020ce689adb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:42.432940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701d879-999f-402e-aa62-e020ce689adb None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:42.434021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701d879-999f-402e-aa62-e020ce689adb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:42.436240 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701d879-999f-402e-aa62-e020ce689adb None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:42.448785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 451/912] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jul 21 12:02:42 2022] GET /identity/v3/services => generated 1497 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:02:42.669470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fab2b8-2254-4946-9dc4-f8e447003a40 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:42.670144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fab2b8-2254-4946-9dc4-f8e447003a40 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:42.670637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fab2b8-2254-4946-9dc4-f8e447003a40 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:42.672614 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 462/913] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:02:42.678692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095d797-99ff-4e83-aff7-8e06b4c2640c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:42.679338 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095d797-99ff-4e83-aff7-8e06b4c2640c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:42.679830 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095d797-99ff-4e83-aff7-8e06b4c2640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:42.699290 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f095d797-99ff-4e83-aff7-8e06b4c2640c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:42.701008 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f095d797-99ff-4e83-aff7-8e06b4c2640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:42.803637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 452/914] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:42.827766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fab2b8-2254-4946-9dc4-f8e447003a40 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:42.927984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:42.969252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fab2b8-2254-4946-9dc4-f8e447003a40 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:43.008398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4836c2-5bfd-4e2d-abf3-c6c7914a2975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:43.009245 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4836c2-5bfd-4e2d-abf3-c6c7914a2975 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:43.009521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4836c2-5bfd-4e2d-abf3-c6c7914a2975 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:43.009792 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4836c2-5bfd-4e2d-abf3-c6c7914a2975 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:43.010556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4836c2-5bfd-4e2d-abf3-c6c7914a2975 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:43.011984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4836c2-5bfd-4e2d-abf3-c6c7914a2975 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-4e4836c2-5bfd-4e2d-abf3-c6c7914a2975 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:43.025256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:43.027541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:43.029216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 463/915] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:02:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:43.041800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095d797-99ff-4e83-aff7-8e06b4c2640c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:43.233472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095d797-99ff-4e83-aff7-8e06b4c2640c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:43.275404 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:43.300536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc7899-db8c-4c92-ba73-059cdf1998b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:43.301709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc7899-db8c-4c92-ba73-059cdf1998b1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:43.302202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc7899-db8c-4c92-ba73-059cdf1998b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:43.302748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc7899-db8c-4c92-ba73-059cdf1998b1 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:43.304145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc7899-db8c-4c92-ba73-059cdf1998b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:43.304694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc7899-db8c-4c92-ba73-059cdf1998b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:43.307463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc7899-db8c-4c92-ba73-059cdf1998b1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:43.318148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 453/916] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:02:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:43.328283 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4836c2-5bfd-4e2d-abf3-c6c7914a2975 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:43.335033 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd918-7df1-4be7-9a80-c262dee91c38 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:43.335564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd918-7df1-4be7-9a80-c262dee91c38 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:43.336059 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd918-7df1-4be7-9a80-c262dee91c38 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:43.339164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 454/917] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:02:43.345759 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd205c-f0ea-49d6-b487-35a58691ac20 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:43.346259 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd205c-f0ea-49d6-b487-35a58691ac20 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:43.347075 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd205c-f0ea-49d6-b487-35a58691ac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:43.378869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5fdd205c-f0ea-49d6-b487-35a58691ac20 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:43.381858 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5fdd205c-f0ea-49d6-b487-35a58691ac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:43.519473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 455/918] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:43.535385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4836c2-5bfd-4e2d-abf3-c6c7914a2975 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:43.547055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd205c-f0ea-49d6-b487-35a58691ac20 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:43.584479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411eb04-14f0-4e24-a8ef-458cdcb21753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:43.585165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411eb04-14f0-4e24-a8ef-458cdcb21753 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:43.585446 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411eb04-14f0-4e24-a8ef-458cdcb21753 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:43.585722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411eb04-14f0-4e24-a8ef-458cdcb21753 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:43.586451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411eb04-14f0-4e24-a8ef-458cdcb21753 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:43.590411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411eb04-14f0-4e24-a8ef-458cdcb21753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:43.591615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411eb04-14f0-4e24-a8ef-458cdcb21753 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:43.598286 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:43.598554 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 464/919] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jul 21 12:02:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:43.608233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411eb04-14f0-4e24-a8ef-458cdcb21753 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:43.724416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411eb04-14f0-4e24-a8ef-458cdcb21753 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:43.749005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd205c-f0ea-49d6-b487-35a58691ac20 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:43.762934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507c70c-7200-431f-81d1-de7525659d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:43.763901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507c70c-7200-431f-81d1-de7525659d83 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:43.764338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507c70c-7200-431f-81d1-de7525659d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:43.764754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507c70c-7200-431f-81d1-de7525659d83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:43.765687 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507c70c-7200-431f-81d1-de7525659d83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:43.767422 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507c70c-7200-431f-81d1-de7525659d83 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:43.778394 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:43.791401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 465/920] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jul 21 12:02:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:02:43.826545 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9828b-9a7b-4a40-840f-23a84664da58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:43.828047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9828b-9a7b-4a40-840f-23a84664da58 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:43.828562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9828b-9a7b-4a40-840f-23a84664da58 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:43.829000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9828b-9a7b-4a40-840f-23a84664da58 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:43.829887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9828b-9a7b-4a40-840f-23a84664da58 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:43.831602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9828b-9a7b-4a40-840f-23a84664da58 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-0ac9828b-9a7b-4a40-840f-23a84664da58 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:43.845841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:43.847101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:43.848055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:43.848055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:43.848055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:43.848055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:43.848055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:43.848055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:43.848055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:43.848055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:43.848055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:43.848055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:43.848055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:43.848055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:43.848055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:43.848055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:43.850792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 456/921] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jul 21 12:02:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:43.857407 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507c70c-7200-431f-81d1-de7525659d83 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:43.936714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:43.987792 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507c70c-7200-431f-81d1-de7525659d83 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:44.028784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b6da7-8d73-4198-848f-59d11473fcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:44.029391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b6da7-8d73-4198-848f-59d11473fcbf None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:44.029673 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b6da7-8d73-4198-848f-59d11473fcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:44.029950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b6da7-8d73-4198-848f-59d11473fcbf None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:44.030709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b6da7-8d73-4198-848f-59d11473fcbf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:44.031026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b6da7-8d73-4198-848f-59d11473fcbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:44.032653 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b6da7-8d73-4198-848f-59d11473fcbf None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:44.039271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 466/922] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jul 21 12:02:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:44.045515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9828b-9a7b-4a40-840f-23a84664da58 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:44.165449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9828b-9a7b-4a40-840f-23a84664da58 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:44.205199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f473bee-aa73-4590-a30f-4a45cc250417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:44.206285 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f473bee-aa73-4590-a30f-4a45cc250417 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:44.206820 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f473bee-aa73-4590-a30f-4a45cc250417 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:44.207315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f473bee-aa73-4590-a30f-4a45cc250417 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:44.208255 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f473bee-aa73-4590-a30f-4a45cc250417 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:44.208862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f473bee-aa73-4590-a30f-4a45cc250417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:44.210458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f473bee-aa73-4590-a30f-4a45cc250417 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:44.216992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 457/923] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jul 21 12:02:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:44.223503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b6da7-8d73-4198-848f-59d11473fcbf None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:44.336331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b6da7-8d73-4198-848f-59d11473fcbf None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:44.359057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:44.374908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1358345-9f1e-4c79-be3e-eaf6f5b8ecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:44.375599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1358345-9f1e-4c79-be3e-eaf6f5b8ecb8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:44.375881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1358345-9f1e-4c79-be3e-eaf6f5b8ecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:44.376160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1358345-9f1e-4c79-be3e-eaf6f5b8ecb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:44.376970 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1358345-9f1e-4c79-be3e-eaf6f5b8ecb8 None admin] RBAC: Adding query filter params (interface=public, service_id=fb2652a4a58c4efeaef7c3c5f094ec67, region_id=RegionOne) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:44.377282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1358345-9f1e-4c79-be3e-eaf6f5b8ecb8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:44.378687 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1358345-9f1e-4c79-be3e-eaf6f5b8ecb8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:44.385105 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 467/924] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jul 21 12:02:44 2022] GET /identity/v3/endpoints?service_id=fb2652a4a58c4efeaef7c3c5f094ec67&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:44.391088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f473bee-aa73-4590-a30f-4a45cc250417 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:44.433285 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:44.550741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f473bee-aa73-4590-a30f-4a45cc250417 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:44.615823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdb2be-e979-42d9-8a48-058766df9f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:44.616883 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdb2be-e979-42d9-8a48-058766df9f5a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:44.617376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdb2be-e979-42d9-8a48-058766df9f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:44.617854 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdb2be-e979-42d9-8a48-058766df9f5a None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:44.619173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdb2be-e979-42d9-8a48-058766df9f5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:44.621793 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdb2be-e979-42d9-8a48-058766df9f5a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:44.634779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 458/925] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jul 21 12:02:44 2022] GET /identity/v3/services => generated 1497 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:02:44.819561 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba33652-fbe1-4736-8d2b-87a67e96eb9c None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:44.819910 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba33652-fbe1-4736-8d2b-87a67e96eb9c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:44.820119 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba33652-fbe1-4736-8d2b-87a67e96eb9c None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:44.821747 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 468/926] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:44.829117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6589f3-26e4-409a-8116-0caba8efc965 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:44.829660 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6589f3-26e4-409a-8116-0caba8efc965 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:44.830081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6589f3-26e4-409a-8116-0caba8efc965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:44.852220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3e6589f3-26e4-409a-8116-0caba8efc965 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:44.853831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3e6589f3-26e4-409a-8116-0caba8efc965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:44.959782 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 459/927] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:44.982688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba33652-fbe1-4736-8d2b-87a67e96eb9c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:45.104751 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba33652-fbe1-4736-8d2b-87a67e96eb9c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:45.146542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bac950-8dfb-4274-8b1e-4235cd1ef769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:45.147857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac950-8dfb-4274-8b1e-4235cd1ef769 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:45.148369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac950-8dfb-4274-8b1e-4235cd1ef769 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:45.148867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac950-8dfb-4274-8b1e-4235cd1ef769 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:45.162970 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bac950-8dfb-4274-8b1e-4235cd1ef769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-99bac950-8dfb-4274-8b1e-4235cd1ef769 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:45.171939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:45.173000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:45.173903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:45.173903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:45.173903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:45.173903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:45.173903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:45.173903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:45.173903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:45.173903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:45.173903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:45.173903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:45.173903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 12:02:45.173903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:45.176458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 469/928] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jul 21 12:02:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:45.182884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6589f3-26e4-409a-8116-0caba8efc965 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:45.219681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:45.281724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810b5aa-d11f-4663-90f0-88c1fdfce319 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:45.282257 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810b5aa-d11f-4663-90f0-88c1fdfce319 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:45.282791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810b5aa-d11f-4663-90f0-88c1fdfce319 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:45.290832 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 470/929] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:45.294877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff75ff-4371-46cb-8c81-95219d7e5b55 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:45.295375 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff75ff-4371-46cb-8c81-95219d7e5b55 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:45.295852 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff75ff-4371-46cb-8c81-95219d7e5b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:45.322140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b3ff75ff-4371-46cb-8c81-95219d7e5b55 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:45.324301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b3ff75ff-4371-46cb-8c81-95219d7e5b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:45.331626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6589f3-26e4-409a-8116-0caba8efc965 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:45.394841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:45.397131 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d419926-599a-4860-9610-5c596948613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:45.398835 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d419926-599a-4860-9610-5c596948613b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:45.399352 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d419926-599a-4860-9610-5c596948613b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:45.400177 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d419926-599a-4860-9610-5c596948613b None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:45.401725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d419926-599a-4860-9610-5c596948613b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:45.402340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d419926-599a-4860-9610-5c596948613b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:45.405091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d419926-599a-4860-9610-5c596948613b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:45.422921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 460/930] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jul 21 12:02:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:45.432271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d419926-599a-4860-9610-5c596948613b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:45.457605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 471/931] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:45.506242 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff75ff-4371-46cb-8c81-95219d7e5b55 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:45.635658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:45.656434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d419926-599a-4860-9610-5c596948613b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:45.711064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff75ff-4371-46cb-8c81-95219d7e5b55 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:45.727984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f9b07-001a-49dd-bf32-a373f1ce0a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:45.729349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f9b07-001a-49dd-bf32-a373f1ce0a4e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:45.729967 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f9b07-001a-49dd-bf32-a373f1ce0a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:45.730687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f9b07-001a-49dd-bf32-a373f1ce0a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:45.753903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f9b07-001a-49dd-bf32-a373f1ce0a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:45.757108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f9b07-001a-49dd-bf32-a373f1ce0a4e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:45.779417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ae6c0-8160-4899-a019-6116307e71e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:45.781126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ae6c0-8160-4899-a019-6116307e71e3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:45.781836 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ae6c0-8160-4899-a019-6116307e71e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:45.782473 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ae6c0-8160-4899-a019-6116307e71e3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:45.783964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ae6c0-8160-4899-a019-6116307e71e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:45.786803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ae6c0-8160-4899-a019-6116307e71e3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-939f9b07-001a-49dd-bf32-a373f1ce0a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:45.793593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:45.795608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:45.797642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:45.797642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:45.797642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:45.797642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:45.806697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 461/932] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:45.809906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f9b07-001a-49dd-bf32-a373f1ce0a4e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-1c8ae6c0-8160-4899-a019-6116307e71e3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:45.820487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:45.822325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 12:02:45.824338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:45.830128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 472/933] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Jul 21 12:02:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:45.832387 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ae6c0-8160-4899-a019-6116307e71e3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:45.907826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:46.024789 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ae6c0-8160-4899-a019-6116307e71e3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:46.025767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f9b07-001a-49dd-bf32-a373f1ce0a4e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:46.091204 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5683d2-3580-4e38-adf5-7a414c24cf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:46.092367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5683d2-3580-4e38-adf5-7a414c24cf0d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:46.092837 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5683d2-3580-4e38-adf5-7a414c24cf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:46.093303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5683d2-3580-4e38-adf5-7a414c24cf0d None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:46.094832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5683d2-3580-4e38-adf5-7a414c24cf0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:46.095387 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5683d2-3580-4e38-adf5-7a414c24cf0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:46.095947 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939ee0f-9647-4863-ae55-cee3a540a804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:46.097490 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939ee0f-9647-4863-ae55-cee3a540a804 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:46.097895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5683d2-3580-4e38-adf5-7a414c24cf0d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:46.098543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939ee0f-9647-4863-ae55-cee3a540a804 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:46.099305 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939ee0f-9647-4863-ae55-cee3a540a804 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:46.101200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939ee0f-9647-4863-ae55-cee3a540a804 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:46.101950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939ee0f-9647-4863-ae55-cee3a540a804 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:46.104837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939ee0f-9647-4863-ae55-cee3a540a804 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:46.115049 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 473/934] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jul 21 12:02:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:46.125631 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939ee0f-9647-4863-ae55-cee3a540a804 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:46.129871 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 462/935] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:46.139158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5683d2-3580-4e38-adf5-7a414c24cf0d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:46.145615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:46.332536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5683d2-3580-4e38-adf5-7a414c24cf0d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:46.353056 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939ee0f-9647-4863-ae55-cee3a540a804 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:46.357891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:46.405203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60a747-ad35-4e33-9aac-7959b27888f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:46.407978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a747-ad35-4e33-9aac-7959b27888f0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:46.409760 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a747-ad35-4e33-9aac-7959b27888f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:46.410867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a747-ad35-4e33-9aac-7959b27888f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:46.429789 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53b968-82f2-4c0c-aa74-7408f9197d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:46.430116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60a747-ad35-4e33-9aac-7959b27888f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:46.431104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53b968-82f2-4c0c-aa74-7408f9197d30 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:46.431673 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53b968-82f2-4c0c-aa74-7408f9197d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:46.432220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53b968-82f2-4c0c-aa74-7408f9197d30 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:46.433629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53b968-82f2-4c0c-aa74-7408f9197d30 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:46.434332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53b968-82f2-4c0c-aa74-7408f9197d30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:46.434769 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60a747-ad35-4e33-9aac-7959b27888f0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:46.437209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53b968-82f2-4c0c-aa74-7408f9197d30 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:46.459121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 474/936] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jul 21 12:02:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:46.468339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53b968-82f2-4c0c-aa74-7408f9197d30 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-2b60a747-ad35-4e33-9aac-7959b27888f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:46.481873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:46.484330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:46.486212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:46.486212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:46.486212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:46.486212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:46.486212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:46.486212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:46.486212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:46.486212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:46.486212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 12:02:46.486212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:46.486212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 463/937] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jul 21 12:02:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:46.486212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd332c-b5be-4dd9-9999-70a391532063 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:46.486212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd332c-b5be-4dd9-9999-70a391532063 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:46.490217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd332c-b5be-4dd9-9999-70a391532063 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:46.491023 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 464/938] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:46.494061 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf6067-daac-4a8c-8c45-7d50bb4bf039 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:46.494521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf6067-daac-4a8c-8c45-7d50bb4bf039 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:46.495009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf6067-daac-4a8c-8c45-7d50bb4bf039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:46.517800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-94bf6067-daac-4a8c-8c45-7d50bb4bf039 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:46.519061 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-94bf6067-daac-4a8c-8c45-7d50bb4bf039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:46.601211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:46.616147 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 465/939] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:46.619184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf6067-daac-4a8c-8c45-7d50bb4bf039 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:46.662547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53b968-82f2-4c0c-aa74-7408f9197d30 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:46.724481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9cd0b-9b67-4bb1-ba31-d7b417f5c58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:46.725356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9cd0b-9b67-4bb1-ba31-d7b417f5c58b None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:46.725766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9cd0b-9b67-4bb1-ba31-d7b417f5c58b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:46.726176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9cd0b-9b67-4bb1-ba31-d7b417f5c58b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:46.727163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9cd0b-9b67-4bb1-ba31-d7b417f5c58b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:46.728765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9cd0b-9b67-4bb1-ba31-d7b417f5c58b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:46.762931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 475/940] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jul 21 12:02:46 2022] POST /identity/v3/endpoints => generated 347 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:02:46.764828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9cd0b-9b67-4bb1-ba31-d7b417f5c58b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:46.813619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf6067-daac-4a8c-8c45-7d50bb4bf039 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:46.821668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:46.866575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c6aa0-1867-45be-9eec-c2bc490875d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:46.867216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c6aa0-1867-45be-9eec-c2bc490875d9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:46.867504 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c6aa0-1867-45be-9eec-c2bc490875d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:46.867787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c6aa0-1867-45be-9eec-c2bc490875d9 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:46.868659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c6aa0-1867-45be-9eec-c2bc490875d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:46.868972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c6aa0-1867-45be-9eec-c2bc490875d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:46.870465 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c6aa0-1867-45be-9eec-c2bc490875d9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:46.893644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 466/941] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jul 21 12:02:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:46.896636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ea506-af7c-4df0-a6fd-3b6840ae8a1d None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:46.897135 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ea506-af7c-4df0-a6fd-3b6840ae8a1d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:46.897617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ea506-af7c-4df0-a6fd-3b6840ae8a1d None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:46.902789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 467/942] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:46.902789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ea506-af7c-4df0-a6fd-3b6840ae8a1d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:46.936051 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9cd0b-9b67-4bb1-ba31-d7b417f5c58b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:46.959358 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:46.977147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db0ffa-c88c-4cb2-a802-24898831c30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:46.977942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db0ffa-c88c-4cb2-a802-24898831c30e None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:46.978231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db0ffa-c88c-4cb2-a802-24898831c30e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:46.978526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db0ffa-c88c-4cb2-a802-24898831c30e None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:46.979290 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db0ffa-c88c-4cb2-a802-24898831c30e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:46.980767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db0ffa-c88c-4cb2-a802-24898831c30e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:46.982262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: WARNING keystone.server.flask.common [None req-a3db0ffa-c88c-4cb2-a802-24898831c30e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 12:02:47.002025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.sql.core [None req-a3db0ffa-c88c-4cb2-a802-24898831c30e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 12:02:47.002025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 12:02:47.002025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [parameters: {'id': 'bfbc786b385c4334a818d90be72b2164', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 12:02:47.002025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80410) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 12:02:47.018922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-a3db0ffa-c88c-4cb2-a802-24898831c30e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bfbc786b385c4334a818d90be72b2164.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bfbc786b385c4334a818d90be72b2164. Jul 21 12:02:47.018922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:47.018922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 12:02:47.018922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 12:02:47.018922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 12:02:47.018922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 12:02:47.018922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 12:02:47.018922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 12:02:47.018922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 12:02:47.018922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application conn.query(q) Jul 21 12:02:47.018922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 12:02:47.018922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 12:02:47.018922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result.read() Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 12:02:47.019827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application next(self.gen) Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application yield resource Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application next(self.gen) Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise self.value Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application session.commit() Jul 21 12:02:47.020835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.session.flush() Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application compat.raise_( Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 12:02:47.021723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 12:02:47.022613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application conn.query(q) Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result.read() Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 12:02:47.023476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [parameters: {'id': 'bfbc786b385c4334a818d90be72b2164', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:47.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:47.030624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:47.033217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:47.033217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 12:02:47.033217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 12:02:47.033217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:47.033217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:47.033217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 12:02:47.033217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 12:02:47.033217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bfbc786b385c4334a818d90be72b2164. Jul 21 12:02:47.033217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:47.033217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 476/943] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Jul 21 12:02:46 2022] POST /identity/v3/projects => generated 262 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:47.033217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d611e-913e-43b2-a8b2-0a51af3620e2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:47.033217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d611e-913e-43b2-a8b2-0a51af3620e2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:47.034786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d611e-913e-43b2-a8b2-0a51af3620e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:47.037606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ea506-af7c-4df0-a6fd-3b6840ae8a1d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:47.049047 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-308d611e-913e-43b2-a8b2-0a51af3620e2 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:47.050585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-308d611e-913e-43b2-a8b2-0a51af3620e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:47.083781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323ad19-63e3-4bdf-931c-88d62cfb1628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:47.084857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323ad19-63e3-4bdf-931c-88d62cfb1628 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:47.085291 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323ad19-63e3-4bdf-931c-88d62cfb1628 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:47.085740 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323ad19-63e3-4bdf-931c-88d62cfb1628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:47.100758 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323ad19-63e3-4bdf-931c-88d62cfb1628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:47.103448 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323ad19-63e3-4bdf-931c-88d62cfb1628 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e323ad19-63e3-4bdf-931c-88d62cfb1628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:47.126163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:47.127276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:47.128349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:47.128349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:47.128349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:47.128349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:47.135274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 468/944] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:47.136809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323ad19-63e3-4bdf-931c-88d62cfb1628 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:47.175356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 477/945] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:47.178406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d611e-913e-43b2-a8b2-0a51af3620e2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:47.207137 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:47.263498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:47.266503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323ad19-63e3-4bdf-931c-88d62cfb1628 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:47.311310 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff492d28-8644-4c8f-b83c-24353f8d1365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:47.312425 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff492d28-8644-4c8f-b83c-24353f8d1365 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:47.312885 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff492d28-8644-4c8f-b83c-24353f8d1365 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:47.313249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff492d28-8644-4c8f-b83c-24353f8d1365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:47.323530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff492d28-8644-4c8f-b83c-24353f8d1365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:47.325301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d611e-913e-43b2-a8b2-0a51af3620e2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:47.325471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff492d28-8644-4c8f-b83c-24353f8d1365 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ff492d28-8644-4c8f-b83c-24353f8d1365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:47.343137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:47.344912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:47.347675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:47.347675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:47.347675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:47.347675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:47.347675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:47.347675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:47.347675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:47.347675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:47.347675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 469/946] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:47.347675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff492d28-8644-4c8f-b83c-24353f8d1365 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:47.373896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2e4b1-0792-4d8f-85f5-9d2a1ff12b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:47.374578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2e4b1-0792-4d8f-85f5-9d2a1ff12b85 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:47.374900 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2e4b1-0792-4d8f-85f5-9d2a1ff12b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:47.375189 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2e4b1-0792-4d8f-85f5-9d2a1ff12b85 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:47.375919 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2e4b1-0792-4d8f-85f5-9d2a1ff12b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:47.376383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2e4b1-0792-4d8f-85f5-9d2a1ff12b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:47.377938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2e4b1-0792-4d8f-85f5-9d2a1ff12b85 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:47.400690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 478/947] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:47.400690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2e4b1-0792-4d8f-85f5-9d2a1ff12b85 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:47.476705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff492d28-8644-4c8f-b83c-24353f8d1365 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:47.490340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:47.524597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090cf45-fb75-4d69-b751-4f1b910efb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:47.525510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090cf45-fb75-4d69-b751-4f1b910efb5b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:47.525817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090cf45-fb75-4d69-b751-4f1b910efb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:47.526276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090cf45-fb75-4d69-b751-4f1b910efb5b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:47.527187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090cf45-fb75-4d69-b751-4f1b910efb5b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:47.528808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090cf45-fb75-4d69-b751-4f1b910efb5b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:47.535412 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2e4b1-0792-4d8f-85f5-9d2a1ff12b85 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-1090cf45-fb75-4d69-b751-4f1b910efb5b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:47.543724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:47.546085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:47.548791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 470/948] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jul 21 12:02:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:47.552070 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090cf45-fb75-4d69-b751-4f1b910efb5b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:47.580108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68b0c4-8bb5-4c25-8743-877ca83f7640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:47.580663 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68b0c4-8bb5-4c25-8743-877ca83f7640 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:47.580951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68b0c4-8bb5-4c25-8743-877ca83f7640 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:47.581325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68b0c4-8bb5-4c25-8743-877ca83f7640 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:47.582096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68b0c4-8bb5-4c25-8743-877ca83f7640 None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:47.582408 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68b0c4-8bb5-4c25-8743-877ca83f7640 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:47.583901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68b0c4-8bb5-4c25-8743-877ca83f7640 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:47.595204 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:47.604285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 479/949] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jul 21 12:02:47 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:47.611760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68b0c4-8bb5-4c25-8743-877ca83f7640 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:47.736537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090cf45-fb75-4d69-b751-4f1b910efb5b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:47.794850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d356a5-fba8-44b2-ad36-149d54a38786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:47.796071 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d356a5-fba8-44b2-ad36-149d54a38786 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:47.796356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d356a5-fba8-44b2-ad36-149d54a38786 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:47.796669 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d356a5-fba8-44b2-ad36-149d54a38786 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:47.799560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68b0c4-8bb5-4c25-8743-877ca83f7640 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:47.806934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d356a5-fba8-44b2-ad36-149d54a38786 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:47.808420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d356a5-fba8-44b2-ad36-149d54a38786 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e0d356a5-fba8-44b2-ad36-149d54a38786 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:47.828217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:47.829164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:47.830398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:47.830398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:47.830398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:47.830398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:47.830398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:47.830398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:47.830398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:47.830398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:47.834071 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 471/950] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:47.835674 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d356a5-fba8-44b2-ad36-149d54a38786 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:47.850352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:47.866502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a39b9-019c-471f-bd37-855c385f6af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:47.867329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a39b9-019c-471f-bd37-855c385f6af6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:47.867678 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a39b9-019c-471f-bd37-855c385f6af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:47.868024 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a39b9-019c-471f-bd37-855c385f6af6 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:47.868949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a39b9-019c-471f-bd37-855c385f6af6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:47.869330 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a39b9-019c-471f-bd37-855c385f6af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:47.870992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a39b9-019c-471f-bd37-855c385f6af6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:47.877337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 480/951] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jul 21 12:02:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:47.887374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a39b9-019c-471f-bd37-855c385f6af6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:47.948388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:47.968912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d356a5-fba8-44b2-ad36-149d54a38786 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:48.012904 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075030bd-e9b4-4d45-b9b0-6b18cfee4905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:48.014278 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075030bd-e9b4-4d45-b9b0-6b18cfee4905 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:48.014762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075030bd-e9b4-4d45-b9b0-6b18cfee4905 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:48.015399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075030bd-e9b4-4d45-b9b0-6b18cfee4905 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:48.016809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075030bd-e9b4-4d45-b9b0-6b18cfee4905 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:48.017294 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075030bd-e9b4-4d45-b9b0-6b18cfee4905 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:48.019243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075030bd-e9b4-4d45-b9b0-6b18cfee4905 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:48.038584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 472/952] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:48.044510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a39b9-019c-471f-bd37-855c385f6af6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:48.048315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075030bd-e9b4-4d45-b9b0-6b18cfee4905 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:48.104387 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd418a2-614e-4a50-b053-549db9533b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:48.105454 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd418a2-614e-4a50-b053-549db9533b91 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:48.105976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd418a2-614e-4a50-b053-549db9533b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:48.106427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd418a2-614e-4a50-b053-549db9533b91 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:48.108206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd418a2-614e-4a50-b053-549db9533b91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:48.108206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd418a2-614e-4a50-b053-549db9533b91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:48.110544 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd418a2-614e-4a50-b053-549db9533b91 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:48.119842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 481/953] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jul 21 12:02:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:48.127803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd418a2-614e-4a50-b053-549db9533b91 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:48.183592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075030bd-e9b4-4d45-b9b0-6b18cfee4905 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:48.212493 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:48.229449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4970aa-9916-4e55-897e-19456b722bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:48.230365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4970aa-9916-4e55-897e-19456b722bf7 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:48.230649 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4970aa-9916-4e55-897e-19456b722bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:48.231010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4970aa-9916-4e55-897e-19456b722bf7 None admin] PATH_INFO: `/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/9410b04623a04e90ac47c4a53cd3c4e6/roles/4aba4eb30dca482a9a29417a44a955d1` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:48.233255 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4970aa-9916-4e55-897e-19456b722bf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0946df6ba381401e8e4958d11c63cb2b, user_id=9410b04623a04e90ac47c4a53cd3c4e6, role_id=4aba4eb30dca482a9a29417a44a955d1)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:48.234731 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4970aa-9916-4e55-897e-19456b722bf7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:48.252964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 473/954] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:02:48 2022] PUT /identity/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/9410b04623a04e90ac47c4a53cd3c4e6/roles/4aba4eb30dca482a9a29417a44a955d1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:02:48.288272 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd418a2-614e-4a50-b053-549db9533b91 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:48.338589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ff375-c940-4088-a7dc-f8bb16feacb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:48.339384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ff375-c940-4088-a7dc-f8bb16feacb9 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:48.339716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ff375-c940-4088-a7dc-f8bb16feacb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:48.340155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ff375-c940-4088-a7dc-f8bb16feacb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:48.341063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ff375-c940-4088-a7dc-f8bb16feacb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:48.342690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ff375-c940-4088-a7dc-f8bb16feacb9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:48.368859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 482/955] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jul 21 12:02:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:02:49.091723 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a2e5f-97c1-415b-bd7d-41917b585a0e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:49.092275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a2e5f-97c1-415b-bd7d-41917b585a0e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:49.092649 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a2e5f-97c1-415b-bd7d-41917b585a0e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:49.095526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 474/956] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:49.104063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadeb4e-7a3f-4f49-9175-eaa033e52c85 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:49.104599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadeb4e-7a3f-4f49-9175-eaa033e52c85 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:49.104911 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadeb4e-7a3f-4f49-9175-eaa033e52c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:49.130539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-daadeb4e-7a3f-4f49-9175-eaa033e52c85 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:49.132533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-daadeb4e-7a3f-4f49-9175-eaa033e52c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:49.260682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 483/957] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:49.295218 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a2e5f-97c1-415b-bd7d-41917b585a0e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:49.300887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:49.472631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a2e5f-97c1-415b-bd7d-41917b585a0e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:49.526482 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a588f-2617-4874-ae48-597f453a1655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:49.527425 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a588f-2617-4874-ae48-597f453a1655 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:49.527750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a588f-2617-4874-ae48-597f453a1655 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:49.528031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a588f-2617-4874-ae48-597f453a1655 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:49.528707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a588f-2617-4874-ae48-597f453a1655 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:49.530104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a588f-2617-4874-ae48-597f453a1655 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-2d0a588f-2617-4874-ae48-597f453a1655 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:49.542709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:49.544049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:49.544923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 475/958] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:49.552517 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadeb4e-7a3f-4f49-9175-eaa033e52c85 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:49.604085 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:49.674626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadeb4e-7a3f-4f49-9175-eaa033e52c85 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:49.713814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8e7e6-e30e-4d1b-a3b9-e8366162c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:49.714465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8e7e6-e30e-4d1b-a3b9-e8366162c6fb None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:49.714775 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8e7e6-e30e-4d1b-a3b9-e8366162c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:49.715085 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8e7e6-e30e-4d1b-a3b9-e8366162c6fb None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:49.715854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8e7e6-e30e-4d1b-a3b9-e8366162c6fb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:49.716158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8e7e6-e30e-4d1b-a3b9-e8366162c6fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:49.717526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8e7e6-e30e-4d1b-a3b9-e8366162c6fb None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:49.723260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 484/959] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jul 21 12:02:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:49.732224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a588f-2617-4874-ae48-597f453a1655 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:49.813679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:49.857511 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a588f-2617-4874-ae48-597f453a1655 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:49.898023 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63cedb-62e2-491b-be75-585fadf46734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:49.898737 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63cedb-62e2-491b-be75-585fadf46734 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:49.899022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63cedb-62e2-491b-be75-585fadf46734 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:49.899296 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63cedb-62e2-491b-be75-585fadf46734 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:49.900059 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63cedb-62e2-491b-be75-585fadf46734 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:49.900368 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63cedb-62e2-491b-be75-585fadf46734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:49.901788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63cedb-62e2-491b-be75-585fadf46734 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:49.907968 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 476/960] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jul 21 12:02:49 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:50.466642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875e1da-aac4-489a-8423-a2626e57e9f1 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:50.467144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875e1da-aac4-489a-8423-a2626e57e9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:50.467234 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875e1da-aac4-489a-8423-a2626e57e9f1 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:50.468973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 485/961] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:50.474695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f44aff-7bf7-4049-8b64-3e564f937547 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:50.475183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f44aff-7bf7-4049-8b64-3e564f937547 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:50.475272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f44aff-7bf7-4049-8b64-3e564f937547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:50.493660 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-73f44aff-7bf7-4049-8b64-3e564f937547 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:50.494905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-73f44aff-7bf7-4049-8b64-3e564f937547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:50.611107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 477/962] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:50.634529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875e1da-aac4-489a-8423-a2626e57e9f1 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:50.713764 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8bc1-a078-434f-a1d4-e0ef25ff5c32 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:50.713949 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8bc1-a078-434f-a1d4-e0ef25ff5c32 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:50.714254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8bc1-a078-434f-a1d4-e0ef25ff5c32 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:50.716093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 478/963] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:02:50.721457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8cdac-8ede-4b63-b11b-d113840c3e45 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:50.721750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8cdac-8ede-4b63-b11b-d113840c3e45 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:50.722012 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8cdac-8ede-4b63-b11b-d113840c3e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:50.739536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f9a8cdac-8ede-4b63-b11b-d113840c3e45 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:50.740740 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f9a8cdac-8ede-4b63-b11b-d113840c3e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:50.812656 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875e1da-aac4-489a-8423-a2626e57e9f1 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:50.817008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:50.832867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:50.835141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 479/964] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:50.840353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f18215-de81-4cdf-b336-ddc49e802515 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:50.840643 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f18215-de81-4cdf-b336-ddc49e802515 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:50.840925 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f18215-de81-4cdf-b336-ddc49e802515 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:50.846625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 480/965] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:50.849852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfa71a-4682-498f-a4d6-cf45593d4a06 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:50.850636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfa71a-4682-498f-a4d6-cf45593d4a06 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:50.851390 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfa71a-4682-498f-a4d6-cf45593d4a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:50.873263 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39001f55-0148-4879-838f-1ee80449294a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:50.874172 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39001f55-0148-4879-838f-1ee80449294a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:50.874450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39001f55-0148-4879-838f-1ee80449294a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:50.874767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39001f55-0148-4879-838f-1ee80449294a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:50.885232 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7ecfa71a-4682-498f-a4d6-cf45593d4a06 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:50.887262 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7ecfa71a-4682-498f-a4d6-cf45593d4a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:50.888916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39001f55-0148-4879-838f-1ee80449294a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-39001f55-0148-4879-838f-1ee80449294a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:02:50.897560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:50.898521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:50.899875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:50.899875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:50.899875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:50.899875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:50.899875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:02:50.899875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:02:50.899875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:02:50.899875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:02:50.899875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:02:50.899875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:02:50.899875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 12:02:50.899875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:50.901895 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 486/966] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jul 21 12:02:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:50.903315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39001f55-0148-4879-838f-1ee80449294a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:50.978835 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 481/967] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:50.989624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfa71a-4682-498f-a4d6-cf45593d4a06 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:51.041568 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39001f55-0148-4879-838f-1ee80449294a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:51.090088 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171889e-1f37-4c15-b226-0afea91b41dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:51.090813 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171889e-1f37-4c15-b226-0afea91b41dc None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:51.091098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171889e-1f37-4c15-b226-0afea91b41dc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:51.091376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171889e-1f37-4c15-b226-0afea91b41dc None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:51.092096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171889e-1f37-4c15-b226-0afea91b41dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:51.093585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171889e-1f37-4c15-b226-0afea91b41dc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:51.108413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.sql.core [None req-2171889e-1f37-4c15-b226-0afea91b41dc None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 12:02:51.108413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 12:02:51.108413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [parameters: {'user_id': 'fb38c211b2a048adade6cfd845334cdf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 12:02:51.108413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80410) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-2171889e-1f37-4c15-b226-0afea91b41dc None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application conn.query(q) Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result.read() Jul 21 12:02:51.116394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 12:02:51.118939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application next(self.gen) Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application yield resource Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application next(self.gen) Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise self.value Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application session.commit() Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 12:02:51.120125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.session.flush() Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application compat.raise_( Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 12:02:51.121069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 12:02:51.122011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application conn.query(q) Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result.read() Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 12:02:51.122924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fb38c211b2a048adade6cfd845334cdf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:51.123865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 12:02:51.124705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 12:02:51.125688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 12:02:51.125688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 12:02:51.125688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 12:02:51.125688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 12:02:51.125688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 12:02:51.125688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:51.125688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 487/968] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jul 21 12:02:50 2022] POST /identity/v3/users => generated 160 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:51.125688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171889e-1f37-4c15-b226-0afea91b41dc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:51.163670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:51.179416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfa71a-4682-498f-a4d6-cf45593d4a06 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:51.207445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:51.220106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843599b1-cd96-4b90-b5ca-e8b73369b9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:51.220789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843599b1-cd96-4b90-b5ca-e8b73369b9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:51.221072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843599b1-cd96-4b90-b5ca-e8b73369b9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:51.221368 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843599b1-cd96-4b90-b5ca-e8b73369b9f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:51.222146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843599b1-cd96-4b90-b5ca-e8b73369b9f0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:51.222457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843599b1-cd96-4b90-b5ca-e8b73369b9f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:51.223874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843599b1-cd96-4b90-b5ca-e8b73369b9f0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:51.233726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 482/969] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jul 21 12:02:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:51.234481 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843599b1-cd96-4b90-b5ca-e8b73369b9f0 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:51.280881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171889e-1f37-4c15-b226-0afea91b41dc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:51.327629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c8089-756d-4e8d-8c21-77504dbeafaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:51.328453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c8089-756d-4e8d-8c21-77504dbeafaa None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:51.328735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c8089-756d-4e8d-8c21-77504dbeafaa None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:51.329018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c8089-756d-4e8d-8c21-77504dbeafaa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:51.329674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c8089-756d-4e8d-8c21-77504dbeafaa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:51.331290 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c8089-756d-4e8d-8c21-77504dbeafaa None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c48c8089-756d-4e8d-8c21-77504dbeafaa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:51.344420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:51.346080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:51.348164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 488/970] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jul 21 12:02:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:51.349890 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c8089-756d-4e8d-8c21-77504dbeafaa None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:51.374784 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843599b1-cd96-4b90-b5ca-e8b73369b9f0 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:51.425852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3847cb-f02d-48c5-9360-224c1a815861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:51.426698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3847cb-f02d-48c5-9360-224c1a815861 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:51.426991 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3847cb-f02d-48c5-9360-224c1a815861 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:51.427266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3847cb-f02d-48c5-9360-224c1a815861 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:51.436743 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3847cb-f02d-48c5-9360-224c1a815861 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:51.438320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3847cb-f02d-48c5-9360-224c1a815861 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-9e3847cb-f02d-48c5-9360-224c1a815861 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:51.455901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:51.457725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:51.464780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:51.464780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:51.464780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:51.464780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:51.464780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:51.464780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:51.464780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:51.464780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:51.464780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 12:02:51.464780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:51.464780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 483/971] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:02:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:51.464780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3847cb-f02d-48c5-9360-224c1a815861 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:51.472578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:51.496079 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c8089-756d-4e8d-8c21-77504dbeafaa None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:51.527973 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:51.561011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e974bcb-489a-4729-8311-41fb976e87f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:51.562257 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974bcb-489a-4729-8311-41fb976e87f7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:51.562781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974bcb-489a-4729-8311-41fb976e87f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:51.563274 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974bcb-489a-4729-8311-41fb976e87f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:51.585233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e974bcb-489a-4729-8311-41fb976e87f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:51.587969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e974bcb-489a-4729-8311-41fb976e87f7 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:51.597911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3847cb-f02d-48c5-9360-224c1a815861 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-1e974bcb-489a-4729-8311-41fb976e87f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:51.622427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:51.623455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:51.624355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:51.624355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:51.624355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:51.624355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:51.625332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 489/972] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:51.626893 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e974bcb-489a-4729-8311-41fb976e87f7 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:51.641581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ad85e-872d-40a5-9a12-e976e8a3dbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:51.642637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ad85e-872d-40a5-9a12-e976e8a3dbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:51.643148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ad85e-872d-40a5-9a12-e976e8a3dbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:51.643644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ad85e-872d-40a5-9a12-e976e8a3dbe3 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:51.644590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ad85e-872d-40a5-9a12-e976e8a3dbe3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:51.645093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ad85e-872d-40a5-9a12-e976e8a3dbe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:51.647495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ad85e-872d-40a5-9a12-e976e8a3dbe3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:51.655258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 484/973] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jul 21 12:02:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:51.656582 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ad85e-872d-40a5-9a12-e976e8a3dbe3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:51.768982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e974bcb-489a-4729-8311-41fb976e87f7 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:51.815260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126812b-35e2-4255-93a1-67c2caf5bae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:51.815950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126812b-35e2-4255-93a1-67c2caf5bae2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:51.816233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126812b-35e2-4255-93a1-67c2caf5bae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:51.816514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126812b-35e2-4255-93a1-67c2caf5bae2 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:51.817336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126812b-35e2-4255-93a1-67c2caf5bae2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:51.817642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126812b-35e2-4255-93a1-67c2caf5bae2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:51.819110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126812b-35e2-4255-93a1-67c2caf5bae2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:51.819859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ad85e-872d-40a5-9a12-e976e8a3dbe3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:51.832888 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:51.859813 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:51.860307 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957f330-d9d5-46ee-b58b-8e0b40ba8976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:51.860996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957f330-d9d5-46ee-b58b-8e0b40ba8976 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:51.861282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957f330-d9d5-46ee-b58b-8e0b40ba8976 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:51.861564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957f330-d9d5-46ee-b58b-8e0b40ba8976 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:51.862306 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957f330-d9d5-46ee-b58b-8e0b40ba8976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:51.862614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957f330-d9d5-46ee-b58b-8e0b40ba8976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:51.864021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957f330-d9d5-46ee-b58b-8e0b40ba8976 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:51.881556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 485/974] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:51.881556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957f330-d9d5-46ee-b58b-8e0b40ba8976 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:51.900665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 490/975] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jul 21 12:02:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:51.901927 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126812b-35e2-4255-93a1-67c2caf5bae2 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:51.999334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957f330-d9d5-46ee-b58b-8e0b40ba8976 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:52.047915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767b3d2-153f-4275-818b-7dd6352dddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:52.048502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767b3d2-153f-4275-818b-7dd6352dddbb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:52.048788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767b3d2-153f-4275-818b-7dd6352dddbb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:52.049065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767b3d2-153f-4275-818b-7dd6352dddbb None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:52.049805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767b3d2-153f-4275-818b-7dd6352dddbb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:52.050182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767b3d2-153f-4275-818b-7dd6352dddbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:52.051559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767b3d2-153f-4275-818b-7dd6352dddbb None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:52.057525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 486/976] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jul 21 12:02:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:52.059109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e72890-8c00-428f-943b-61ddc5bf9a95 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:52.059404 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e72890-8c00-428f-943b-61ddc5bf9a95 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:52.059682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e72890-8c00-428f-943b-61ddc5bf9a95 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:52.062697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 487/977] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:52.068129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e72890-8c00-428f-943b-61ddc5bf9a95 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:52.078063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126812b-35e2-4255-93a1-67c2caf5bae2 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:52.123259 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:52.133793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60335360-653b-4edc-84b4-8b32ba639f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:52.134694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60335360-653b-4edc-84b4-8b32ba639f12 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:52.135888 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60335360-653b-4edc-84b4-8b32ba639f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:52.135888 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60335360-653b-4edc-84b4-8b32ba639f12 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:52.146006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60335360-653b-4edc-84b4-8b32ba639f12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:52.150054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60335360-653b-4edc-84b4-8b32ba639f12 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-60335360-653b-4edc-84b4-8b32ba639f12 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:02:52.168585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:52.170491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:52.172606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:52.172606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:52.172606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:02:52.172606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:02:52.172606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:02:52.172606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:02:52.172606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:02:52.172606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:02:52.172606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 12:02:52.172606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:52.172606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 491/978] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jul 21 12:02:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:52.172606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b46fc9-eaeb-44f8-a830-acd435e810f0 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:52.172606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b46fc9-eaeb-44f8-a830-acd435e810f0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:52.174057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b46fc9-eaeb-44f8-a830-acd435e810f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:52.200304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-30b46fc9-eaeb-44f8-a830-acd435e810f0 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:52.203056 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-30b46fc9-eaeb-44f8-a830-acd435e810f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:52.240222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e72890-8c00-428f-943b-61ddc5bf9a95 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:52.281306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:52.284384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8918f26-53b8-4bcf-996b-cf58e2ba1b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:52.285200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8918f26-53b8-4bcf-996b-cf58e2ba1b72 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:52.285588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8918f26-53b8-4bcf-996b-cf58e2ba1b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:52.285921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8918f26-53b8-4bcf-996b-cf58e2ba1b72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:52.286780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8918f26-53b8-4bcf-996b-cf58e2ba1b72 None admin] RBAC: Adding query filter params (interface=admin, service_id=fb2652a4a58c4efeaef7c3c5f094ec67, region_id=RegionOne) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:52.287099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8918f26-53b8-4bcf-996b-cf58e2ba1b72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:52.288494 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8918f26-53b8-4bcf-996b-cf58e2ba1b72 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:52.294258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 488/979] 10.222.0.15 () {56 vars in 1249 bytes} [Thu Jul 21 12:02:52 2022] GET /identity/v3/endpoints?service_id=fb2652a4a58c4efeaef7c3c5f094ec67&interface=admin®ion_id=RegionOne => generated 193 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:52.299312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8918f26-53b8-4bcf-996b-cf58e2ba1b72 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:52.308275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 492/980] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:52.309313 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b46fc9-eaeb-44f8-a830-acd435e810f0 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:52.429772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:52.434675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b46fc9-eaeb-44f8-a830-acd435e810f0 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:52.437397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8918f26-53b8-4bcf-996b-cf58e2ba1b72 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:52.481120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262d2e3-86aa-4007-8c83-34cad028ea1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:52.481955 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b3df2-2a95-4fc2-b67a-74ec3cd4e8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:52.482161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262d2e3-86aa-4007-8c83-34cad028ea1c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:52.482161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262d2e3-86aa-4007-8c83-34cad028ea1c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:52.482460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262d2e3-86aa-4007-8c83-34cad028ea1c None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:52.482711 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b3df2-2a95-4fc2-b67a-74ec3cd4e8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:52.483010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b3df2-2a95-4fc2-b67a-74ec3cd4e8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:52.483132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262d2e3-86aa-4007-8c83-34cad028ea1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:52.483299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b3df2-2a95-4fc2-b67a-74ec3cd4e8f6 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:52.484189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b3df2-2a95-4fc2-b67a-74ec3cd4e8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:52.484481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262d2e3-86aa-4007-8c83-34cad028ea1c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:52.484610 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b3df2-2a95-4fc2-b67a-74ec3cd4e8f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:52.485942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b3df2-2a95-4fc2-b67a-74ec3cd4e8f6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:52.492467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 493/981] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jul 21 12:02:52 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:02:52.493366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262d2e3-86aa-4007-8c83-34cad028ea1c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:52.510114 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 489/982] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jul 21 12:02:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:52.516348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b3df2-2a95-4fc2-b67a-74ec3cd4e8f6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:52.568867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:52.632494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262d2e3-86aa-4007-8c83-34cad028ea1c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:52.667038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b3df2-2a95-4fc2-b67a-74ec3cd4e8f6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:52.687495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c8a72-a384-432f-a3b5-a5155543dcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:52.688470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c8a72-a384-432f-a3b5-a5155543dcc3 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:52.688933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c8a72-a384-432f-a3b5-a5155543dcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:52.689374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c8a72-a384-432f-a3b5-a5155543dcc3 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:52.690186 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c8a72-a384-432f-a3b5-a5155543dcc3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:52.692049 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c8a72-a384-432f-a3b5-a5155543dcc3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:52.710876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 494/983] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jul 21 12:02:52 2022] POST /identity/v3/services => generated 242 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:02:52.730150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bb9f8-77f2-452f-a5f8-4e0e9eb4e171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:52.731291 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb9f8-77f2-452f-a5f8-4e0e9eb4e171 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:52.731809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb9f8-77f2-452f-a5f8-4e0e9eb4e171 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:52.732514 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb9f8-77f2-452f-a5f8-4e0e9eb4e171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:52.766349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:52.854894 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bb9f8-77f2-452f-a5f8-4e0e9eb4e171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:52.857519 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bb9f8-77f2-452f-a5f8-4e0e9eb4e171 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:53.021369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 490/984] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:02:52 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 12:02:53.028316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c8a72-a384-432f-a3b5-a5155543dcc3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:53.201479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c8a72-a384-432f-a3b5-a5155543dcc3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:53.223209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:53.257754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd69b8-b0b7-4907-88e2-89364eaedf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:53.258854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd69b8-b0b7-4907-88e2-89364eaedf61 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:53.259323 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd69b8-b0b7-4907-88e2-89364eaedf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:53.259667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd69b8-b0b7-4907-88e2-89364eaedf61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:53.278311 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd69b8-b0b7-4907-88e2-89364eaedf61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:53.279859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd69b8-b0b7-4907-88e2-89364eaedf61 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-72fd69b8-b0b7-4907-88e2-89364eaedf61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:02:53.310809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:53.311804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:53.312738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:02:53.312738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:02:53.312738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:02:53.312738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:53.317680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 495/985] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:53.319567 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bb9f8-77f2-452f-a5f8-4e0e9eb4e171 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:53.377999 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:53.436130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bb9f8-77f2-452f-a5f8-4e0e9eb4e171 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:53.495364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7bd31-0740-4bb4-b968-0ac3118c7c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:53.496496 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7bd31-0740-4bb4-b968-0ac3118c7c21 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:53.497003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7bd31-0740-4bb4-b968-0ac3118c7c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:53.497501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7bd31-0740-4bb4-b968-0ac3118c7c21 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:53.498858 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7bd31-0740-4bb4-b968-0ac3118c7c21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:53.499394 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7bd31-0740-4bb4-b968-0ac3118c7c21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:53.502062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7bd31-0740-4bb4-b968-0ac3118c7c21 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:53.526765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 491/986] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:53.530032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd69b8-b0b7-4907-88e2-89364eaedf61 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:53.650446 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd69b8-b0b7-4907-88e2-89364eaedf61 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:53.692627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb0231-6002-4f0c-b545-8b058682243a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:53.693478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb0231-6002-4f0c-b545-8b058682243a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:53.694402 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb0231-6002-4f0c-b545-8b058682243a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:53.694709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb0231-6002-4f0c-b545-8b058682243a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:53.708180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb0231-6002-4f0c-b545-8b058682243a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:53.709699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb0231-6002-4f0c-b545-8b058682243a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-b3cb0231-6002-4f0c-b545-8b058682243a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:02:53.726871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:53.728383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:53.729937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:02:53.729937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:02:53.729937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:02:53.729937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:02:53.729937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:02:53.729937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:02:53.729937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:02:53.729937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:53.733070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 496/987] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:53.734995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7bd31-0740-4bb4-b968-0ac3118c7c21 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:53.909057 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7bd31-0740-4bb4-b968-0ac3118c7c21 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:53.929498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:53.966776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e66676-0f55-426e-9d94-6efced705d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:53.967474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e66676-0f55-426e-9d94-6efced705d1e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:53.967869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e66676-0f55-426e-9d94-6efced705d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:53.968218 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e66676-0f55-426e-9d94-6efced705d1e None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:53.969051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e66676-0f55-426e-9d94-6efced705d1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:53.969530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e66676-0f55-426e-9d94-6efced705d1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:53.971373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e66676-0f55-426e-9d94-6efced705d1e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:53.988052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 492/988] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:02:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:53.995111 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb0231-6002-4f0c-b545-8b058682243a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:54.028588 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:54.118556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb0231-6002-4f0c-b545-8b058682243a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:54.157082 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4f8da-9b94-4d08-b27b-f52ca3c8e121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:54.157752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4f8da-9b94-4d08-b27b-f52ca3c8e121 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:54.158103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4f8da-9b94-4d08-b27b-f52ca3c8e121 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:54.158471 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4f8da-9b94-4d08-b27b-f52ca3c8e121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:54.159624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4f8da-9b94-4d08-b27b-f52ca3c8e121 None admin] RBAC: Adding query filter params (role.id=4aba4eb30dca482a9a29417a44a955d1, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=9410b04623a04e90ac47c4a53cd3c4e6) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:54.160018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4f8da-9b94-4d08-b27b-f52ca3c8e121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:54.161662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4f8da-9b94-4d08-b27b-f52ca3c8e121 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:54.171559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 497/989] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:02:53 2022] GET /identity/v3/role_assignments?user.id=9410b04623a04e90ac47c4a53cd3c4e6&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=4aba4eb30dca482a9a29417a44a955d1 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:54.585596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aa25f-1c1c-4ea9-b997-f5ca70b78a0b None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:54.585947 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aa25f-1c1c-4ea9-b997-f5ca70b78a0b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:54.586196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aa25f-1c1c-4ea9-b997-f5ca70b78a0b None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:54.587759 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 493/990] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:02:54.593401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b4a0-271b-4911-92b8-4173f12312f4 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:54.593920 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b4a0-271b-4911-92b8-4173f12312f4 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:54.594033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b4a0-271b-4911-92b8-4173f12312f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:54.612258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-fd74b4a0-271b-4911-92b8-4173f12312f4 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:54.613464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-fd74b4a0-271b-4911-92b8-4173f12312f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:54.696760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 498/991] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:54.720085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48aa25f-1c1c-4ea9-b997-f5ca70b78a0b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:54.854774 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48aa25f-1c1c-4ea9-b997-f5ca70b78a0b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:54.897752 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f1e3d-ae03-4fb6-bdb4-dfa853935f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:54.899225 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f1e3d-ae03-4fb6-bdb4-dfa853935f65 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:54.899787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f1e3d-ae03-4fb6-bdb4-dfa853935f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:54.900397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f1e3d-ae03-4fb6-bdb4-dfa853935f65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:54.901261 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f1e3d-ae03-4fb6-bdb4-dfa853935f65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:54.902978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f1e3d-ae03-4fb6-bdb4-dfa853935f65 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-271f1e3d-ae03-4fb6-bdb4-dfa853935f65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:54.921088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:54.922153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:54.923181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:54.923181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:54.923181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:54.923181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:54.923181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:54.923181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:54.923181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:54.923181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:54.923181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:54.923181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:54.923181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:54.923181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:54.923181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 12:02:54.923181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:54.924443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 494/992] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jul 21 12:02:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:54.930834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74b4a0-271b-4911-92b8-4173f12312f4 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:54.952792 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:55.056342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74b4a0-271b-4911-92b8-4173f12312f4 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:55.095227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842b04c-249a-4bd7-81ea-9d2d4c87b6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:55.095922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842b04c-249a-4bd7-81ea-9d2d4c87b6cc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:55.096209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842b04c-249a-4bd7-81ea-9d2d4c87b6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:55.096489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842b04c-249a-4bd7-81ea-9d2d4c87b6cc None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:55.097216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842b04c-249a-4bd7-81ea-9d2d4c87b6cc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:55.097528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842b04c-249a-4bd7-81ea-9d2d4c87b6cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:55.098960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842b04c-249a-4bd7-81ea-9d2d4c87b6cc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:55.109470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 499/993] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jul 21 12:02:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:55.110517 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f1e3d-ae03-4fb6-bdb4-dfa853935f65 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:55.116800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae2c41-c0c9-4845-8613-43f5ea15cbd6 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:55.117277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae2c41-c0c9-4845-8613-43f5ea15cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:55.117754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae2c41-c0c9-4845-8613-43f5ea15cbd6 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:55.120425 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 500/994] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:02:55.126388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca02772-9425-4cc2-80da-92936d666afb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:55.126801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca02772-9425-4cc2-80da-92936d666afb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:55.127085 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca02772-9425-4cc2-80da-92936d666afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:55.149965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5ca02772-9425-4cc2-80da-92936d666afb None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:55.151392 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5ca02772-9425-4cc2-80da-92936d666afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:55.153122 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:55.237080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f1e3d-ae03-4fb6-bdb4-dfa853935f65 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:55.248309 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 501/995] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:55.275271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca02772-9425-4cc2-80da-92936d666afb None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:55.278686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb11d3d-8c4e-4d40-8e3f-560a4f33141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:55.279402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb11d3d-8c4e-4d40-8e3f-560a4f33141b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:55.279684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb11d3d-8c4e-4d40-8e3f-560a4f33141b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:55.279957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb11d3d-8c4e-4d40-8e3f-560a4f33141b None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:55.280698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb11d3d-8c4e-4d40-8e3f-560a4f33141b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:55.281005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb11d3d-8c4e-4d40-8e3f-560a4f33141b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:55.282412 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb11d3d-8c4e-4d40-8e3f-560a4f33141b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:55.288461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 495/996] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jul 21 12:02:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:55.294373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb11d3d-8c4e-4d40-8e3f-560a4f33141b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:55.296365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:55.422607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:55.427389 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca02772-9425-4cc2-80da-92936d666afb None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:55.427723 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb11d3d-8c4e-4d40-8e3f-560a4f33141b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:55.475306 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b16fa-d4ce-4cca-9d5c-ee4373d00605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:55.475990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b16fa-d4ce-4cca-9d5c-ee4373d00605 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:55.476275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b16fa-d4ce-4cca-9d5c-ee4373d00605 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:55.476553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b16fa-d4ce-4cca-9d5c-ee4373d00605 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:55.477313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b16fa-d4ce-4cca-9d5c-ee4373d00605 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:55.478824 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b16fa-d4ce-4cca-9d5c-ee4373d00605 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:55.492136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566ded-ebf0-410b-a5a1-391e2cf66cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:55.493449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566ded-ebf0-410b-a5a1-391e2cf66cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:55.493919 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566ded-ebf0-410b-a5a1-391e2cf66cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:55.494264 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566ded-ebf0-410b-a5a1-391e2cf66cb3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:55.495155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4566ded-ebf0-410b-a5a1-391e2cf66cb3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:55.496703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4566ded-ebf0-410b-a5a1-391e2cf66cb3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:55.510691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 496/997] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jul 21 12:02:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-b4566ded-ebf0-410b-a5a1-391e2cf66cb3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:55.510989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:55.512930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:55.515803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 502/998] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:55.517661 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b16fa-d4ce-4cca-9d5c-ee4373d00605 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:55.659302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b16fa-d4ce-4cca-9d5c-ee4373d00605 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:55.716027 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b533279-96ca-4cda-b08a-a7d4e4311c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:55.716444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b533279-96ca-4cda-b08a-a7d4e4311c77 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:55.716731 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b533279-96ca-4cda-b08a-a7d4e4311c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:55.717085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b533279-96ca-4cda-b08a-a7d4e4311c77 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:55.718056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b533279-96ca-4cda-b08a-a7d4e4311c77 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:55.718554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b533279-96ca-4cda-b08a-a7d4e4311c77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:55.720523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b533279-96ca-4cda-b08a-a7d4e4311c77 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:55.729723 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 497/999] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jul 21 12:02:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:55.739772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566ded-ebf0-410b-a5a1-391e2cf66cb3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:55.869106 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:55.912898 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566ded-ebf0-410b-a5a1-391e2cf66cb3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:55.973398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7fe3a-39a5-4031-8b25-65d1eac9719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:55.974470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7fe3a-39a5-4031-8b25-65d1eac9719f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:55.975001 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7fe3a-39a5-4031-8b25-65d1eac9719f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:55.975508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7fe3a-39a5-4031-8b25-65d1eac9719f None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:55.976891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7fe3a-39a5-4031-8b25-65d1eac9719f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:55.977453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7fe3a-39a5-4031-8b25-65d1eac9719f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:55.979946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7fe3a-39a5-4031-8b25-65d1eac9719f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:55.994941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 503/1000] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jul 21 12:02:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:55.996772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b533279-96ca-4cda-b08a-a7d4e4311c77 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:56.028120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:56.140718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b533279-96ca-4cda-b08a-a7d4e4311c77 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:56.188058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407149fb-96b1-4e01-9a57-d210b8ef5c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:56.188799 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407149fb-96b1-4e01-9a57-d210b8ef5c8b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:56.189077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407149fb-96b1-4e01-9a57-d210b8ef5c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:56.189351 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407149fb-96b1-4e01-9a57-d210b8ef5c8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:56.190175 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407149fb-96b1-4e01-9a57-d210b8ef5c8b None admin] RBAC: Adding query filter params (interface=public, service_id=475f84882b024dbb867d7ba6e04c952a, region_id=RegionOne) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:56.190520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407149fb-96b1-4e01-9a57-d210b8ef5c8b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:56.192000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407149fb-96b1-4e01-9a57-d210b8ef5c8b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:56.205864 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 498/1001] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jul 21 12:02:55 2022] GET /identity/v3/endpoints?service_id=475f84882b024dbb867d7ba6e04c952a&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:56.207253 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7fe3a-39a5-4031-8b25-65d1eac9719f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:56.336342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7fe3a-39a5-4031-8b25-65d1eac9719f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:56.373752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ff172-df17-41ce-bdc7-ec816dd4c497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:56.374517 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ff172-df17-41ce-bdc7-ec816dd4c497 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:56.374833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ff172-df17-41ce-bdc7-ec816dd4c497 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:56.375114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ff172-df17-41ce-bdc7-ec816dd4c497 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:56.375795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ff172-df17-41ce-bdc7-ec816dd4c497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:56.377261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ff172-df17-41ce-bdc7-ec816dd4c497 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:56.384820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 504/1002] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jul 21 12:02:56 2022] GET /identity/v3/services => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:02:56.613922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed366-d85c-4550-b1d1-cb94e6229f67 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:56.614192 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed366-d85c-4550-b1d1-cb94e6229f67 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:56.614545 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed366-d85c-4550-b1d1-cb94e6229f67 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:56.616054 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 499/1003] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:02:56.621766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279900-5a33-43cf-9133-10aad41593ae None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:56.622126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279900-5a33-43cf-9133-10aad41593ae None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:56.622365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279900-5a33-43cf-9133-10aad41593ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:56.630283 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:56.642470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6f279900-5a33-43cf-9133-10aad41593ae None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:56.643707 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6f279900-5a33-43cf-9133-10aad41593ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:56.722018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 505/1004] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:56 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:56.745906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ed366-d85c-4550-b1d1-cb94e6229f67 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:56.900452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:56.933659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ed366-d85c-4550-b1d1-cb94e6229f67 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:56.995097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475ae9a-ff0a-4b2e-8132-2920516b636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:56.996625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475ae9a-ff0a-4b2e-8132-2920516b636d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:56.997135 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475ae9a-ff0a-4b2e-8132-2920516b636d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:56.997674 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475ae9a-ff0a-4b2e-8132-2920516b636d None admin] PATH_INFO: `/v3/services/image` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:56.998837 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475ae9a-ff0a-4b2e-8132-2920516b636d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:57.001445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475ae9a-ff0a-4b2e-8132-2920516b636d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-f475ae9a-ff0a-4b2e-8132-2920516b636d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:57.024349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:57.025557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:57.026510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:57.026510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:57.026510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:57.026510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:57.026510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:57.026510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:57.026510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:57.026510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:57.026510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:57.026510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:57.026510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:57.026510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:57.026510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 12:02:57.026510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:02:57.031934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 500/1005] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Jul 21 12:02:56 2022] GET /identity/v3/services/image => generated 86 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:02:57.040074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f279900-5a33-43cf-9133-10aad41593ae None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:57.210159 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f279900-5a33-43cf-9133-10aad41593ae None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:57.266924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63958226-7b26-4eaa-be8f-db90858e6bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:57.267913 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63958226-7b26-4eaa-be8f-db90858e6bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:57.268399 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63958226-7b26-4eaa-be8f-db90858e6bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:57.268883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63958226-7b26-4eaa-be8f-db90858e6bd9 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:57.270149 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63958226-7b26-4eaa-be8f-db90858e6bd9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:57.270729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63958226-7b26-4eaa-be8f-db90858e6bd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:57.273218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63958226-7b26-4eaa-be8f-db90858e6bd9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:57.274982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:57.284763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 506/1006] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:57.293644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475ae9a-ff0a-4b2e-8132-2920516b636d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:57.468607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475ae9a-ff0a-4b2e-8132-2920516b636d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:57.538186 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff62f7-c8c7-4d87-a323-c913ffc17dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:57.539392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff62f7-c8c7-4d87-a323-c913ffc17dce None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:57.539898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff62f7-c8c7-4d87-a323-c913ffc17dce None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:57.540390 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff62f7-c8c7-4d87-a323-c913ffc17dce None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:57.541751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff62f7-c8c7-4d87-a323-c913ffc17dce None admin] RBAC: Adding query filter params (type=image) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:57.542291 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff62f7-c8c7-4d87-a323-c913ffc17dce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:57.544911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff62f7-c8c7-4d87-a323-c913ffc17dce None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:57.555461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 501/1007] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:57.695383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308f791-8324-4a8a-b373-d3a7954acb91 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:57.695786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308f791-8324-4a8a-b373-d3a7954acb91 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:57.695930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308f791-8324-4a8a-b373-d3a7954acb91 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:57.697957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 507/1008] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:57.703739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c9f38-ada6-4c95-a871-cdda19959bbe None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:57.704092 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c9f38-ada6-4c95-a871-cdda19959bbe None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:57.704325 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c9f38-ada6-4c95-a871-cdda19959bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:57.723404 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-dd7c9f38-ada6-4c95-a871-cdda19959bbe None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:57.724535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-dd7c9f38-ada6-4c95-a871-cdda19959bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:57.728109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:57.810935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 502/1009] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:57.846324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308f791-8324-4a8a-b373-d3a7954acb91 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:58.019617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308f791-8324-4a8a-b373-d3a7954acb91 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:58.081888 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3413d-3a56-4730-9af6-ce739a478133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:58.083295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3413d-3a56-4730-9af6-ce739a478133 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:58.083788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3413d-3a56-4730-9af6-ce739a478133 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:58.084278 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3413d-3a56-4730-9af6-ce739a478133 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:58.086115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3413d-3a56-4730-9af6-ce739a478133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:58.088849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3413d-3a56-4730-9af6-ce739a478133 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:58.092266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 508/1010] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:02:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:58.101730 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c9f38-ada6-4c95-a871-cdda19959bbe None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:58.265376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c9f38-ada6-4c95-a871-cdda19959bbe None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:58.326002 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7dea7-3b82-432c-ab95-aba8be050ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:58.327059 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7dea7-3b82-432c-ab95-aba8be050ad7 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:58.327561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7dea7-3b82-432c-ab95-aba8be050ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:58.328057 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7dea7-3b82-432c-ab95-aba8be050ad7 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:58.329383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7dea7-3b82-432c-ab95-aba8be050ad7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:58.332158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7dea7-3b82-432c-ab95-aba8be050ad7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:58.350048 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:58.376318 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 503/1011] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jul 21 12:02:58 2022] POST /identity/v3/projects => generated 311 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:02:58.476983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cd6c7-7236-4603-bef3-cc78b94bd2a1 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:58.477390 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cd6c7-7236-4603-bef3-cc78b94bd2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:58.477539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cd6c7-7236-4603-bef3-cc78b94bd2a1 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:58.479258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 509/1012] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:02:58.485149 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017311-31a3-40a7-8a8f-502527a12924 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:58.485423 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017311-31a3-40a7-8a8f-502527a12924 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:58.485694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017311-31a3-40a7-8a8f-502527a12924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:58.506294 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-51017311-31a3-40a7-8a8f-502527a12924 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:58.507336 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-51017311-31a3-40a7-8a8f-502527a12924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:58.610891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 504/1013] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:58 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:02:58.631501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cd6c7-7236-4603-bef3-cc78b94bd2a1 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:58.712975 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:58.761554 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cd6c7-7236-4603-bef3-cc78b94bd2a1 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:58.805451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdda18-a0fb-4bc5-9280-29fd0d25e605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:58.806283 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdda18-a0fb-4bc5-9280-29fd0d25e605 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:58.806562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdda18-a0fb-4bc5-9280-29fd0d25e605 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:58.806864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdda18-a0fb-4bc5-9280-29fd0d25e605 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:58.807548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdda18-a0fb-4bc5-9280-29fd0d25e605 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:58.809063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdda18-a0fb-4bc5-9280-29fd0d25e605 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-47bdda18-a0fb-4bc5-9280-29fd0d25e605 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:02:58.822770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:02:58.824208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:02:58.825207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:02:58.825207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:02:58.825207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:02:58.825207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:02:58.825207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:02:58.825207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:02:58.825207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:02:58.825207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:02:58.825207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:02:58.825207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:02:58.825207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:02:58.825207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:02:58.825207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 12:02:58.825207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:02:58.826942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 510/1014] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:02:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:02:58.830923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51017311-31a3-40a7-8a8f-502527a12924 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:58.966184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51017311-31a3-40a7-8a8f-502527a12924 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:59.005856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:59.029750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c611b-291b-467b-b738-21251dfae5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:59.031079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c611b-291b-467b-b738-21251dfae5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:59.031474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c611b-291b-467b-b738-21251dfae5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:59.031951 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c611b-291b-467b-b738-21251dfae5a4 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:59.033286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c611b-291b-467b-b738-21251dfae5a4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:59.034071 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c611b-291b-467b-b738-21251dfae5a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:59.036397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c611b-291b-467b-b738-21251dfae5a4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:59.050340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 505/1015] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jul 21 12:02:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:02:59.052102 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdda18-a0fb-4bc5-9280-29fd0d25e605 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:59.206461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdda18-a0fb-4bc5-9280-29fd0d25e605 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:59.257043 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:59.267552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064e8c9-b44c-47b0-8f8d-651233935a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:59.268723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064e8c9-b44c-47b0-8f8d-651233935a42 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:59.269206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064e8c9-b44c-47b0-8f8d-651233935a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:59.269625 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064e8c9-b44c-47b0-8f8d-651233935a42 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:59.270598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064e8c9-b44c-47b0-8f8d-651233935a42 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:02:59.271188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064e8c9-b44c-47b0-8f8d-651233935a42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:59.273725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064e8c9-b44c-47b0-8f8d-651233935a42 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:59.289156 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 511/1016] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jul 21 12:02:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:02:59.290847 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c611b-291b-467b-b738-21251dfae5a4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:59.413005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c611b-291b-467b-b738-21251dfae5a4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:02:59.463717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c87da-7225-4d6c-a666-1a73cb197aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:02:59.464424 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c87da-7225-4d6c-a666-1a73cb197aec None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:59.464761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c87da-7225-4d6c-a666-1a73cb197aec None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:59.465036 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c87da-7225-4d6c-a666-1a73cb197aec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:59.465829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c87da-7225-4d6c-a666-1a73cb197aec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:02:59.467376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c87da-7225-4d6c-a666-1a73cb197aec None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:02:59.494681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 506/1017] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jul 21 12:02:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:02:59.725779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd0438-1ee4-4868-9194-9eb85552d8a2 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:59.726010 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd0438-1ee4-4868-9194-9eb85552d8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:59.726346 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd0438-1ee4-4868-9194-9eb85552d8a2 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:59.728045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 512/1018] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:02:59.736032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce3592-ad21-4226-ba32-e6339be9901b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:02:59.736379 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce3592-ad21-4226-ba32-e6339be9901b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:02:59.736624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce3592-ad21-4226-ba32-e6339be9901b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:02:59.758800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-15ce3592-ad21-4226-ba32-e6339be9901b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:02:59.760005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-15ce3592-ad21-4226-ba32-e6339be9901b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:02:59.807594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:02:59.851626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 507/1019] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:02:59 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:02:59.874018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd0438-1ee4-4868-9194-9eb85552d8a2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:02:59.996233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd0438-1ee4-4868-9194-9eb85552d8a2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:00.053791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdae3b9-aab7-4179-a2db-38eab6331a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:00.054816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdae3b9-aab7-4179-a2db-38eab6331a88 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:00.055256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdae3b9-aab7-4179-a2db-38eab6331a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:00.055682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdae3b9-aab7-4179-a2db-38eab6331a88 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:00.056904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdae3b9-aab7-4179-a2db-38eab6331a88 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:00.059401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdae3b9-aab7-4179-a2db-38eab6331a88 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:00.086719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 513/1020] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jul 21 12:02:59 2022] POST /identity/v3/services => generated 242 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:03:00.570322 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591b433-b36d-45cd-ac89-ce69164d0f02 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:00.571189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591b433-b36d-45cd-ac89-ce69164d0f02 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:00.571189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591b433-b36d-45cd-ac89-ce69164d0f02 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:00.572889 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 508/1021] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:03:00.578498 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adbf51-bf62-475a-b505-9b0a5cb6b588 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:00.579106 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adbf51-bf62-475a-b505-9b0a5cb6b588 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:00.579106 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adbf51-bf62-475a-b505-9b0a5cb6b588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:00.597094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-78adbf51-bf62-475a-b505-9b0a5cb6b588 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:00.598313 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-78adbf51-bf62-475a-b505-9b0a5cb6b588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:00.654359 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:00.683729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 514/1022] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:00.710692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591b433-b36d-45cd-ac89-ce69164d0f02 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:00.825565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591b433-b36d-45cd-ac89-ce69164d0f02 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:00.864917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9f716-05a7-486a-a2a9-bad402901359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:00.865985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9f716-05a7-486a-a2a9-bad402901359 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:00.866418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9f716-05a7-486a-a2a9-bad402901359 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:00.866881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9f716-05a7-486a-a2a9-bad402901359 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:00.868265 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9f716-05a7-486a-a2a9-bad402901359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:00.869853 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9f716-05a7-486a-a2a9-bad402901359 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:00.876261 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 509/1023] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:00.878106 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adbf51-bf62-475a-b505-9b0a5cb6b588 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:01.024277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adbf51-bf62-475a-b505-9b0a5cb6b588 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:01.082542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c4bc4-ee0f-4322-a843-a7da144e85b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:01.083599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c4bc4-ee0f-4322-a843-a7da144e85b3 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:01.084097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c4bc4-ee0f-4322-a843-a7da144e85b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:01.084572 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c4bc4-ee0f-4322-a843-a7da144e85b3 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:01.085928 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c4bc4-ee0f-4322-a843-a7da144e85b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:01.088746 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c4bc4-ee0f-4322-a843-a7da144e85b3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:01.130700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 515/1024] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:03:00 2022] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:03:01.793370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6813b1-296b-4c9c-89e8-840e94437334 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:01.793969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6813b1-296b-4c9c-89e8-840e94437334 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:01.794363 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6813b1-296b-4c9c-89e8-840e94437334 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:01.797006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 510/1025] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:01.802951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b6cbb-699d-458a-87dc-c34eafde9c42 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:01.803705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b6cbb-699d-458a-87dc-c34eafde9c42 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:01.803705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b6cbb-699d-458a-87dc-c34eafde9c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:01.825920 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ca2b6cbb-699d-458a-87dc-c34eafde9c42 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:01.827990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ca2b6cbb-699d-458a-87dc-c34eafde9c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:01.881575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:01.957956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 516/1026] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:03:01.987086 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6813b1-296b-4c9c-89e8-840e94437334 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:02.044175 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:02.155626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6813b1-296b-4c9c-89e8-840e94437334 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:02.164109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a4c15-48ca-460d-ab99-6c1d1afa2004 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:02.164390 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a4c15-48ca-460d-ab99-6c1d1afa2004 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:02.164835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a4c15-48ca-460d-ab99-6c1d1afa2004 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:02.166249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 517/1027] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:03:02.173603 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369aee9-e182-4721-87da-dcdb7270e869 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:02.173890 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369aee9-e182-4721-87da-dcdb7270e869 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:02.174193 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369aee9-e182-4721-87da-dcdb7270e869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:02.196060 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6369aee9-e182-4721-87da-dcdb7270e869 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:02.198243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6369aee9-e182-4721-87da-dcdb7270e869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:02.208874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af20a35-b391-43c5-b0ae-9f1d8111e652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:02.209715 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af20a35-b391-43c5-b0ae-9f1d8111e652 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:02.209996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af20a35-b391-43c5-b0ae-9f1d8111e652 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:02.210273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af20a35-b391-43c5-b0ae-9f1d8111e652 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:02.222554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af20a35-b391-43c5-b0ae-9f1d8111e652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-9af20a35-b391-43c5-b0ae-9f1d8111e652 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:03:02.232284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:02.233309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:02.234321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:02.234321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:02.234321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:02.234321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:02.234321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:03:02.234321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:03:02.234321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:03:02.234321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:03:02.234321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:03:02.234321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:03:02.234321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 12:03:02.234321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:02.238126 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 511/1028] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jul 21 12:03:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:02.239095 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af20a35-b391-43c5-b0ae-9f1d8111e652 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:02.302782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 518/1029] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:03:02.323429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369aee9-e182-4721-87da-dcdb7270e869 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:02.349607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:02.357218 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af20a35-b391-43c5-b0ae-9f1d8111e652 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:02.409772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e402a59-4206-4a41-9dd4-a8794f19b83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:02.410519 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e402a59-4206-4a41-9dd4-a8794f19b83a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:02.410927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e402a59-4206-4a41-9dd4-a8794f19b83a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:02.411370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e402a59-4206-4a41-9dd4-a8794f19b83a None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:02.412369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e402a59-4206-4a41-9dd4-a8794f19b83a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:02.412684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e402a59-4206-4a41-9dd4-a8794f19b83a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:02.414090 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e402a59-4206-4a41-9dd4-a8794f19b83a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:02.423551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 512/1030] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jul 21 12:03:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:02.429365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e402a59-4206-4a41-9dd4-a8794f19b83a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:02.452981 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:02.470566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369aee9-e182-4721-87da-dcdb7270e869 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:02.512919 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbeb721-6986-4069-b41f-d26d1d148d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:02.514337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeb721-6986-4069-b41f-d26d1d148d0f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:02.514838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeb721-6986-4069-b41f-d26d1d148d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:02.515127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeb721-6986-4069-b41f-d26d1d148d0f None admin] PATH_INFO: `/v3/services/image` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:02.516176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbeb721-6986-4069-b41f-d26d1d148d0f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:02.518921 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbeb721-6986-4069-b41f-d26d1d148d0f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-fbbeb721-6986-4069-b41f-d26d1d148d0f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:02.541815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:02.543643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:02.545151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 519/1031] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Jul 21 12:03:02 2022] GET /identity/v3/services/image => generated 86 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:03:02.551279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbeb721-6986-4069-b41f-d26d1d148d0f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:02.555972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e402a59-4206-4a41-9dd4-a8794f19b83a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:02.593975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb69e4a-d8a0-476e-a0b2-8f6526cec279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:02.594836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb69e4a-d8a0-476e-a0b2-8f6526cec279 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:02.595122 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb69e4a-d8a0-476e-a0b2-8f6526cec279 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:02.595399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb69e4a-d8a0-476e-a0b2-8f6526cec279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:02.608601 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb69e4a-d8a0-476e-a0b2-8f6526cec279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:02.610072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb69e4a-d8a0-476e-a0b2-8f6526cec279 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-efb69e4a-d8a0-476e-a0b2-8f6526cec279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:03:02.628001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:02.629787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:02.631604 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:03:02.631604 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:03:02.631604 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:03:02.631604 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:02.634193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 513/1032] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:03:02.634970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb69e4a-d8a0-476e-a0b2-8f6526cec279 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:02.648248 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:02.695462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbeb721-6986-4069-b41f-d26d1d148d0f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:02.735104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3836345-4fe5-4a66-978e-67802c75c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:02.735806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3836345-4fe5-4a66-978e-67802c75c99e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:02.736096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3836345-4fe5-4a66-978e-67802c75c99e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:02.736377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3836345-4fe5-4a66-978e-67802c75c99e None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:02.737113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3836345-4fe5-4a66-978e-67802c75c99e None admin] RBAC: Adding query filter params (name=image) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:02.737424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3836345-4fe5-4a66-978e-67802c75c99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:02.738835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3836345-4fe5-4a66-978e-67802c75c99e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:02.744096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 520/1033] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:02.750453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3836345-4fe5-4a66-978e-67802c75c99e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:02.762302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb69e4a-d8a0-476e-a0b2-8f6526cec279 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:02.777747 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:02.805483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948eb271-294c-47e1-bd24-afeda4b00a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:02.805483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948eb271-294c-47e1-bd24-afeda4b00a94 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:02.806500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948eb271-294c-47e1-bd24-afeda4b00a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:02.806500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948eb271-294c-47e1-bd24-afeda4b00a94 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:02.806944 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948eb271-294c-47e1-bd24-afeda4b00a94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:02.807150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948eb271-294c-47e1-bd24-afeda4b00a94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:02.808604 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948eb271-294c-47e1-bd24-afeda4b00a94 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:02.824193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 514/1034] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:02.829955 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948eb271-294c-47e1-bd24-afeda4b00a94 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:02.872640 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3836345-4fe5-4a66-978e-67802c75c99e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:02.913532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1d133-e421-4a38-9457-c39a86d957ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:02.914209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d133-e421-4a38-9457-c39a86d957ed None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:02.914497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d133-e421-4a38-9457-c39a86d957ed None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:02.914806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d133-e421-4a38-9457-c39a86d957ed None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:02.915534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1d133-e421-4a38-9457-c39a86d957ed None admin] RBAC: Adding query filter params (type=image) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:02.915846 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1d133-e421-4a38-9457-c39a86d957ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:02.917240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1d133-e421-4a38-9457-c39a86d957ed None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:02.919180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:02.923270 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 521/1035] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:02.930506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1d133-e421-4a38-9457-c39a86d957ed None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:02.974408 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948eb271-294c-47e1-bd24-afeda4b00a94 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:03.033637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c295c-3eb0-4c81-ac3a-46b886657669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:03.035670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c295c-3eb0-4c81-ac3a-46b886657669 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:03.036484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c295c-3eb0-4c81-ac3a-46b886657669 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:03.037279 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c295c-3eb0-4c81-ac3a-46b886657669 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:03.048626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c295c-3eb0-4c81-ac3a-46b886657669 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:03.050085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c295c-3eb0-4c81-ac3a-46b886657669 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-006c295c-3eb0-4c81-ac3a-46b886657669 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:03:03.065984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:03.067172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:03.068609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:03.068609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:03.068609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:03:03.068609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:03:03.068609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:03:03.068609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:03:03.068609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:03:03.068609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:03:03.068609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:03:03.068609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:03.068609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 515/1036] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jul 21 12:03:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:03:03.073866 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c295c-3eb0-4c81-ac3a-46b886657669 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:03.076529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:03.094421 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1d133-e421-4a38-9457-c39a86d957ed None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:03.132699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fc677-6e46-4b9e-af6b-d751d0c1fcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:03.133701 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fc677-6e46-4b9e-af6b-d751d0c1fcdc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:03.133991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fc677-6e46-4b9e-af6b-d751d0c1fcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:03.134274 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fc677-6e46-4b9e-af6b-d751d0c1fcdc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:03.135482 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fc677-6e46-4b9e-af6b-d751d0c1fcdc None admin] RBAC: Adding query filter params (interface=public, service_id=bfa03052974c4282875671c55e07ee17, region_id=RegionOne) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:03.136045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fc677-6e46-4b9e-af6b-d751d0c1fcdc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:03.138721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fc677-6e46-4b9e-af6b-d751d0c1fcdc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:03.152661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 522/1037] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jul 21 12:03:02 2022] GET /identity/v3/endpoints?service_id=bfa03052974c4282875671c55e07ee17&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:03.154632 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fc677-6e46-4b9e-af6b-d751d0c1fcdc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:03.234633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c295c-3eb0-4c81-ac3a-46b886657669 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:03.270194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:03.278027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fc677-6e46-4b9e-af6b-d751d0c1fcdc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:03.278247 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f616097-b0d5-4162-8389-2c814662badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:03.279076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f616097-b0d5-4162-8389-2c814662badb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:03.279369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f616097-b0d5-4162-8389-2c814662badb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:03.279649 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f616097-b0d5-4162-8389-2c814662badb None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:03.280557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f616097-b0d5-4162-8389-2c814662badb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:03.280873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f616097-b0d5-4162-8389-2c814662badb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:03.282405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f616097-b0d5-4162-8389-2c814662badb None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:03.303677 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 516/1038] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jul 21 12:03:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:03.309452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f616097-b0d5-4162-8389-2c814662badb None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:03.323251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85f108-5a39-4a55-9551-470b582b9137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:03.323986 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f108-5a39-4a55-9551-470b582b9137 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:03.324230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f108-5a39-4a55-9551-470b582b9137 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:03.324512 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f108-5a39-4a55-9551-470b582b9137 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:03.325227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85f108-5a39-4a55-9551-470b582b9137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:03.326681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85f108-5a39-4a55-9551-470b582b9137 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:03.334705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 523/1039] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jul 21 12:03:03 2022] GET /identity/v3/services => generated 1957 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:03:03.463745 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb0ade-4fe4-4a1a-a2ea-f2a58c81bcc2 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:03.463745 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb0ade-4fe4-4a1a-a2ea-f2a58c81bcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:03.463745 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb0ade-4fe4-4a1a-a2ea-f2a58c81bcc2 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:03.465264 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 524/1040] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:03.471622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5804e-b4d3-473d-8698-337491bc133b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:03.471918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5804e-b4d3-473d-8698-337491bc133b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:03.472217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5804e-b4d3-473d-8698-337491bc133b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:03.488253 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f616097-b0d5-4162-8389-2c814662badb None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:03.497700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-56e5804e-b4d3-473d-8698-337491bc133b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:03.499589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-56e5804e-b4d3-473d-8698-337491bc133b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:03.516038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:03.542920 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d6e35-bd78-4da1-9419-4c7644df21c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:03.543600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d6e35-bd78-4da1-9419-4c7644df21c9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:03.543887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d6e35-bd78-4da1-9419-4c7644df21c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:03.544163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d6e35-bd78-4da1-9419-4c7644df21c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:03.598597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 525/1041] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:03:03.622212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5804e-b4d3-473d-8698-337491bc133b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:03.625527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:03.643580 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d6e35-bd78-4da1-9419-4c7644df21c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:03.645072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d6e35-bd78-4da1-9419-4c7644df21c9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:03.757090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5804e-b4d3-473d-8698-337491bc133b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:03.772853 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 517/1042] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:03:03 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:03:03.774993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d6e35-bd78-4da1-9419-4c7644df21c9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:03.806061 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc8c06-d5c8-4de4-866d-5c31eb24f7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:03.806915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc8c06-d5c8-4de4-866d-5c31eb24f7be None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:03.807201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc8c06-d5c8-4de4-866d-5c31eb24f7be None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:03.807478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc8c06-d5c8-4de4-866d-5c31eb24f7be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:03.823497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc8c06-d5c8-4de4-866d-5c31eb24f7be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-fccc8c06-d5c8-4de4-866d-5c31eb24f7be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:03:03.831704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:03.832702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:03.834334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:03.834334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:03.834334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:03.834334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:03.834334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:03:03.834334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:03:03.834334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:03:03.834334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:03:03.834334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:03:03.834334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:03:03.834334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:03.834334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:03.834334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 526/1043] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:03:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:03:03.839062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc8c06-d5c8-4de4-866d-5c31eb24f7be None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:03.852492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:03.888276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:03.906732 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d6e35-bd78-4da1-9419-4c7644df21c9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:03.952977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c6efa-897b-4554-bdca-0999762b1bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:03.953792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c6efa-897b-4554-bdca-0999762b1bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:03.954076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c6efa-897b-4554-bdca-0999762b1bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:03.954367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c6efa-897b-4554-bdca-0999762b1bf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:03.963343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc8c06-d5c8-4de4-866d-5c31eb24f7be None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:03.966537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c6efa-897b-4554-bdca-0999762b1bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:03.968072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c6efa-897b-4554-bdca-0999762b1bf4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-1c2c6efa-897b-4554-bdca-0999762b1bf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:03:03.992638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:03.993699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:03.995091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:03:03.995091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:03:03.995091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:03:03.995091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:03.995091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 518/1044] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:03.995367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c6efa-897b-4554-bdca-0999762b1bf4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:04.010974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77086fb-5015-4966-a8bf-810d3cf8e178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:04.011849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77086fb-5015-4966-a8bf-810d3cf8e178 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:04.012141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77086fb-5015-4966-a8bf-810d3cf8e178 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:04.012429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77086fb-5015-4966-a8bf-810d3cf8e178 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:04.013455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77086fb-5015-4966-a8bf-810d3cf8e178 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:04.013793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77086fb-5015-4966-a8bf-810d3cf8e178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:04.015370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77086fb-5015-4966-a8bf-810d3cf8e178 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:04.024905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 527/1045] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:03:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:04.031406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77086fb-5015-4966-a8bf-810d3cf8e178 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:04.109061 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:04.121907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c6efa-897b-4554-bdca-0999762b1bf4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:04.156727 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77086fb-5015-4966-a8bf-810d3cf8e178 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:04.162871 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46cd5d-75b9-4db5-8f0a-93049360b3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:04.163554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46cd5d-75b9-4db5-8f0a-93049360b3fe None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:04.163835 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46cd5d-75b9-4db5-8f0a-93049360b3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:04.164115 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46cd5d-75b9-4db5-8f0a-93049360b3fe None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:04.164859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46cd5d-75b9-4db5-8f0a-93049360b3fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:04.165162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46cd5d-75b9-4db5-8f0a-93049360b3fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:04.166541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46cd5d-75b9-4db5-8f0a-93049360b3fe None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:04.177149 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:04.182697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 519/1046] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:04.188459 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46cd5d-75b9-4db5-8f0a-93049360b3fe None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:04.202807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e6533-60fc-4c1a-87ad-1e258c173e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:04.203728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e6533-60fc-4c1a-87ad-1e258c173e09 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:04.204644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e6533-60fc-4c1a-87ad-1e258c173e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:04.204644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e6533-60fc-4c1a-87ad-1e258c173e09 None admin] PATH_INFO: `/v3/users/188b3b0aa933432fa343cefe04b5dedf` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:04.222518 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e6533-60fc-4c1a-87ad-1e258c173e09 None admin] RBAC: Authorizing `identity:get_user(user_id=188b3b0aa933432fa343cefe04b5dedf)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:04.224762 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e6533-60fc-4c1a-87ad-1e258c173e09 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:04.227071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 528/1047] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:04 2022] GET /identity/v3/users/188b3b0aa933432fa343cefe04b5dedf => generated 285 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:04.232726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e6533-60fc-4c1a-87ad-1e258c173e09 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:04.304376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46cd5d-75b9-4db5-8f0a-93049360b3fe None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:04.343759 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f9a32-b3f4-4f3e-9201-fa0ad8c86655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:04.344626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f9a32-b3f4-4f3e-9201-fa0ad8c86655 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:04.344918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f9a32-b3f4-4f3e-9201-fa0ad8c86655 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:04.345192 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f9a32-b3f4-4f3e-9201-fa0ad8c86655 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:04.346545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e6533-60fc-4c1a-87ad-1e258c173e09 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:04.354169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f9a32-b3f4-4f3e-9201-fa0ad8c86655 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:04.355746 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f9a32-b3f4-4f3e-9201-fa0ad8c86655 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-c55f9a32-b3f4-4f3e-9201-fa0ad8c86655 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:03:04.372024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:04.373785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:04.376138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:03:04.376138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:03:04.376138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:03:04.376138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:03:04.376138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:03:04.376138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:03:04.376138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:03:04.376138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:04.376138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 520/1048] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:03:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:03:04.379357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f9a32-b3f4-4f3e-9201-fa0ad8c86655 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:04.388390 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:04.401050 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c2c7-4732-43b9-b421-6a03ca2f69a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:04.401715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c2c7-4732-43b9-b421-6a03ca2f69a0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:04.402057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c2c7-4732-43b9-b421-6a03ca2f69a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:04.402337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c2c7-4732-43b9-b421-6a03ca2f69a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:04.463845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:04.489962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512c2c7-4732-43b9-b421-6a03ca2f69a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:04.491789 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512c2c7-4732-43b9-b421-6a03ca2f69a0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:04.523773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f9a32-b3f4-4f3e-9201-fa0ad8c86655 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:04.569598 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff21c63-0015-41e7-a73e-7efc98b21bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:04.570294 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff21c63-0015-41e7-a73e-7efc98b21bfe None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:04.570571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff21c63-0015-41e7-a73e-7efc98b21bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:04.570881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff21c63-0015-41e7-a73e-7efc98b21bfe None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:04.571696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff21c63-0015-41e7-a73e-7efc98b21bfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:04.572368 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff21c63-0015-41e7-a73e-7efc98b21bfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:04.573926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff21c63-0015-41e7-a73e-7efc98b21bfe None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:04.587144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 521/1049] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:03:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:04.594715 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff21c63-0015-41e7-a73e-7efc98b21bfe None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:04.618532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 529/1050] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:03:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:03:04.625081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c2c7-4732-43b9-b421-6a03ca2f69a0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:04.654731 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:04.715444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff21c63-0015-41e7-a73e-7efc98b21bfe None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:04.735990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:04.747558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c2c7-4732-43b9-b421-6a03ca2f69a0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:04.756203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b33bfc-f122-4abc-848d-a4f3011eded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:04.756877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b33bfc-f122-4abc-848d-a4f3011eded5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:04.757158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b33bfc-f122-4abc-848d-a4f3011eded5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:04.757435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b33bfc-f122-4abc-848d-a4f3011eded5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:04.758359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b33bfc-f122-4abc-848d-a4f3011eded5 None admin] RBAC: Adding query filter params (role.id=4aba4eb30dca482a9a29417a44a955d1, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=f3fb1d091b27472081549f4166ca172f) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:04.758705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b33bfc-f122-4abc-848d-a4f3011eded5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:04.760179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b33bfc-f122-4abc-848d-a4f3011eded5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:04.767041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 522/1051] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:03:04 2022] GET /identity/v3/role_assignments?user.id=f3fb1d091b27472081549f4166ca172f&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=4aba4eb30dca482a9a29417a44a955d1 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:04.799447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e68584-6633-436c-94a9-11194fcd9b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:04.800397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e68584-6633-436c-94a9-11194fcd9b00 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:04.800682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e68584-6633-436c-94a9-11194fcd9b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:04.800954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e68584-6633-436c-94a9-11194fcd9b00 None admin] PATH_INFO: `/v3/projects/cc1b41975b8f49398d44323ba918092a` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:04.802310 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e68584-6633-436c-94a9-11194fcd9b00 None admin] RBAC: Authorizing `identity:get_project(project_id=cc1b41975b8f49398d44323ba918092a)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:04.803885 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e68584-6633-436c-94a9-11194fcd9b00 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:04.805940 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 530/1052] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:03:04 2022] GET /identity/v3/projects/cc1b41975b8f49398d44323ba918092a => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:04.812326 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b33bfc-f122-4abc-848d-a4f3011eded5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:04.931449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b33bfc-f122-4abc-848d-a4f3011eded5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:04.967868 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767215fd-0e52-422e-a943-dfc9faf21666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:04.968543 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767215fd-0e52-422e-a943-dfc9faf21666 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:04.968827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767215fd-0e52-422e-a943-dfc9faf21666 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:04.969104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767215fd-0e52-422e-a943-dfc9faf21666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:04.969959 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767215fd-0e52-422e-a943-dfc9faf21666 None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=cc1b41975b8f49398d44323ba918092a, user.id=188b3b0aa933432fa343cefe04b5dedf) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:04.970274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767215fd-0e52-422e-a943-dfc9faf21666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:04.971755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767215fd-0e52-422e-a943-dfc9faf21666 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:04.982762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 523/1053] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:03:04 2022] GET /identity/v3/role_assignments?user.id=188b3b0aa933432fa343cefe04b5dedf&scope.project.id=cc1b41975b8f49398d44323ba918092a&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:05.418111 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4a9bd-bca6-4ad1-bb3c-e85e032705a9 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:05.418676 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4a9bd-bca6-4ad1-bb3c-e85e032705a9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:05.418676 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4a9bd-bca6-4ad1-bb3c-e85e032705a9 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:05.420231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 531/1054] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:05.425619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44a985-1625-4ccf-8689-8bcbb00795c8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:05.425902 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44a985-1625-4ccf-8689-8bcbb00795c8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:05.426183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44a985-1625-4ccf-8689-8bcbb00795c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:05.451197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2d44a985-1625-4ccf-8689-8bcbb00795c8 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:05.451197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2d44a985-1625-4ccf-8689-8bcbb00795c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:05.524281 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:05.555390 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 524/1055] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:05.578749 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4a9bd-bca6-4ad1-bb3c-e85e032705a9 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:05.718777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:05.728460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4a9bd-bca6-4ad1-bb3c-e85e032705a9 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:05.766943 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30157988-9df4-44e5-b374-b25f7113420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:05.767980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30157988-9df4-44e5-b374-b25f7113420b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:05.768343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30157988-9df4-44e5-b374-b25f7113420b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:05.768711 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30157988-9df4-44e5-b374-b25f7113420b None admin] PATH_INFO: `/v3/services/image` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:05.769388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30157988-9df4-44e5-b374-b25f7113420b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:05.770983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30157988-9df4-44e5-b374-b25f7113420b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-30157988-9df4-44e5-b374-b25f7113420b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:05.785267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:05.786397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:05.787365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:05.787365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:05.787365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:05.787365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:05.787365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:05.787365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:05.787365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:05.787365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:05.787365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:05.787365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:05.787365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:03:05.787365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:03:05.787365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 12:03:05.787365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:05.795276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 532/1056] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Jul 21 12:03:05 2022] GET /identity/v3/services/image => generated 86 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:05.795431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44a985-1625-4ccf-8689-8bcbb00795c8 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:05.929690 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44a985-1625-4ccf-8689-8bcbb00795c8 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:05.971863 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c0389-a739-45be-9c30-6b805ae5e2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:05.972602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c0389-a739-45be-9c30-6b805ae5e2ee None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:05.972693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c0389-a739-45be-9c30-6b805ae5e2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:05.972926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c0389-a739-45be-9c30-6b805ae5e2ee None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:05.973751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c0389-a739-45be-9c30-6b805ae5e2ee None admin] RBAC: Adding query filter params (name=image) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:05.974053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c0389-a739-45be-9c30-6b805ae5e2ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:05.975469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c0389-a739-45be-9c30-6b805ae5e2ee None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:05.981251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 525/1057] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:05.986982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30157988-9df4-44e5-b374-b25f7113420b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:06.107393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30157988-9df4-44e5-b374-b25f7113420b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:06.150737 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cea1f0-899f-4c1f-a2ab-9cf268da2410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:06.151345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cea1f0-899f-4c1f-a2ab-9cf268da2410 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:06.151644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cea1f0-899f-4c1f-a2ab-9cf268da2410 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:06.151973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cea1f0-899f-4c1f-a2ab-9cf268da2410 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:06.152758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cea1f0-899f-4c1f-a2ab-9cf268da2410 None admin] RBAC: Adding query filter params (type=image) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:06.153012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cea1f0-899f-4c1f-a2ab-9cf268da2410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:06.154384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cea1f0-899f-4c1f-a2ab-9cf268da2410 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:06.160825 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 533/1058] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:06.166491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c0389-a739-45be-9c30-6b805ae5e2ee None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:06.213059 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:06.277753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c0389-a739-45be-9c30-6b805ae5e2ee None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:06.317494 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24baa040-a74e-4c45-adc9-7e01ee020ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:06.318171 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24baa040-a74e-4c45-adc9-7e01ee020ef0 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:06.318432 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24baa040-a74e-4c45-adc9-7e01ee020ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:06.318741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24baa040-a74e-4c45-adc9-7e01ee020ef0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:06.319561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24baa040-a74e-4c45-adc9-7e01ee020ef0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:06.320918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24baa040-a74e-4c45-adc9-7e01ee020ef0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:06.350712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 526/1059] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jul 21 12:03:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:03:06.861597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8944-7f4f-43ce-bd08-dc64061b46c8 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:06.862136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8944-7f4f-43ce-bd08-dc64061b46c8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:06.862544 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8944-7f4f-43ce-bd08-dc64061b46c8 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:06.864604 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 534/1060] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:06.870749 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99faf8d-38f7-4435-96af-931ab1fc2fba None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:06.870976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99faf8d-38f7-4435-96af-931ab1fc2fba None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:06.871301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99faf8d-38f7-4435-96af-931ab1fc2fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:06.889860 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a99faf8d-38f7-4435-96af-931ab1fc2fba None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:06.891108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a99faf8d-38f7-4435-96af-931ab1fc2fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:06.996143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 527/1061] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:07.018800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8944-7f4f-43ce-bd08-dc64061b46c8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:07.044161 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106861-ee2a-4570-b2e2-4072eeade1bd None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:07.044505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106861-ee2a-4570-b2e2-4072eeade1bd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:07.044715 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106861-ee2a-4570-b2e2-4072eeade1bd None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:07.050534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 528/1062] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:03:07.050844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:07.054130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4915-76b8-4acd-bc10-9cae6fd55987 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:07.054426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4915-76b8-4acd-bc10-9cae6fd55987 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:07.054767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4915-76b8-4acd-bc10-9cae6fd55987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:07.075459 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0fad4915-76b8-4acd-bc10-9cae6fd55987 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:07.076637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0fad4915-76b8-4acd-bc10-9cae6fd55987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:07.097636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:07.155154 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 529/1063] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:07.160667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8944-7f4f-43ce-bd08-dc64061b46c8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:07.177601 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad4915-76b8-4acd-bc10-9cae6fd55987 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:07.205952 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59992590-02a7-4112-91c0-69bf6ae8a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:07.207118 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992590-02a7-4112-91c0-69bf6ae8a73c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:07.207631 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992590-02a7-4112-91c0-69bf6ae8a73c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:07.207924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992590-02a7-4112-91c0-69bf6ae8a73c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:07.220112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59992590-02a7-4112-91c0-69bf6ae8a73c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-59992590-02a7-4112-91c0-69bf6ae8a73c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:03:07.228521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:07.229609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:07.231210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:07.231210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:07.231210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:07.231210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:07.231210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:03:07.231210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:03:07.231210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:03:07.231210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:03:07.231210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:03:07.231210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:03:07.231210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 12:03:07.231210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:07.231210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 535/1064] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jul 21 12:03:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:07.239078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59992590-02a7-4112-91c0-69bf6ae8a73c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:07.304897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad4915-76b8-4acd-bc10-9cae6fd55987 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:07.345722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9b630-6086-4d81-a7d1-5fb0c761d9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:07.346937 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9b630-6086-4d81-a7d1-5fb0c761d9dc None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:07.347263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9b630-6086-4d81-a7d1-5fb0c761d9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:07.347497 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9b630-6086-4d81-a7d1-5fb0c761d9dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:07.351893 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:07.360046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9b630-6086-4d81-a7d1-5fb0c761d9dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-9ee9b630-6086-4d81-a7d1-5fb0c761d9dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:03:07.367789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:07.368767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:07.370453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:07.370453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:07.370453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:07.370453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:07.370453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:03:07.370453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:03:07.370453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:03:07.370453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:03:07.370453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:03:07.370453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:03:07.370453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:07.370453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:07.370453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 530/1065] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:03:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:03:07.375426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9b630-6086-4d81-a7d1-5fb0c761d9dc None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:07.377343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59992590-02a7-4112-91c0-69bf6ae8a73c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:07.395687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:07.418746 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a7bd5-21b8-4daf-b907-f52325a4c5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:07.419795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7bd5-21b8-4daf-b907-f52325a4c5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:07.420185 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7bd5-21b8-4daf-b907-f52325a4c5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:07.420466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7bd5-21b8-4daf-b907-f52325a4c5e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:07.421240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a7bd5-21b8-4daf-b907-f52325a4c5e1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:07.421544 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a7bd5-21b8-4daf-b907-f52325a4c5e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:07.422960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a7bd5-21b8-4daf-b907-f52325a4c5e1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:07.432022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 536/1066] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jul 21 12:03:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:07.437983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a7bd5-21b8-4daf-b907-f52325a4c5e1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:07.506237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9b630-6086-4d81-a7d1-5fb0c761d9dc None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:07.551139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0778e9b-8995-4afd-b7a8-5bc272d48735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:07.551862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0778e9b-8995-4afd-b7a8-5bc272d48735 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:07.552149 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0778e9b-8995-4afd-b7a8-5bc272d48735 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:07.552490 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0778e9b-8995-4afd-b7a8-5bc272d48735 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:07.553708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0778e9b-8995-4afd-b7a8-5bc272d48735 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:07.553819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0778e9b-8995-4afd-b7a8-5bc272d48735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:07.555221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0778e9b-8995-4afd-b7a8-5bc272d48735 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:07.564934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a7bd5-21b8-4daf-b907-f52325a4c5e1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:07.570411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 531/1067] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:03:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:07.571345 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0778e9b-8995-4afd-b7a8-5bc272d48735 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:07.602037 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb2cbb-ad14-48aa-abef-54e766fb5dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:07.602871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb2cbb-ad14-48aa-abef-54e766fb5dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:07.603158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb2cbb-ad14-48aa-abef-54e766fb5dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:07.603431 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb2cbb-ad14-48aa-abef-54e766fb5dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:07.616092 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb2cbb-ad14-48aa-abef-54e766fb5dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:07.617542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb2cbb-ad14-48aa-abef-54e766fb5dc3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:07.620686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-cdbb2cbb-ad14-48aa-abef-54e766fb5dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:03:07.637584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:07.638951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:07.639853 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:03:07.639853 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:03:07.639853 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:03:07.639853 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:07.639853 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 537/1068] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:03:07.645000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb2cbb-ad14-48aa-abef-54e766fb5dc3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:07.690273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:07.716493 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0778e9b-8995-4afd-b7a8-5bc272d48735 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:07.757182 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb2cbb-ad14-48aa-abef-54e766fb5dc3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:07.760297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ced762-c077-44c9-b554-1e0a75a6e430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:07.761560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ced762-c077-44c9-b554-1e0a75a6e430 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:07.761914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ced762-c077-44c9-b554-1e0a75a6e430 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:07.762360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ced762-c077-44c9-b554-1e0a75a6e430 None admin] PATH_INFO: `/v3/users/188b3b0aa933432fa343cefe04b5dedf` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:07.763908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ced762-c077-44c9-b554-1e0a75a6e430 None admin] RBAC: Authorizing `identity:get_user(user_id=188b3b0aa933432fa343cefe04b5dedf)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:07.765817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ced762-c077-44c9-b554-1e0a75a6e430 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:07.768117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 532/1069] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:07 2022] GET /identity/v3/users/188b3b0aa933432fa343cefe04b5dedf => generated 285 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:07.774626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ced762-c077-44c9-b554-1e0a75a6e430 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:07.795827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e753a5-29b1-4d15-a001-73e39ab427a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:07.796484 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e753a5-29b1-4d15-a001-73e39ab427a3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:07.796765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e753a5-29b1-4d15-a001-73e39ab427a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:07.797037 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e753a5-29b1-4d15-a001-73e39ab427a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:07.797773 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e753a5-29b1-4d15-a001-73e39ab427a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:07.798077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e753a5-29b1-4d15-a001-73e39ab427a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:07.799481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e753a5-29b1-4d15-a001-73e39ab427a3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:07.813408 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 538/1070] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:07.819192 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e753a5-29b1-4d15-a001-73e39ab427a3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:07.883818 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:07.904780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ced762-c077-44c9-b554-1e0a75a6e430 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:07.942306 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b269107-8a84-4ee7-8028-f5fda1a5e552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:07.943009 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e753a5-29b1-4d15-a001-73e39ab427a3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:07.943195 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b269107-8a84-4ee7-8028-f5fda1a5e552 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:07.943449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b269107-8a84-4ee7-8028-f5fda1a5e552 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:07.943756 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b269107-8a84-4ee7-8028-f5fda1a5e552 None admin] PATH_INFO: `/v3/projects/cc1b41975b8f49398d44323ba918092a` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:07.945188 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b269107-8a84-4ee7-8028-f5fda1a5e552 None admin] RBAC: Authorizing `identity:get_project(project_id=cc1b41975b8f49398d44323ba918092a)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:07.946665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b269107-8a84-4ee7-8028-f5fda1a5e552 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:07.949321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 533/1071] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:03:07 2022] GET /identity/v3/projects/cc1b41975b8f49398d44323ba918092a => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:07.955266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b269107-8a84-4ee7-8028-f5fda1a5e552 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:07.973147 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:07.983876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a6aa9-c845-45e5-84c0-81cb4359ab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:07.984692 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6aa9-c845-45e5-84c0-81cb4359ab73 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:07.985115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6aa9-c845-45e5-84c0-81cb4359ab73 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:07.985380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6aa9-c845-45e5-84c0-81cb4359ab73 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:07.993479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a6aa9-c845-45e5-84c0-81cb4359ab73 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:07.994976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a6aa9-c845-45e5-84c0-81cb4359ab73 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-075a6aa9-c845-45e5-84c0-81cb4359ab73 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:03:08.010212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:08.011560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:08.012496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:08.012496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:08.012496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:03:08.012496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:03:08.012496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:03:08.012496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:03:08.012496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:03:08.012496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:03:08.012496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:03:08.012496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:08.012496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 539/1072] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jul 21 12:03:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:03:08.020811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a6aa9-c845-45e5-84c0-81cb4359ab73 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:08.090614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b269107-8a84-4ee7-8028-f5fda1a5e552 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:08.128581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20054e9a-d6df-4b50-b07c-fa0135535ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:08.129482 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054e9a-d6df-4b50-b07c-fa0135535ed1 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:08.129762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054e9a-d6df-4b50-b07c-fa0135535ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:08.130039 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054e9a-d6df-4b50-b07c-fa0135535ed1 None admin] PATH_INFO: `/v3/projects/cc1b41975b8f49398d44323ba918092a/users/188b3b0aa933432fa343cefe04b5dedf/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:08.132092 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20054e9a-d6df-4b50-b07c-fa0135535ed1 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc1b41975b8f49398d44323ba918092a, user_id=188b3b0aa933432fa343cefe04b5dedf, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:08.133549 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20054e9a-d6df-4b50-b07c-fa0135535ed1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:08.150017 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 534/1073] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:03:07 2022] PUT /identity/v3/projects/cc1b41975b8f49398d44323ba918092a/users/188b3b0aa933432fa343cefe04b5dedf/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:03:08.188682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a6aa9-c845-45e5-84c0-81cb4359ab73 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:08.209936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:08.233545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228f50f-46d4-42f1-bfcc-ae070ab967cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:08.234245 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228f50f-46d4-42f1-bfcc-ae070ab967cb None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:08.234523 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228f50f-46d4-42f1-bfcc-ae070ab967cb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:08.234801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228f50f-46d4-42f1-bfcc-ae070ab967cb None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:08.235829 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228f50f-46d4-42f1-bfcc-ae070ab967cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:08.236060 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228f50f-46d4-42f1-bfcc-ae070ab967cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:08.237623 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228f50f-46d4-42f1-bfcc-ae070ab967cb None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:08.263993 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 540/1074] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jul 21 12:03:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:08.265680 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20054e9a-d6df-4b50-b07c-fa0135535ed1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:08.360584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:08.406275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20054e9a-d6df-4b50-b07c-fa0135535ed1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:08.445786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb4f9c-162e-46a7-8daa-49cfbd3dfdcb None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:08.445786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb4f9c-162e-46a7-8daa-49cfbd3dfdcb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:08.445786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb4f9c-162e-46a7-8daa-49cfbd3dfdcb None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:08.445786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 541/1075] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:03:08.451042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c209f-777f-4379-aa03-cef7dd987dc5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:08.452489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c209f-777f-4379-aa03-cef7dd987dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:08.452489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c209f-777f-4379-aa03-cef7dd987dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:08.463257 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe970e5-b5ab-491e-84c9-521f7a627d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:08.463997 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe970e5-b5ab-491e-84c9-521f7a627d47 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:08.464334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe970e5-b5ab-491e-84c9-521f7a627d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:08.464609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe970e5-b5ab-491e-84c9-521f7a627d47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:08.471128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6b4c209f-777f-4379-aa03-cef7dd987dc5 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:08.472017 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6b4c209f-777f-4379-aa03-cef7dd987dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:08.477486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe970e5-b5ab-491e-84c9-521f7a627d47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:08.479000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe970e5-b5ab-491e-84c9-521f7a627d47 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-1fe970e5-b5ab-491e-84c9-521f7a627d47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:03:08.501659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:08.502848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:08.503783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:03:08.503783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:03:08.503783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:03:08.503783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:08.503783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 535/1076] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:08.511795 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe970e5-b5ab-491e-84c9-521f7a627d47 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:08.566213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 542/1077] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:03:08.590199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c209f-777f-4379-aa03-cef7dd987dc5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:08.651558 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe970e5-b5ab-491e-84c9-521f7a627d47 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:08.691263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:08.708886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88969d-4bfa-4c0f-9ed9-f729dee21495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:08.710990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88969d-4bfa-4c0f-9ed9-f729dee21495 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:08.710990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88969d-4bfa-4c0f-9ed9-f729dee21495 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:08.710990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88969d-4bfa-4c0f-9ed9-f729dee21495 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:08.710990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88969d-4bfa-4c0f-9ed9-f729dee21495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:08.711301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88969d-4bfa-4c0f-9ed9-f729dee21495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:08.712774 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88969d-4bfa-4c0f-9ed9-f729dee21495 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:08.727155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 536/1078] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:08.729531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c209f-777f-4379-aa03-cef7dd987dc5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:08.733696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88969d-4bfa-4c0f-9ed9-f729dee21495 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:08.735220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:08.771641 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd19011-ca56-49bf-8f1e-0d8236e593b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:08.772310 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd19011-ca56-49bf-8f1e-0d8236e593b0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:08.772593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd19011-ca56-49bf-8f1e-0d8236e593b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:08.772865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd19011-ca56-49bf-8f1e-0d8236e593b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:08.856286 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd19011-ca56-49bf-8f1e-0d8236e593b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:08.857248 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88969d-4bfa-4c0f-9ed9-f729dee21495 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:08.857750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd19011-ca56-49bf-8f1e-0d8236e593b0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:08.898456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed689c-78fb-4528-8624-58bcc39b1e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:08.899375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed689c-78fb-4528-8624-58bcc39b1e45 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:08.899652 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed689c-78fb-4528-8624-58bcc39b1e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:08.899928 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed689c-78fb-4528-8624-58bcc39b1e45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:08.908205 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed689c-78fb-4528-8624-58bcc39b1e45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:08.909679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed689c-78fb-4528-8624-58bcc39b1e45 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-20ed689c-78fb-4528-8624-58bcc39b1e45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:03:08.924252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:08.925219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:08.926158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:03:08.926158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:03:08.926158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:03:08.926158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:03:08.926158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:03:08.926158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:03:08.926158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:03:08.926158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:08.926158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 537/1079] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:03:08.931531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed689c-78fb-4528-8624-58bcc39b1e45 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:08.992558 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:09.013735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 543/1080] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:03:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 12:03:09.019570 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd19011-ca56-49bf-8f1e-0d8236e593b0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:09.022704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:09.066817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed689c-78fb-4528-8624-58bcc39b1e45 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:09.107416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059159c-0aaf-446b-885e-1f7cc58c9eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:09.108263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059159c-0aaf-446b-885e-1f7cc58c9eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:09.108625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059159c-0aaf-446b-885e-1f7cc58c9eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:09.108968 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059159c-0aaf-446b-885e-1f7cc58c9eb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:09.109847 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059159c-0aaf-446b-885e-1f7cc58c9eb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:09.110165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059159c-0aaf-446b-885e-1f7cc58c9eb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:09.111662 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059159c-0aaf-446b-885e-1f7cc58c9eb1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:09.129506 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 538/1081] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:09.130805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059159c-0aaf-446b-885e-1f7cc58c9eb1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:09.150795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd19011-ca56-49bf-8f1e-0d8236e593b0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:09.188452 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22b036-5553-4ddc-94e4-0026dc895753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:09.189252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22b036-5553-4ddc-94e4-0026dc895753 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:09.189538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22b036-5553-4ddc-94e4-0026dc895753 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:09.190468 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22b036-5553-4ddc-94e4-0026dc895753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:09.201767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22b036-5553-4ddc-94e4-0026dc895753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:09.203152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22b036-5553-4ddc-94e4-0026dc895753 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-9b22b036-5553-4ddc-94e4-0026dc895753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:03:09.223084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:09.224902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:09.226619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:03:09.226619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:03:09.226619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:03:09.226619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:09.226619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 544/1082] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:03:09.231807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22b036-5553-4ddc-94e4-0026dc895753 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:09.277935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059159c-0aaf-446b-885e-1f7cc58c9eb1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:09.280821 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:09.312776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:09.335921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba514f29-6d6b-47dc-a8b2-244f3c589b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:09.338315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba514f29-6d6b-47dc-a8b2-244f3c589b8c None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:09.339580 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba514f29-6d6b-47dc-a8b2-244f3c589b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:09.339885 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba514f29-6d6b-47dc-a8b2-244f3c589b8c None admin] PATH_INFO: `/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/f3fb1d091b27472081549f4166ca172f/roles/4aba4eb30dca482a9a29417a44a955d1` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:09.344427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba514f29-6d6b-47dc-a8b2-244f3c589b8c None admin] RBAC: Authorizing `identity:create_grant(project_id=0946df6ba381401e8e4958d11c63cb2b, user_id=f3fb1d091b27472081549f4166ca172f, role_id=4aba4eb30dca482a9a29417a44a955d1)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:09.346950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba514f29-6d6b-47dc-a8b2-244f3c589b8c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:09.368324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 539/1083] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:03:09 2022] PUT /identity/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/f3fb1d091b27472081549f4166ca172f/roles/4aba4eb30dca482a9a29417a44a955d1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:03:09.370354 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22b036-5553-4ddc-94e4-0026dc895753 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:09.427316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77280bcd-81cd-4cec-b2dd-78f79ab35749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:09.428175 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77280bcd-81cd-4cec-b2dd-78f79ab35749 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:09.428493 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77280bcd-81cd-4cec-b2dd-78f79ab35749 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:09.428755 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77280bcd-81cd-4cec-b2dd-78f79ab35749 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:09.429567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77280bcd-81cd-4cec-b2dd-78f79ab35749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:09.429993 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77280bcd-81cd-4cec-b2dd-78f79ab35749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:09.431511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77280bcd-81cd-4cec-b2dd-78f79ab35749 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:09.448100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 545/1084] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:10.293924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244787bc-074b-4b2a-aa83-3e21e577bb96 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:10.294535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244787bc-074b-4b2a-aa83-3e21e577bb96 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:10.294535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244787bc-074b-4b2a-aa83-3e21e577bb96 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:10.296337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 540/1085] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:10.303470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb631-6537-4529-aff1-01e97bedd0f5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:10.304075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb631-6537-4529-aff1-01e97bedd0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:10.304211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb631-6537-4529-aff1-01e97bedd0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:10.321523 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f0ddb631-6537-4529-aff1-01e97bedd0f5 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:10.323112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f0ddb631-6537-4529-aff1-01e97bedd0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:10.395496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 546/1086] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:10.418925 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244787bc-074b-4b2a-aa83-3e21e577bb96 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:10.524824 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244787bc-074b-4b2a-aa83-3e21e577bb96 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:10.561508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b0e31-1e63-4562-9cb7-b4259e235a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:10.562215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b0e31-1e63-4562-9cb7-b4259e235a94 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:10.562496 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b0e31-1e63-4562-9cb7-b4259e235a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:10.562789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b0e31-1e63-4562-9cb7-b4259e235a94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:10.574126 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b0e31-1e63-4562-9cb7-b4259e235a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-3e1b0e31-1e63-4562-9cb7-b4259e235a94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:03:10.581667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:10.582635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:10.583678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:10.583678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:10.583678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:10.583678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:10.583678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:03:10.583678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:03:10.583678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:03:10.583678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:03:10.583678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:03:10.583678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:03:10.583678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:10.583678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:10.583678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 541/1087] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:03:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:10.589037 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddb631-6537-4529-aff1-01e97bedd0f5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:10.635208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:10.689638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddb631-6537-4529-aff1-01e97bedd0f5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:10.723726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbfd2a-f58c-48da-9dcb-a64ad10d2f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:10.724404 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbfd2a-f58c-48da-9dcb-a64ad10d2f9d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:10.724688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbfd2a-f58c-48da-9dcb-a64ad10d2f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:10.724962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbfd2a-f58c-48da-9dcb-a64ad10d2f9d None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:10.725711 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbfd2a-f58c-48da-9dcb-a64ad10d2f9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:10.726014 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbfd2a-f58c-48da-9dcb-a64ad10d2f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:10.727396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbfd2a-f58c-48da-9dcb-a64ad10d2f9d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:10.736109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 547/1088] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:03:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:10.742283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b0e31-1e63-4562-9cb7-b4259e235a94 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:10.769469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:10.846696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b0e31-1e63-4562-9cb7-b4259e235a94 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:10.878972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb78d7-3374-42f3-afbb-89e7b50628fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:10.879830 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb78d7-3374-42f3-afbb-89e7b50628fc None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:10.880094 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb78d7-3374-42f3-afbb-89e7b50628fc None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:10.880378 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb78d7-3374-42f3-afbb-89e7b50628fc None admin] PATH_INFO: `/v3/users/188b3b0aa933432fa343cefe04b5dedf` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:10.881575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb78d7-3374-42f3-afbb-89e7b50628fc None admin] RBAC: Authorizing `identity:get_user(user_id=188b3b0aa933432fa343cefe04b5dedf)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:10.883032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb78d7-3374-42f3-afbb-89e7b50628fc None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:10.884633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 542/1089] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:10 2022] GET /identity/v3/users/188b3b0aa933432fa343cefe04b5dedf => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:10.890581 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbfd2a-f58c-48da-9dcb-a64ad10d2f9d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:10.991562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbfd2a-f58c-48da-9dcb-a64ad10d2f9d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:11.000634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:11.025948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5c9d3-a294-478e-9367-543b37f0199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:11.026593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c9d3-a294-478e-9367-543b37f0199d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:11.026998 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c9d3-a294-478e-9367-543b37f0199d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:11.027275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c9d3-a294-478e-9367-543b37f0199d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:11.099104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5c9d3-a294-478e-9367-543b37f0199d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:11.100452 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5c9d3-a294-478e-9367-543b37f0199d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:11.206405 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 548/1090] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:03:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 12:03:11.212572 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb78d7-3374-42f3-afbb-89e7b50628fc None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:11.305187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:11.316719 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb78d7-3374-42f3-afbb-89e7b50628fc None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:11.353438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28708f3-531f-4464-9dd6-35b7592e6856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:11.354226 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28708f3-531f-4464-9dd6-35b7592e6856 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:11.354510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28708f3-531f-4464-9dd6-35b7592e6856 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:11.354910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28708f3-531f-4464-9dd6-35b7592e6856 None admin] PATH_INFO: `/v3/projects/cc1b41975b8f49398d44323ba918092a` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:11.356202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28708f3-531f-4464-9dd6-35b7592e6856 None admin] RBAC: Authorizing `identity:get_project(project_id=cc1b41975b8f49398d44323ba918092a)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:11.357638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28708f3-531f-4464-9dd6-35b7592e6856 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:11.359389 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 543/1091] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:03:11 2022] GET /identity/v3/projects/cc1b41975b8f49398d44323ba918092a => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:11.365911 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5c9d3-a294-478e-9367-543b37f0199d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:11.376280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:11.452774 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19b757-1bac-4bc7-85b8-d416d9615bee None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:11.453065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19b757-1bac-4bc7-85b8-d416d9615bee None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:11.453341 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19b757-1bac-4bc7-85b8-d416d9615bee None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:11.454753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 544/1092] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:11.459789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958877b-e7d9-4b2a-b04c-ff4b7848df7a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:11.460108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958877b-e7d9-4b2a-b04c-ff4b7848df7a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:11.460353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958877b-e7d9-4b2a-b04c-ff4b7848df7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:11.473516 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5c9d3-a294-478e-9367-543b37f0199d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:11.477998 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1958877b-e7d9-4b2a-b04c-ff4b7848df7a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:11.479233 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1958877b-e7d9-4b2a-b04c-ff4b7848df7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:11.509113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15a001-24b4-4d2a-8c1f-f7efbc14053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:11.509780 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15a001-24b4-4d2a-8c1f-f7efbc14053c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:11.510065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15a001-24b4-4d2a-8c1f-f7efbc14053c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:11.510339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15a001-24b4-4d2a-8c1f-f7efbc14053c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:11.511771 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15a001-24b4-4d2a-8c1f-f7efbc14053c None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=cc1b41975b8f49398d44323ba918092a, user.id=188b3b0aa933432fa343cefe04b5dedf) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:11.512088 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15a001-24b4-4d2a-8c1f-f7efbc14053c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:11.513528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15a001-24b4-4d2a-8c1f-f7efbc14053c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:11.519807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 549/1093] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:03:11 2022] GET /identity/v3/role_assignments?user.id=188b3b0aa933432fa343cefe04b5dedf&scope.project.id=cc1b41975b8f49398d44323ba918092a&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:11.549149 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 545/1094] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:11.573755 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15a001-24b4-4d2a-8c1f-f7efbc14053c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:11.651516 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:11.685212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15a001-24b4-4d2a-8c1f-f7efbc14053c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:11.720963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae049b-e881-4142-8f3f-47bafaa3ce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:11.721791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae049b-e881-4142-8f3f-47bafaa3ce4e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:11.722121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae049b-e881-4142-8f3f-47bafaa3ce4e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:11.722434 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae049b-e881-4142-8f3f-47bafaa3ce4e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:11.733046 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae049b-e881-4142-8f3f-47bafaa3ce4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-a9ae049b-e881-4142-8f3f-47bafaa3ce4e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:03:11.741260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:11.742262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:11.743276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:11.743276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:11.743276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:11.743276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:11.743276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:03:11.743276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:03:11.743276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:03:11.743276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:03:11.743276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:03:11.743276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:03:11.743276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 12:03:11.743276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:11.743276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 550/1095] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jul 21 12:03:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:11.748701 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958877b-e7d9-4b2a-b04c-ff4b7848df7a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:11.843223 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:11.853418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958877b-e7d9-4b2a-b04c-ff4b7848df7a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:11.889623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8455a7-2031-4f68-9fb8-14a7b2d74e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:11.890300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8455a7-2031-4f68-9fb8-14a7b2d74e43 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:11.890590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8455a7-2031-4f68-9fb8-14a7b2d74e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:11.890897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8455a7-2031-4f68-9fb8-14a7b2d74e43 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:11.891650 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8455a7-2031-4f68-9fb8-14a7b2d74e43 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:11.891969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8455a7-2031-4f68-9fb8-14a7b2d74e43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:11.893340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8455a7-2031-4f68-9fb8-14a7b2d74e43 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:11.901900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 546/1096] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jul 21 12:03:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:11.907722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae049b-e881-4142-8f3f-47bafaa3ce4e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:12.013167 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae049b-e881-4142-8f3f-47bafaa3ce4e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:12.041640 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:12.047848 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17ddc4-817d-48f4-81db-0fd3eea0f8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:12.048668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17ddc4-817d-48f4-81db-0fd3eea0f8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:12.048963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17ddc4-817d-48f4-81db-0fd3eea0f8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:12.049240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17ddc4-817d-48f4-81db-0fd3eea0f8d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:12.060469 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17ddc4-817d-48f4-81db-0fd3eea0f8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:12.061926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17ddc4-817d-48f4-81db-0fd3eea0f8d3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-1f17ddc4-817d-48f4-81db-0fd3eea0f8d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:03:12.087552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:12.088558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:12.089463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:03:12.089463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:03:12.089463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:03:12.089463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:12.089463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 551/1097] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:12.094875 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8455a7-2031-4f68-9fb8-14a7b2d74e43 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:12.215207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8455a7-2031-4f68-9fb8-14a7b2d74e43 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:12.259962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fa691-6f25-4855-8aab-165245d4cb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:12.260635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fa691-6f25-4855-8aab-165245d4cb0b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:12.260952 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fa691-6f25-4855-8aab-165245d4cb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:12.261271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fa691-6f25-4855-8aab-165245d4cb0b None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:12.261999 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fa691-6f25-4855-8aab-165245d4cb0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:12.262312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fa691-6f25-4855-8aab-165245d4cb0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:12.263732 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fa691-6f25-4855-8aab-165245d4cb0b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:12.276763 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 547/1098] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:12.282408 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17ddc4-817d-48f4-81db-0fd3eea0f8d3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:12.394266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17ddc4-817d-48f4-81db-0fd3eea0f8d3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:12.428669 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092224a-8a34-43df-b507-7a7440d743e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:12.429463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092224a-8a34-43df-b507-7a7440d743e9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:12.429763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092224a-8a34-43df-b507-7a7440d743e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:12.430038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092224a-8a34-43df-b507-7a7440d743e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:12.437905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092224a-8a34-43df-b507-7a7440d743e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:12.439385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092224a-8a34-43df-b507-7a7440d743e9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-3092224a-8a34-43df-b507-7a7440d743e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:03:12.456022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:12.457230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:12.458621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:12.458621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:12.458621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:03:12.458621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:03:12.458621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:03:12.458621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:03:12.458621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:03:12.458621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:03:12.458621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 12:03:12.458621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:12.462104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 552/1099] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jul 21 12:03:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:12.463426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fa691-6f25-4855-8aab-165245d4cb0b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:12.479129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:12.577322 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fa691-6f25-4855-8aab-165245d4cb0b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:12.615299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3c484-22e2-432b-8d84-aecf3e0f14e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:12.615991 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c484-22e2-432b-8d84-aecf3e0f14e6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:12.616274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c484-22e2-432b-8d84-aecf3e0f14e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:12.616553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c484-22e2-432b-8d84-aecf3e0f14e6 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:12.617415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3c484-22e2-432b-8d84-aecf3e0f14e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:12.617728 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3c484-22e2-432b-8d84-aecf3e0f14e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:12.619209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3c484-22e2-432b-8d84-aecf3e0f14e6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:12.638916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 548/1100] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jul 21 12:03:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:12.645032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092224a-8a34-43df-b507-7a7440d743e9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:12.696277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:12.756558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092224a-8a34-43df-b507-7a7440d743e9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:12.791828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d294a-3eca-4236-a43c-9bb53d6e0b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:12.792588 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d294a-3eca-4236-a43c-9bb53d6e0b09 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:12.792871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d294a-3eca-4236-a43c-9bb53d6e0b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:12.793146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d294a-3eca-4236-a43c-9bb53d6e0b09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:12.860855 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d294a-3eca-4236-a43c-9bb53d6e0b09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:12.862294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d294a-3eca-4236-a43c-9bb53d6e0b09 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:12.907142 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:12.960933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 553/1101] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:03:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:03:12.966978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3c484-22e2-432b-8d84-aecf3e0f14e6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:13.063754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:13.096785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3c484-22e2-432b-8d84-aecf3e0f14e6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:13.132208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc234ed-5035-49b4-a365-865729267dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:13.133022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc234ed-5035-49b4-a365-865729267dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:13.133304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc234ed-5035-49b4-a365-865729267dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:13.133577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc234ed-5035-49b4-a365-865729267dd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:13.144714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc234ed-5035-49b4-a365-865729267dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:13.146725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc234ed-5035-49b4-a365-865729267dd5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-2bc234ed-5035-49b4-a365-865729267dd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:03:13.165757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:13.166755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:13.167656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:03:13.167656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:03:13.167656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:03:13.167656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:13.167656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 549/1102] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:13.173074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d294a-3eca-4236-a43c-9bb53d6e0b09 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:13.279399 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d294a-3eca-4236-a43c-9bb53d6e0b09 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:13.316575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4a918-922d-4941-9e21-22af0ae1b0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:13.317149 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4a918-922d-4941-9e21-22af0ae1b0dd None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:13.317432 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4a918-922d-4941-9e21-22af0ae1b0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:13.317704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4a918-922d-4941-9e21-22af0ae1b0dd None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:13.318427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4a918-922d-4941-9e21-22af0ae1b0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:13.318752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4a918-922d-4941-9e21-22af0ae1b0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:13.320120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4a918-922d-4941-9e21-22af0ae1b0dd None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:13.333204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 554/1103] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:13.339140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc234ed-5035-49b4-a365-865729267dd5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:13.440721 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc234ed-5035-49b4-a365-865729267dd5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:13.469387 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:13.481785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff841d9-c884-4c7f-a312-2e9f59eaa296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:13.482591 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff841d9-c884-4c7f-a312-2e9f59eaa296 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:13.482900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff841d9-c884-4c7f-a312-2e9f59eaa296 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:13.483175 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff841d9-c884-4c7f-a312-2e9f59eaa296 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:13.490241 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff841d9-c884-4c7f-a312-2e9f59eaa296 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:13.491697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff841d9-c884-4c7f-a312-2e9f59eaa296 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-dff841d9-c884-4c7f-a312-2e9f59eaa296 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:03:13.505411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:13.506416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:13.507371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:03:13.507371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:03:13.507371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:03:13.507371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:03:13.507371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:03:13.507371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:03:13.507371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:03:13.507371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:13.507371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 550/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:13.512639 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4a918-922d-4941-9e21-22af0ae1b0dd None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:13.516735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:13.583226 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512dfc2-b0c2-4746-8bbf-2341b95898b8 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:13.583426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512dfc2-b0c2-4746-8bbf-2341b95898b8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:13.583691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512dfc2-b0c2-4746-8bbf-2341b95898b8 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:13.585080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 551/1105] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:13.590251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d7b8a-7bf8-404c-8a8b-efce4c6a6f63 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:13.590542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d7b8a-7bf8-404c-8a8b-efce4c6a6f63 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:13.591071 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d7b8a-7bf8-404c-8a8b-efce4c6a6f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:13.609786 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8f6d7b8a-7bf8-404c-8a8b-efce4c6a6f63 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:13.611064 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8f6d7b8a-7bf8-404c-8a8b-efce4c6a6f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:13.615574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4a918-922d-4941-9e21-22af0ae1b0dd None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:13.649803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef300c-6f5a-4eef-8a10-d2f7cd950b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:13.650476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef300c-6f5a-4eef-8a10-d2f7cd950b98 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:13.650788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef300c-6f5a-4eef-8a10-d2f7cd950b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:13.651070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef300c-6f5a-4eef-8a10-d2f7cd950b98 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:13.652120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef300c-6f5a-4eef-8a10-d2f7cd950b98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:13.652434 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef300c-6f5a-4eef-8a10-d2f7cd950b98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:13.662798 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef300c-6f5a-4eef-8a10-d2f7cd950b98 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:13.681433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 555/1106] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:13.684753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 552/1107] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:13.687915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef300c-6f5a-4eef-8a10-d2f7cd950b98 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:13.710202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d7b8a-7bf8-404c-8a8b-efce4c6a6f63 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:13.752168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:13.789352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef300c-6f5a-4eef-8a10-d2f7cd950b98 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:13.807561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d7b8a-7bf8-404c-8a8b-efce4c6a6f63 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:13.820661 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:13.822213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cbe7d-31fa-4d9d-919e-46b3185089cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:13.823014 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cbe7d-31fa-4d9d-919e-46b3185089cf None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:13.823300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cbe7d-31fa-4d9d-919e-46b3185089cf None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:13.823636 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cbe7d-31fa-4d9d-919e-46b3185089cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:13.824463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cbe7d-31fa-4d9d-919e-46b3185089cf None admin] RBAC: Adding query filter params (role.id=4aba4eb30dca482a9a29417a44a955d1, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=f3fb1d091b27472081549f4166ca172f) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:13.824771 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cbe7d-31fa-4d9d-919e-46b3185089cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:13.826196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cbe7d-31fa-4d9d-919e-46b3185089cf None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:13.832084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 556/1108] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:03:13 2022] GET /identity/v3/role_assignments?user.id=f3fb1d091b27472081549f4166ca172f&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=4aba4eb30dca482a9a29417a44a955d1 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:13.844095 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc4c5-240d-47c3-812d-355c6dfd2fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:13.844831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc4c5-240d-47c3-812d-355c6dfd2fae None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:13.845109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc4c5-240d-47c3-812d-355c6dfd2fae None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:13.845377 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc4c5-240d-47c3-812d-355c6dfd2fae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:13.846812 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc4c5-240d-47c3-812d-355c6dfd2fae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:13.848351 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc4c5-240d-47c3-812d-355c6dfd2fae None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:13.850109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 553/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:13.856532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cbe7d-31fa-4d9d-919e-46b3185089cf None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:13.965692 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cbe7d-31fa-4d9d-919e-46b3185089cf None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:13.996354 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:14.005102 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f221bba-e3a2-4147-8874-2607db05d401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:14.005796 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f221bba-e3a2-4147-8874-2607db05d401 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:14.006083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f221bba-e3a2-4147-8874-2607db05d401 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:14.006364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f221bba-e3a2-4147-8874-2607db05d401 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:14.007145 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f221bba-e3a2-4147-8874-2607db05d401 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:14.008589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f221bba-e3a2-4147-8874-2607db05d401 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:14.030347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 557/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:03:13 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:03:16.079930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c83d92-b473-4f57-9d75-2acea512d96b None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:16.080533 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c83d92-b473-4f57-9d75-2acea512d96b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:16.080533 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c83d92-b473-4f57-9d75-2acea512d96b None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:16.081848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 554/1111] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:16.087229 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68d771-fdef-4173-92ba-f773b69ae5ea None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:16.087652 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68d771-fdef-4173-92ba-f773b69ae5ea None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:16.087760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68d771-fdef-4173-92ba-f773b69ae5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:16.105599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4f68d771-fdef-4173-92ba-f773b69ae5ea None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:16.106844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4f68d771-fdef-4173-92ba-f773b69ae5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:16.177896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 558/1112] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:16.202110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c83d92-b473-4f57-9d75-2acea512d96b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:16.309126 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c83d92-b473-4f57-9d75-2acea512d96b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:16.344833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d5285-5f5d-4808-bdc3-47231cd436ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:16.345613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d5285-5f5d-4808-bdc3-47231cd436ad None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:16.345895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d5285-5f5d-4808-bdc3-47231cd436ad None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:16.346168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d5285-5f5d-4808-bdc3-47231cd436ad None admin] PATH_INFO: `/v3/roles/a6779b95437c46648185d3ce128f658b` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:16.347701 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d5285-5f5d-4808-bdc3-47231cd436ad None admin] RBAC: Authorizing `identity:get_role(role_id=a6779b95437c46648185d3ce128f658b)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:16.349085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d5285-5f5d-4808-bdc3-47231cd436ad None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:16.350472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 555/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:16 2022] GET /identity/v3/roles/a6779b95437c46648185d3ce128f658b => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:16.356530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68d771-fdef-4173-92ba-f773b69ae5ea None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:16.456215 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68d771-fdef-4173-92ba-f773b69ae5ea None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:16.470618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:16.491324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0f23e-8246-4aa0-8ace-a88eabea6782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:16.492198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f23e-8246-4aa0-8ace-a88eabea6782 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:16.492480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f23e-8246-4aa0-8ace-a88eabea6782 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:16.492759 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f23e-8246-4aa0-8ace-a88eabea6782 None admin] PATH_INFO: `/v3/users/d83138ee07d944c38683e85136891bdd` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:16.506155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0f23e-8246-4aa0-8ace-a88eabea6782 None admin] RBAC: Authorizing `identity:get_user(user_id=d83138ee07d944c38683e85136891bdd)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:16.507624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0f23e-8246-4aa0-8ace-a88eabea6782 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:16.509290 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 559/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:16 2022] GET /identity/v3/users/d83138ee07d944c38683e85136891bdd => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:16.515515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d5285-5f5d-4808-bdc3-47231cd436ad None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:16.565404 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:16.617091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d5285-5f5d-4808-bdc3-47231cd436ad None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:16.652003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2fa83-828a-4ef1-92cd-160756a5a858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:16.652658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2fa83-828a-4ef1-92cd-160756a5a858 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:16.652941 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2fa83-828a-4ef1-92cd-160756a5a858 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:16.653220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2fa83-828a-4ef1-92cd-160756a5a858 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:16.724653 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2fa83-828a-4ef1-92cd-160756a5a858 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:16.726118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2fa83-828a-4ef1-92cd-160756a5a858 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:16.774770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:16.825901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 556/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:03:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:03:16.832148 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0f23e-8246-4aa0-8ace-a88eabea6782 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:16.938041 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0f23e-8246-4aa0-8ace-a88eabea6782 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:16.973766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d36eb0-18a1-4599-a64e-be49faf28bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:16.974624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d36eb0-18a1-4599-a64e-be49faf28bcb None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:16.974941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d36eb0-18a1-4599-a64e-be49faf28bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:16.975219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d36eb0-18a1-4599-a64e-be49faf28bcb None admin] PATH_INFO: `/v3/projects/cc1b41975b8f49398d44323ba918092a` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:16.976445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d36eb0-18a1-4599-a64e-be49faf28bcb None admin] RBAC: Authorizing `identity:get_project(project_id=cc1b41975b8f49398d44323ba918092a)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:16.977872 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d36eb0-18a1-4599-a64e-be49faf28bcb None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:16.979769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 560/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:03:16 2022] GET /identity/v3/projects/cc1b41975b8f49398d44323ba918092a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:16.986396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2fa83-828a-4ef1-92cd-160756a5a858 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:17.093566 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2fa83-828a-4ef1-92cd-160756a5a858 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:17.130884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448f07a-60b4-4bd1-aa73-de3ce57c7b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:17.131536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448f07a-60b4-4bd1-aa73-de3ce57c7b46 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:17.131822 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448f07a-60b4-4bd1-aa73-de3ce57c7b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:17.132104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448f07a-60b4-4bd1-aa73-de3ce57c7b46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:17.132940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448f07a-60b4-4bd1-aa73-de3ce57c7b46 None admin] RBAC: Adding query filter params (role.id=a6779b95437c46648185d3ce128f658b, scope.project.id=cc1b41975b8f49398d44323ba918092a, user.id=d83138ee07d944c38683e85136891bdd) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:17.133250 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448f07a-60b4-4bd1-aa73-de3ce57c7b46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:17.134711 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448f07a-60b4-4bd1-aa73-de3ce57c7b46 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:17.142380 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 557/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:03:16 2022] GET /identity/v3/role_assignments?user.id=d83138ee07d944c38683e85136891bdd&scope.project.id=cc1b41975b8f49398d44323ba918092a&role.id=a6779b95437c46648185d3ce128f658b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:19.129905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498141-1092-4247-9231-964d754cf167 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:19.130490 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498141-1092-4247-9231-964d754cf167 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:19.130490 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498141-1092-4247-9231-964d754cf167 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:19.131930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 561/1118] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:19.138188 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ddedf-ee07-48c4-a6d6-1953ef971f73 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:19.138771 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ddedf-ee07-48c4-a6d6-1953ef971f73 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:19.138771 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ddedf-ee07-48c4-a6d6-1953ef971f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:19.156892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d19ddedf-ee07-48c4-a6d6-1953ef971f73 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:19.158091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d19ddedf-ee07-48c4-a6d6-1953ef971f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:19.165800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:19.227333 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 558/1119] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:19.250315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1498141-1092-4247-9231-964d754cf167 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:19.294913 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:19.356254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1498141-1092-4247-9231-964d754cf167 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:19.390784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39b26d-8736-4b9f-b805-06746f201e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:19.391579 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39b26d-8736-4b9f-b805-06746f201e87 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:19.391862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39b26d-8736-4b9f-b805-06746f201e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:19.392134 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39b26d-8736-4b9f-b805-06746f201e87 None admin] PATH_INFO: `/v3/roles/a6779b95437c46648185d3ce128f658b` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:19.393617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39b26d-8736-4b9f-b805-06746f201e87 None admin] RBAC: Authorizing `identity:get_role(role_id=a6779b95437c46648185d3ce128f658b)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:19.394996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39b26d-8736-4b9f-b805-06746f201e87 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:19.396382 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 562/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:19 2022] GET /identity/v3/roles/a6779b95437c46648185d3ce128f658b => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:19.402523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ddedf-ee07-48c4-a6d6-1953ef971f73 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:19.508499 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ddedf-ee07-48c4-a6d6-1953ef971f73 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:19.544783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828e8c-6e79-43d4-b3e0-569455de9864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:19.545651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828e8c-6e79-43d4-b3e0-569455de9864 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:19.545931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828e8c-6e79-43d4-b3e0-569455de9864 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:19.546205 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828e8c-6e79-43d4-b3e0-569455de9864 None admin] PATH_INFO: `/v3/users/d83138ee07d944c38683e85136891bdd` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:19.547486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1828e8c-6e79-43d4-b3e0-569455de9864 None admin] RBAC: Authorizing `identity:get_user(user_id=d83138ee07d944c38683e85136891bdd)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:19.548930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1828e8c-6e79-43d4-b3e0-569455de9864 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:19.550578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 559/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:19 2022] GET /identity/v3/users/d83138ee07d944c38683e85136891bdd => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:19.556846 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39b26d-8736-4b9f-b805-06746f201e87 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:19.661972 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39b26d-8736-4b9f-b805-06746f201e87 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:19.671149 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:19.697894 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e02c79-9d31-471c-920d-9af06c59f39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:19.698839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e02c79-9d31-471c-920d-9af06c59f39b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:19.699128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e02c79-9d31-471c-920d-9af06c59f39b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:19.699409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e02c79-9d31-471c-920d-9af06c59f39b None admin] PATH_INFO: `/v3/projects/cc1b41975b8f49398d44323ba918092a` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:19.700631 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e02c79-9d31-471c-920d-9af06c59f39b None admin] RBAC: Authorizing `identity:get_project(project_id=cc1b41975b8f49398d44323ba918092a)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:19.702068 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e02c79-9d31-471c-920d-9af06c59f39b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:19.703812 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 563/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:03:19 2022] GET /identity/v3/projects/cc1b41975b8f49398d44323ba918092a => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:19.710199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828e8c-6e79-43d4-b3e0-569455de9864 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:19.723298 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:19.813179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828e8c-6e79-43d4-b3e0-569455de9864 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:19.850398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cb6a9-5d22-4c36-a528-415b4ddbf5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:19.851321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cb6a9-5d22-4c36-a528-415b4ddbf5be None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:19.851611 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cb6a9-5d22-4c36-a528-415b4ddbf5be None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:19.851917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cb6a9-5d22-4c36-a528-415b4ddbf5be None admin] PATH_INFO: `/v3/projects/cc1b41975b8f49398d44323ba918092a/users/d83138ee07d944c38683e85136891bdd/roles/a6779b95437c46648185d3ce128f658b` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:19.854203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cb6a9-5d22-4c36-a528-415b4ddbf5be None admin] RBAC: Authorizing `identity:create_grant(project_id=cc1b41975b8f49398d44323ba918092a, user_id=d83138ee07d944c38683e85136891bdd, role_id=a6779b95437c46648185d3ce128f658b)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:19.855670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cb6a9-5d22-4c36-a528-415b4ddbf5be None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:19.870905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 560/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:03:19 2022] PUT /identity/v3/projects/cc1b41975b8f49398d44323ba918092a/users/d83138ee07d944c38683e85136891bdd/roles/a6779b95437c46648185d3ce128f658b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:03:21.853119 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9e310-0456-4622-ae0e-be4206a055ee None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:21.853712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9e310-0456-4622-ae0e-be4206a055ee None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:21.853712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9e310-0456-4622-ae0e-be4206a055ee None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:21.855244 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 564/1124] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:21.860464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784860f-3fa1-43b2-966b-24ed725984b4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:21.860875 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784860f-3fa1-43b2-966b-24ed725984b4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:21.861015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784860f-3fa1-43b2-966b-24ed725984b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:21.879184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0784860f-3fa1-43b2-966b-24ed725984b4 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:21.880388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0784860f-3fa1-43b2-966b-24ed725984b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:21.946646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:21.952813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 561/1125] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:21.976902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9e310-0456-4622-ae0e-be4206a055ee None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:22.084083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9e310-0456-4622-ae0e-be4206a055ee None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:22.119733 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae71d5-25ad-4dc0-8795-b186960b33f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:22.120574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae71d5-25ad-4dc0-8795-b186960b33f1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:22.120856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae71d5-25ad-4dc0-8795-b186960b33f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:22.121133 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae71d5-25ad-4dc0-8795-b186960b33f1 None admin] PATH_INFO: `/v3/roles/a6779b95437c46648185d3ce128f658b` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:22.122690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae71d5-25ad-4dc0-8795-b186960b33f1 None admin] RBAC: Authorizing `identity:get_role(role_id=a6779b95437c46648185d3ce128f658b)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:22.124054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae71d5-25ad-4dc0-8795-b186960b33f1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:22.125455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 565/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:21 2022] GET /identity/v3/roles/a6779b95437c46648185d3ce128f658b => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:22.131796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784860f-3fa1-43b2-966b-24ed725984b4 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:22.234937 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784860f-3fa1-43b2-966b-24ed725984b4 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:22.269232 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a6e94-2a74-491c-bbac-1811c92d26e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:22.270104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6e94-2a74-491c-bbac-1811c92d26e1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:22.270380 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6e94-2a74-491c-bbac-1811c92d26e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:22.270702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6e94-2a74-491c-bbac-1811c92d26e1 None admin] PATH_INFO: `/v3/users/d83138ee07d944c38683e85136891bdd` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:22.271908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a6e94-2a74-491c-bbac-1811c92d26e1 None admin] RBAC: Authorizing `identity:get_user(user_id=d83138ee07d944c38683e85136891bdd)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:22.273334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a6e94-2a74-491c-bbac-1811c92d26e1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:22.274984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 562/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:22 2022] GET /identity/v3/users/d83138ee07d944c38683e85136891bdd => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:22.281104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae71d5-25ad-4dc0-8795-b186960b33f1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:22.330682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:22.385934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae71d5-25ad-4dc0-8795-b186960b33f1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:22.418394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee526c21-842a-4fa5-9301-dbf7b35e09ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:22.419108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee526c21-842a-4fa5-9301-dbf7b35e09ff None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:22.419388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee526c21-842a-4fa5-9301-dbf7b35e09ff None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:22.419659 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee526c21-842a-4fa5-9301-dbf7b35e09ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:22.490259 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee526c21-842a-4fa5-9301-dbf7b35e09ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:22.491746 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee526c21-842a-4fa5-9301-dbf7b35e09ff None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:22.536834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:22.596283 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 566/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:03:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:03:22.602603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a6e94-2a74-491c-bbac-1811c92d26e1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:22.673377 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:22.709056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a6e94-2a74-491c-bbac-1811c92d26e1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:22.744351 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bd14f-905c-4e3c-9c1b-4d562612bab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:22.745220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bd14f-905c-4e3c-9c1b-4d562612bab9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:22.745503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bd14f-905c-4e3c-9c1b-4d562612bab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:22.745779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bd14f-905c-4e3c-9c1b-4d562612bab9 None admin] PATH_INFO: `/v3/projects/cc1b41975b8f49398d44323ba918092a` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:22.747008 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bd14f-905c-4e3c-9c1b-4d562612bab9 None admin] RBAC: Authorizing `identity:get_project(project_id=cc1b41975b8f49398d44323ba918092a)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:22.748440 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bd14f-905c-4e3c-9c1b-4d562612bab9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:22.750146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 563/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:03:22 2022] GET /identity/v3/projects/cc1b41975b8f49398d44323ba918092a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:22.756690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee526c21-842a-4fa5-9301-dbf7b35e09ff None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:22.857931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee526c21-842a-4fa5-9301-dbf7b35e09ff None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:22.893662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37fea2-c6f4-45b6-bd09-8c1402da34d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:22.894326 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37fea2-c6f4-45b6-bd09-8c1402da34d5 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:22.894609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37fea2-c6f4-45b6-bd09-8c1402da34d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:22.894917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37fea2-c6f4-45b6-bd09-8c1402da34d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:22.895766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37fea2-c6f4-45b6-bd09-8c1402da34d5 None admin] RBAC: Adding query filter params (role.id=a6779b95437c46648185d3ce128f658b, scope.project.id=cc1b41975b8f49398d44323ba918092a, user.id=d83138ee07d944c38683e85136891bdd) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:22.896075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37fea2-c6f4-45b6-bd09-8c1402da34d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:22.897517 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37fea2-c6f4-45b6-bd09-8c1402da34d5 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:22.904098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 567/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:03:22 2022] GET /identity/v3/role_assignments?user.id=d83138ee07d944c38683e85136891bdd&scope.project.id=cc1b41975b8f49398d44323ba918092a&role.id=a6779b95437c46648185d3ce128f658b => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:24.938236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2da4b-529c-44bd-86fe-b1ff53baaee2 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:24.938822 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2da4b-529c-44bd-86fe-b1ff53baaee2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:24.938899 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2da4b-529c-44bd-86fe-b1ff53baaee2 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:24.940329 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 564/1131] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:24.945647 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04e6cc-ecf9-46f8-bdde-8fe5f171899b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:24.946449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04e6cc-ecf9-46f8-bdde-8fe5f171899b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:24.946556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04e6cc-ecf9-46f8-bdde-8fe5f171899b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:24.964108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0b04e6cc-ecf9-46f8-bdde-8fe5f171899b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:24.965297 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0b04e6cc-ecf9-46f8-bdde-8fe5f171899b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:24.967262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:25.038326 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 568/1132] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:25.062190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2da4b-529c-44bd-86fe-b1ff53baaee2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:25.167451 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2da4b-529c-44bd-86fe-b1ff53baaee2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:25.203199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b825dcd-ea6c-42f7-908a-1811a7ee16d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:25.203930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b825dcd-ea6c-42f7-908a-1811a7ee16d5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:25.204212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b825dcd-ea6c-42f7-908a-1811a7ee16d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:25.204479 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b825dcd-ea6c-42f7-908a-1811a7ee16d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:25.205783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b825dcd-ea6c-42f7-908a-1811a7ee16d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:25.207262 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b825dcd-ea6c-42f7-908a-1811a7ee16d5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:25.208890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 565/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:25.215226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04e6cc-ecf9-46f8-bdde-8fe5f171899b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:25.316744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04e6cc-ecf9-46f8-bdde-8fe5f171899b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:25.351349 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b725e-616c-4f92-b6ff-36384320c1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:25.352001 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b725e-616c-4f92-b6ff-36384320c1d6 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:25.352279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b725e-616c-4f92-b6ff-36384320c1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:25.352551 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b725e-616c-4f92-b6ff-36384320c1d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:25.353256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b725e-616c-4f92-b6ff-36384320c1d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:25.354702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b725e-616c-4f92-b6ff-36384320c1d6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:25.362847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:25.381288 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 569/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jul 21 12:03:25 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:03:27.418144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f4f47-9b10-49ca-8771-f8bcc19c94bf None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:27.418750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f4f47-9b10-49ca-8771-f8bcc19c94bf None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:27.418750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f4f47-9b10-49ca-8771-f8bcc19c94bf None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:27.420080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 566/1135] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:27.425447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a23c5b-46ce-4fa6-9b68-92a5395d073d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:27.425901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a23c5b-46ce-4fa6-9b68-92a5395d073d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:27.426013 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a23c5b-46ce-4fa6-9b68-92a5395d073d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:27.443797 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-21a23c5b-46ce-4fa6-9b68-92a5395d073d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:27.445004 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-21a23c5b-46ce-4fa6-9b68-92a5395d073d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:27.518992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 570/1136] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:27.543694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f4f47-9b10-49ca-8771-f8bcc19c94bf None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:27.548028 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:27.653190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f4f47-9b10-49ca-8771-f8bcc19c94bf None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:27.688005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e80f-aad3-47f0-add6-1a7a550394a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:27.688721 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e80f-aad3-47f0-add6-1a7a550394a5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:27.689041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e80f-aad3-47f0-add6-1a7a550394a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:27.689327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e80f-aad3-47f0-add6-1a7a550394a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:27.690606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475e80f-aad3-47f0-add6-1a7a550394a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:27.692177 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475e80f-aad3-47f0-add6-1a7a550394a5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:27.693801 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 567/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:03:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:27.700437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a23c5b-46ce-4fa6-9b68-92a5395d073d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:27.800194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a23c5b-46ce-4fa6-9b68-92a5395d073d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:27.820172 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:27.835765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0422cf-0c5e-40cc-b8dd-2002c2bef72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:27.836446 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0422cf-0c5e-40cc-b8dd-2002c2bef72a None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:27.836728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0422cf-0c5e-40cc-b8dd-2002c2bef72a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:27.837003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0422cf-0c5e-40cc-b8dd-2002c2bef72a None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:27.837734 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0422cf-0c5e-40cc-b8dd-2002c2bef72a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:27.839230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0422cf-0c5e-40cc-b8dd-2002c2bef72a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:27.859704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 571/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:03:27 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:03:29.968292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cac45-7ef5-4b3b-941c-1b45b6d884bf None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:29.968889 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cac45-7ef5-4b3b-941c-1b45b6d884bf None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:29.968889 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cac45-7ef5-4b3b-941c-1b45b6d884bf None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:29.970169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 568/1139] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:29.975890 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1fee6-dea5-4a25-9d2e-7fb5fbc590cd None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:29.976331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1fee6-dea5-4a25-9d2e-7fb5fbc590cd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:29.976418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1fee6-dea5-4a25-9d2e-7fb5fbc590cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:29.993688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-43a1fee6-dea5-4a25-9d2e-7fb5fbc590cd None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:29.994965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-43a1fee6-dea5-4a25-9d2e-7fb5fbc590cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:30.064525 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 572/1140] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:03:30.088683 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cac45-7ef5-4b3b-941c-1b45b6d884bf None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:30.167177 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:30.201160 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cac45-7ef5-4b3b-941c-1b45b6d884bf None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:30.235881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4272d1-d997-4abc-99bd-9cc924cd45fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:30.236598 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4272d1-d997-4abc-99bd-9cc924cd45fe None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:30.236877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4272d1-d997-4abc-99bd-9cc924cd45fe None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:30.237146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4272d1-d997-4abc-99bd-9cc924cd45fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:30.247682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4272d1-d997-4abc-99bd-9cc924cd45fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-4f4272d1-d997-4abc-99bd-9cc924cd45fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:03:30.255196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:30.256303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:30.262472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:30.262472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:30.262472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:30.262472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:30.262472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:03:30.262472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:03:30.262472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:03:30.262472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:03:30.262472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:03:30.262472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:03:30.262472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:30.262472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:30.262472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 569/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:03:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:30.263323 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1fee6-dea5-4a25-9d2e-7fb5fbc590cd None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:30.366377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1fee6-dea5-4a25-9d2e-7fb5fbc590cd None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:30.373740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:30.404227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72eb0b-6487-40d5-9e29-f7b6deda6659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:30.404900 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72eb0b-6487-40d5-9e29-f7b6deda6659 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:30.405186 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72eb0b-6487-40d5-9e29-f7b6deda6659 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:30.405462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72eb0b-6487-40d5-9e29-f7b6deda6659 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:30.406214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72eb0b-6487-40d5-9e29-f7b6deda6659 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:30.406524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72eb0b-6487-40d5-9e29-f7b6deda6659 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:30.407924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72eb0b-6487-40d5-9e29-f7b6deda6659 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:30.416392 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 573/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:03:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:30.422520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4272d1-d997-4abc-99bd-9cc924cd45fe None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:30.524964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4272d1-d997-4abc-99bd-9cc924cd45fe None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:30.554116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:30.559741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25886356-0025-426e-bd13-d8a408216831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:30.560619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886356-0025-426e-bd13-d8a408216831 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:30.560902 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886356-0025-426e-bd13-d8a408216831 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:30.561174 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886356-0025-426e-bd13-d8a408216831 None admin] PATH_INFO: `/v3/users/0116e7e55f974a429ea96ad747b54740` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:30.574992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25886356-0025-426e-bd13-d8a408216831 None admin] RBAC: Authorizing `identity:get_user(user_id=0116e7e55f974a429ea96ad747b54740)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:30.576443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25886356-0025-426e-bd13-d8a408216831 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:30.578113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 570/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:30 2022] GET /identity/v3/users/0116e7e55f974a429ea96ad747b54740 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:30.584169 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72eb0b-6487-40d5-9e29-f7b6deda6659 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:30.683336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72eb0b-6487-40d5-9e29-f7b6deda6659 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:30.718325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54b0f9-2317-49b6-95f1-841a2cf90049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:30.718993 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54b0f9-2317-49b6-95f1-841a2cf90049 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:30.719275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54b0f9-2317-49b6-95f1-841a2cf90049 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:30.719550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54b0f9-2317-49b6-95f1-841a2cf90049 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:30.757529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:30.795762 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54b0f9-2317-49b6-95f1-841a2cf90049 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:30.797143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54b0f9-2317-49b6-95f1-841a2cf90049 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:30.905192 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 574/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:03:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:03:30.911756 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25886356-0025-426e-bd13-d8a408216831 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:31.014554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25886356-0025-426e-bd13-d8a408216831 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:31.049827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a98a4-f235-4432-bd36-7473c601a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:31.050625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a98a4-f235-4432-bd36-7473c601a35c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:31.050947 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a98a4-f235-4432-bd36-7473c601a35c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:31.051219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a98a4-f235-4432-bd36-7473c601a35c None admin] PATH_INFO: `/v3/projects/e4d0767c939b4247ac9a118ca89d068e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:31.052451 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a98a4-f235-4432-bd36-7473c601a35c None admin] RBAC: Authorizing `identity:get_project(project_id=e4d0767c939b4247ac9a118ca89d068e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:31.053884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a98a4-f235-4432-bd36-7473c601a35c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:31.055611 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 571/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:03:30 2022] GET /identity/v3/projects/e4d0767c939b4247ac9a118ca89d068e => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:31.062088 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54b0f9-2317-49b6-95f1-841a2cf90049 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:31.128517 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:31.165917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54b0f9-2317-49b6-95f1-841a2cf90049 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:31.201458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a50406-ddf4-45c6-92c3-443dded9bc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:31.202113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a50406-ddf4-45c6-92c3-443dded9bc44 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:31.202394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a50406-ddf4-45c6-92c3-443dded9bc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:31.202712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a50406-ddf4-45c6-92c3-443dded9bc44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:31.203524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a50406-ddf4-45c6-92c3-443dded9bc44 None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=e4d0767c939b4247ac9a118ca89d068e, user.id=0116e7e55f974a429ea96ad747b54740) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:31.203837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a50406-ddf4-45c6-92c3-443dded9bc44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:31.205274 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a50406-ddf4-45c6-92c3-443dded9bc44 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:31.210941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 575/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:03:31 2022] GET /identity/v3/role_assignments?user.id=0116e7e55f974a429ea96ad747b54740&scope.project.id=e4d0767c939b4247ac9a118ca89d068e&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:33.190288 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dfaa1-efd6-43dd-b79b-587de8dcabc5 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:33.190926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dfaa1-efd6-43dd-b79b-587de8dcabc5 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:33.190926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dfaa1-efd6-43dd-b79b-587de8dcabc5 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:33.192251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 572/1147] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:33.198136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b617751-c081-46ce-a1b4-aeb90fe7a6d0 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:33.198563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b617751-c081-46ce-a1b4-aeb90fe7a6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:33.198702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b617751-c081-46ce-a1b4-aeb90fe7a6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:33.215843 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8b617751-c081-46ce-a1b4-aeb90fe7a6d0 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:33.217023 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8b617751-c081-46ce-a1b4-aeb90fe7a6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:33.285221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 576/1148] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:33.308465 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dfaa1-efd6-43dd-b79b-587de8dcabc5 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:33.368995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:33.413403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dfaa1-efd6-43dd-b79b-587de8dcabc5 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:33.448972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ea704-3049-42a6-b00a-c908e6fa01c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:33.449701 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ea704-3049-42a6-b00a-c908e6fa01c4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:33.449993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ea704-3049-42a6-b00a-c908e6fa01c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:33.450271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ea704-3049-42a6-b00a-c908e6fa01c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:33.461319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ea704-3049-42a6-b00a-c908e6fa01c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-853ea704-3049-42a6-b00a-c908e6fa01c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:03:33.468958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:33.470038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:33.475675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:33.475675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:33.475675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:33.475675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:33.475675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:03:33.475675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:03:33.475675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:03:33.475675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:03:33.475675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:03:33.475675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:03:33.475675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:33.475675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:33.475675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 573/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:03:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:33.476630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b617751-c081-46ce-a1b4-aeb90fe7a6d0 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:33.540214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:33.581483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b617751-c081-46ce-a1b4-aeb90fe7a6d0 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:33.616125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365d240-4d33-425f-adab-dae445cc06a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:33.616936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365d240-4d33-425f-adab-dae445cc06a7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:33.617278 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365d240-4d33-425f-adab-dae445cc06a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:33.617579 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365d240-4d33-425f-adab-dae445cc06a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:33.618345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365d240-4d33-425f-adab-dae445cc06a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:33.618648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365d240-4d33-425f-adab-dae445cc06a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:33.620084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365d240-4d33-425f-adab-dae445cc06a7 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:33.628605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 577/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:03:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:33.635143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ea704-3049-42a6-b00a-c908e6fa01c4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:33.746614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ea704-3049-42a6-b00a-c908e6fa01c4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:33.763974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:33.782182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246efbbd-d0b7-4aac-b5a1-9e418fd0ef9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:33.783098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246efbbd-d0b7-4aac-b5a1-9e418fd0ef9a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:33.783385 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246efbbd-d0b7-4aac-b5a1-9e418fd0ef9a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:33.783663 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246efbbd-d0b7-4aac-b5a1-9e418fd0ef9a None admin] PATH_INFO: `/v3/users/0116e7e55f974a429ea96ad747b54740` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:33.784894 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246efbbd-d0b7-4aac-b5a1-9e418fd0ef9a None admin] RBAC: Authorizing `identity:get_user(user_id=0116e7e55f974a429ea96ad747b54740)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:33.786339 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246efbbd-d0b7-4aac-b5a1-9e418fd0ef9a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:33.788033 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 574/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:33 2022] GET /identity/v3/users/0116e7e55f974a429ea96ad747b54740 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:33.794337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365d240-4d33-425f-adab-dae445cc06a7 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:33.897296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365d240-4d33-425f-adab-dae445cc06a7 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:33.920344 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:33.931281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac93e1-817e-4ee1-b294-08b2f1936afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:33.932175 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac93e1-817e-4ee1-b294-08b2f1936afb None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:33.932456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac93e1-817e-4ee1-b294-08b2f1936afb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:33.932727 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac93e1-817e-4ee1-b294-08b2f1936afb None admin] PATH_INFO: `/v3/projects/e4d0767c939b4247ac9a118ca89d068e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:33.933923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac93e1-817e-4ee1-b294-08b2f1936afb None admin] RBAC: Authorizing `identity:get_project(project_id=e4d0767c939b4247ac9a118ca89d068e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:33.935386 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac93e1-817e-4ee1-b294-08b2f1936afb None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:33.937105 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 578/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:03:33 2022] GET /identity/v3/projects/e4d0767c939b4247ac9a118ca89d068e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:33.943371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246efbbd-d0b7-4aac-b5a1-9e418fd0ef9a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:34.047156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246efbbd-d0b7-4aac-b5a1-9e418fd0ef9a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:34.081889 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16b2dc-dfa8-43a3-ac19-72a6c5cbf595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:34.082812 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b2dc-dfa8-43a3-ac19-72a6c5cbf595 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:34.083099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b2dc-dfa8-43a3-ac19-72a6c5cbf595 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:34.083370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b2dc-dfa8-43a3-ac19-72a6c5cbf595 None admin] PATH_INFO: `/v3/projects/e4d0767c939b4247ac9a118ca89d068e/users/0116e7e55f974a429ea96ad747b54740/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:34.085357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16b2dc-dfa8-43a3-ac19-72a6c5cbf595 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4d0767c939b4247ac9a118ca89d068e, user_id=0116e7e55f974a429ea96ad747b54740, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:34.086817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16b2dc-dfa8-43a3-ac19-72a6c5cbf595 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:34.100796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 575/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:03:33 2022] PUT /identity/v3/projects/e4d0767c939b4247ac9a118ca89d068e/users/0116e7e55f974a429ea96ad747b54740/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:03:36.143788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3677e-f4bf-4012-beb8-5111585b9d59 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:36.144353 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3677e-f4bf-4012-beb8-5111585b9d59 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:36.144353 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3677e-f4bf-4012-beb8-5111585b9d59 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:36.145667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 579/1154] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:36.151341 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff61e41-9815-4e98-b8de-e01ffa9b7d7d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:36.151787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff61e41-9815-4e98-b8de-e01ffa9b7d7d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:36.151905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff61e41-9815-4e98-b8de-e01ffa9b7d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:36.169357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4ff61e41-9815-4e98-b8de-e01ffa9b7d7d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:36.170553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4ff61e41-9815-4e98-b8de-e01ffa9b7d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:36.214846 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:36.241722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 576/1155] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:36.265177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3677e-f4bf-4012-beb8-5111585b9d59 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:36.371045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3677e-f4bf-4012-beb8-5111585b9d59 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:36.405546 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb377649-698a-4615-add6-fab5e13a6583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:36.406345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377649-698a-4615-add6-fab5e13a6583 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:36.406572 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377649-698a-4615-add6-fab5e13a6583 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:36.406883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377649-698a-4615-add6-fab5e13a6583 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:36.418041 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb377649-698a-4615-add6-fab5e13a6583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-cb377649-698a-4615-add6-fab5e13a6583 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:03:36.426237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:36.427294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:36.428315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:36.428315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:36.428315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:36.428315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:36.428315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:03:36.428315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:03:36.428315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:03:36.428315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:03:36.428315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:03:36.428315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:03:36.428315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:36.428315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:36.431044 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 580/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:03:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:36.435665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff61e41-9815-4e98-b8de-e01ffa9b7d7d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:36.544911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff61e41-9815-4e98-b8de-e01ffa9b7d7d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:36.582138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193d45a-b65c-4eed-8fe7-445ad1fd5864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:36.582836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193d45a-b65c-4eed-8fe7-445ad1fd5864 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:36.583127 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193d45a-b65c-4eed-8fe7-445ad1fd5864 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:36.583406 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193d45a-b65c-4eed-8fe7-445ad1fd5864 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:36.584164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193d45a-b65c-4eed-8fe7-445ad1fd5864 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:36.584478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193d45a-b65c-4eed-8fe7-445ad1fd5864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:36.585841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193d45a-b65c-4eed-8fe7-445ad1fd5864 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:36.594369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 577/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:03:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:36.600693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb377649-698a-4615-add6-fab5e13a6583 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:36.652720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:36.700438 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb377649-698a-4615-add6-fab5e13a6583 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:36.735556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ff22f-557d-43ce-ae26-cfeaea912b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:36.736422 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ff22f-557d-43ce-ae26-cfeaea912b9c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:36.736700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ff22f-557d-43ce-ae26-cfeaea912b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:36.736974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ff22f-557d-43ce-ae26-cfeaea912b9c None admin] PATH_INFO: `/v3/users/0116e7e55f974a429ea96ad747b54740` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:36.738206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ff22f-557d-43ce-ae26-cfeaea912b9c None admin] RBAC: Authorizing `identity:get_user(user_id=0116e7e55f974a429ea96ad747b54740)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:36.739663 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ff22f-557d-43ce-ae26-cfeaea912b9c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:36.741310 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 581/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:36 2022] GET /identity/v3/users/0116e7e55f974a429ea96ad747b54740 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:36.747698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193d45a-b65c-4eed-8fe7-445ad1fd5864 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:36.789652 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:36.857029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193d45a-b65c-4eed-8fe7-445ad1fd5864 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:36.893462 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ab6e8-49e2-4157-8516-5d1df0778f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:36.894107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ab6e8-49e2-4157-8516-5d1df0778f0e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:36.894385 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ab6e8-49e2-4157-8516-5d1df0778f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:36.894676 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ab6e8-49e2-4157-8516-5d1df0778f0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:36.965981 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ab6e8-49e2-4157-8516-5d1df0778f0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:36.967368 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ab6e8-49e2-4157-8516-5d1df0778f0e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:37.008376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:37.073809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 578/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:03:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:03:37.080067 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ff22f-557d-43ce-ae26-cfeaea912b9c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:37.188750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ff22f-557d-43ce-ae26-cfeaea912b9c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:37.209154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:37.223835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae31331-f9c6-45f0-9d8d-62de00c94167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:37.224638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae31331-f9c6-45f0-9d8d-62de00c94167 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:37.224945 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae31331-f9c6-45f0-9d8d-62de00c94167 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:37.225221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae31331-f9c6-45f0-9d8d-62de00c94167 None admin] PATH_INFO: `/v3/projects/e4d0767c939b4247ac9a118ca89d068e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:37.226454 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae31331-f9c6-45f0-9d8d-62de00c94167 None admin] RBAC: Authorizing `identity:get_project(project_id=e4d0767c939b4247ac9a118ca89d068e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:37.227923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae31331-f9c6-45f0-9d8d-62de00c94167 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:37.229647 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 582/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:03:37 2022] GET /identity/v3/projects/e4d0767c939b4247ac9a118ca89d068e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:37.236080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ab6e8-49e2-4157-8516-5d1df0778f0e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:37.338582 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ab6e8-49e2-4157-8516-5d1df0778f0e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:37.373170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c93bd-7561-411a-bb03-fdc6a88e8d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:37.373827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c93bd-7561-411a-bb03-fdc6a88e8d0b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:37.374111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c93bd-7561-411a-bb03-fdc6a88e8d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:37.374389 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c93bd-7561-411a-bb03-fdc6a88e8d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:37.375255 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c93bd-7561-411a-bb03-fdc6a88e8d0b None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=e4d0767c939b4247ac9a118ca89d068e, user.id=0116e7e55f974a429ea96ad747b54740) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:37.375567 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c93bd-7561-411a-bb03-fdc6a88e8d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:37.376999 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c93bd-7561-411a-bb03-fdc6a88e8d0b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:37.383076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 579/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:03:37 2022] GET /identity/v3/role_assignments?user.id=0116e7e55f974a429ea96ad747b54740&scope.project.id=e4d0767c939b4247ac9a118ca89d068e&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:39.421510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463d4a7-78a1-4d4b-9746-fb4473965c65 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:39.422104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463d4a7-78a1-4d4b-9746-fb4473965c65 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:39.422104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463d4a7-78a1-4d4b-9746-fb4473965c65 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:39.423502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 583/1162] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:39.428888 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a174-8953-4df4-a157-baf1b708810b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:39.429342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a174-8953-4df4-a157-baf1b708810b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:39.429444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a174-8953-4df4-a157-baf1b708810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:39.434924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:39.448732 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-51b6a174-8953-4df4-a157-baf1b708810b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:39.449924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-51b6a174-8953-4df4-a157-baf1b708810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:39.518796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 580/1163] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:39.541233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463d4a7-78a1-4d4b-9746-fb4473965c65 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:39.645141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463d4a7-78a1-4d4b-9746-fb4473965c65 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:39.680067 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2c454-ac9d-4c49-89b2-03052dcfa082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:39.680629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2c454-ac9d-4c49-89b2-03052dcfa082 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:39.680911 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2c454-ac9d-4c49-89b2-03052dcfa082 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:39.681174 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2c454-ac9d-4c49-89b2-03052dcfa082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:39.739985 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:39.752528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2c454-ac9d-4c49-89b2-03052dcfa082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:39.753993 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2c454-ac9d-4c49-89b2-03052dcfa082 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:39.854297 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 584/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:03:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:03:39.862409 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6a174-8953-4df4-a157-baf1b708810b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:39.965928 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6a174-8953-4df4-a157-baf1b708810b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:39.995134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:40.000473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61ca9c-894c-40cc-ae0d-8609bf7852ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:40.001288 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61ca9c-894c-40cc-ae0d-8609bf7852ab None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:40.001568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61ca9c-894c-40cc-ae0d-8609bf7852ab None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:40.001840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61ca9c-894c-40cc-ae0d-8609bf7852ab None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:40.008707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61ca9c-894c-40cc-ae0d-8609bf7852ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:40.010207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61ca9c-894c-40cc-ae0d-8609bf7852ab None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-2b61ca9c-894c-40cc-ae0d-8609bf7852ab None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:40.024302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:40.025512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:40.026742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 581/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jul 21 12:03:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:40.031792 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2c454-ac9d-4c49-89b2-03052dcfa082 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:40.119159 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:40.131491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2c454-ac9d-4c49-89b2-03052dcfa082 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:40.171475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee2a6f-095a-46cb-846f-26ca1f6b673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:40.172138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee2a6f-095a-46cb-846f-26ca1f6b673d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:40.172420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee2a6f-095a-46cb-846f-26ca1f6b673d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:40.172693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee2a6f-095a-46cb-846f-26ca1f6b673d None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:40.173406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee2a6f-095a-46cb-846f-26ca1f6b673d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:40.173712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee2a6f-095a-46cb-846f-26ca1f6b673d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:40.175113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee2a6f-095a-46cb-846f-26ca1f6b673d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:40.182626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 585/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jul 21 12:03:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:42.186688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c463c79-034a-4721-87b6-41c796013dbf None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:42.187253 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c463c79-034a-4721-87b6-41c796013dbf None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:42.187253 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c463c79-034a-4721-87b6-41c796013dbf None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:42.188660 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 582/1167] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:42.193991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deee698-b8e3-4c1d-aa98-e1417f429868 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:42.194436 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deee698-b8e3-4c1d-aa98-e1417f429868 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:42.194527 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deee698-b8e3-4c1d-aa98-e1417f429868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:42.213055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3deee698-b8e3-4c1d-aa98-e1417f429868 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:42.214246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3deee698-b8e3-4c1d-aa98-e1417f429868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:42.283775 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 586/1168] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:42.307305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c463c79-034a-4721-87b6-41c796013dbf None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:42.412237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c463c79-034a-4721-87b6-41c796013dbf None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:42.448597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441e749-2c2b-478b-9e9e-60c1f5028884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:42.449198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441e749-2c2b-478b-9e9e-60c1f5028884 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:42.449480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441e749-2c2b-478b-9e9e-60c1f5028884 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:42.449748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441e749-2c2b-478b-9e9e-60c1f5028884 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:42.450505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441e749-2c2b-478b-9e9e-60c1f5028884 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:42.451933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441e749-2c2b-478b-9e9e-60c1f5028884 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:42.468965 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 583/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Thu Jul 21 12:03:42 2022] POST /identity/v3/domains => generated 267 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:03:44.511828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3465-8fbb-44e9-8a31-cc8ff6252074 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:44.512433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3465-8fbb-44e9-8a31-cc8ff6252074 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:44.512433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3465-8fbb-44e9-8a31-cc8ff6252074 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:44.513776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 587/1170] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:44.519240 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dc784-fc65-4c47-b931-694c55ae8953 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:44.519692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dc784-fc65-4c47-b931-694c55ae8953 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:44.519788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dc784-fc65-4c47-b931-694c55ae8953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:44.536859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3d5dc784-fc65-4c47-b931-694c55ae8953 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:44.538044 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3d5dc784-fc65-4c47-b931-694c55ae8953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:44.585736 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:44.607255 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 584/1171] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:44.631738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c3465-8fbb-44e9-8a31-cc8ff6252074 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:44.720578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:44.753244 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c3465-8fbb-44e9-8a31-cc8ff6252074 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:44.789761 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6382bbf-1456-4316-9941-141605aa3d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:44.790625 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6382bbf-1456-4316-9941-141605aa3d99 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:44.790960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6382bbf-1456-4316-9941-141605aa3d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:44.791233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6382bbf-1456-4316-9941-141605aa3d99 None admin] PATH_INFO: `/v3/domains/330c0049e7f444f5bdd5b57b98ea8ba6` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:44.801779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6382bbf-1456-4316-9941-141605aa3d99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=330c0049e7f444f5bdd5b57b98ea8ba6)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:44.803268 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6382bbf-1456-4316-9941-141605aa3d99 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:44.804936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 588/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Jul 21 12:03:44 2022] GET /identity/v3/domains/330c0049e7f444f5bdd5b57b98ea8ba6 => generated 267 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:44.811264 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dc784-fc65-4c47-b931-694c55ae8953 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:44.911131 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dc784-fc65-4c47-b931-694c55ae8953 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:44.946637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f949f6-e308-4750-b310-7e73990f23d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:44.947372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f949f6-e308-4750-b310-7e73990f23d8 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:44.947651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f949f6-e308-4750-b310-7e73990f23d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:44.947933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f949f6-e308-4750-b310-7e73990f23d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:44.948651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f949f6-e308-4750-b310-7e73990f23d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:44.950090 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f949f6-e308-4750-b310-7e73990f23d8 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:44.976984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 585/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jul 21 12:03:44 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:03:47.008590 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b2bf6-f5bc-4344-adfa-76e3b39f46d9 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:47.009182 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b2bf6-f5bc-4344-adfa-76e3b39f46d9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:47.009182 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b2bf6-f5bc-4344-adfa-76e3b39f46d9 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:47.010531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 589/1174] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:47.015942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda61ced-dffa-4c9e-b8fb-ebfc1f58caf1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:47.016377 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda61ced-dffa-4c9e-b8fb-ebfc1f58caf1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:47.016474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda61ced-dffa-4c9e-b8fb-ebfc1f58caf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:47.034848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-bda61ced-dffa-4c9e-b8fb-ebfc1f58caf1 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:47.036048 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bda61ced-dffa-4c9e-b8fb-ebfc1f58caf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:47.064414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:47.109169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 586/1175] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:47.134246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b2bf6-f5bc-4344-adfa-76e3b39f46d9 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:47.243709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b2bf6-f5bc-4344-adfa-76e3b39f46d9 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:47.277826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be712c-0ad1-4307-bf08-5ed2e5166546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:47.278617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be712c-0ad1-4307-bf08-5ed2e5166546 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:47.278951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be712c-0ad1-4307-bf08-5ed2e5166546 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:47.279232 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be712c-0ad1-4307-bf08-5ed2e5166546 None admin] PATH_INFO: `/v3/domains/330c0049e7f444f5bdd5b57b98ea8ba6` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:47.280594 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be712c-0ad1-4307-bf08-5ed2e5166546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=330c0049e7f444f5bdd5b57b98ea8ba6)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:47.282046 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be712c-0ad1-4307-bf08-5ed2e5166546 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:47.283739 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 590/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Jul 21 12:03:47 2022] GET /identity/v3/domains/330c0049e7f444f5bdd5b57b98ea8ba6 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:47.289938 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda61ced-dffa-4c9e-b8fb-ebfc1f58caf1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:47.391148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda61ced-dffa-4c9e-b8fb-ebfc1f58caf1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:47.425195 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b5861-ddce-426a-80b9-ab8eb6a77e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:47.425875 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5861-ddce-426a-80b9-ab8eb6a77e02 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:47.426157 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5861-ddce-426a-80b9-ab8eb6a77e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:47.426431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5861-ddce-426a-80b9-ab8eb6a77e02 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:47.427168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b5861-ddce-426a-80b9-ab8eb6a77e02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:47.428596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b5861-ddce-426a-80b9-ab8eb6a77e02 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:47.451371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 587/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:03:47 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:03:49.498853 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03ca4-68b0-4aa8-ac2d-6c54cef75054 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:49.499437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03ca4-68b0-4aa8-ac2d-6c54cef75054 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:49.499437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03ca4-68b0-4aa8-ac2d-6c54cef75054 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:49.500749 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 591/1178] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:49.507178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372cebc-68be-4a84-96e5-beeb444d7986 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:49.507591 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372cebc-68be-4a84-96e5-beeb444d7986 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:49.507781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372cebc-68be-4a84-96e5-beeb444d7986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:49.526360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9372cebc-68be-4a84-96e5-beeb444d7986 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:49.527576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9372cebc-68be-4a84-96e5-beeb444d7986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:49.542832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:49.596467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 588/1179] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:49.619960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af03ca4-68b0-4aa8-ac2d-6c54cef75054 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:49.633560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:49.728529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af03ca4-68b0-4aa8-ac2d-6c54cef75054 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:49.764292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0290f-4bd0-4ceb-b13c-17c069d2f8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:49.765096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0290f-4bd0-4ceb-b13c-17c069d2f8db None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:49.765371 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0290f-4bd0-4ceb-b13c-17c069d2f8db None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:49.765648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0290f-4bd0-4ceb-b13c-17c069d2f8db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:49.777027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0290f-4bd0-4ceb-b13c-17c069d2f8db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-b9a0290f-4bd0-4ceb-b13c-17c069d2f8db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:03:49.784464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:49.785635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:49.786550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:49.786550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:49.786550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:49.786550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:49.786550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:03:49.786550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:03:49.786550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:03:49.786550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:03:49.786550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:03:49.786550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:03:49.786550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:49.786550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:49.786550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 592/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:03:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:49.792129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372cebc-68be-4a84-96e5-beeb444d7986 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:49.896161 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372cebc-68be-4a84-96e5-beeb444d7986 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:49.931476 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500751-7595-4394-b2ee-b18aaa4d0c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:49.932144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500751-7595-4394-b2ee-b18aaa4d0c3d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:49.932416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500751-7595-4394-b2ee-b18aaa4d0c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:49.932692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500751-7595-4394-b2ee-b18aaa4d0c3d None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:49.933442 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57500751-7595-4394-b2ee-b18aaa4d0c3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:49.933744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57500751-7595-4394-b2ee-b18aaa4d0c3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:49.935136 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57500751-7595-4394-b2ee-b18aaa4d0c3d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:49.943454 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 589/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:03:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:49.949952 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0290f-4bd0-4ceb-b13c-17c069d2f8db None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:50.020463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:50.053624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0290f-4bd0-4ceb-b13c-17c069d2f8db None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:50.089191 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34966391-1114-411b-a007-8e061b810da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:50.090067 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34966391-1114-411b-a007-8e061b810da7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:50.090346 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34966391-1114-411b-a007-8e061b810da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:50.090622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34966391-1114-411b-a007-8e061b810da7 None admin] PATH_INFO: `/v3/users/27c834e18c02440abaaf372ffa06d229` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:50.103574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34966391-1114-411b-a007-8e061b810da7 None admin] RBAC: Authorizing `identity:get_user(user_id=27c834e18c02440abaaf372ffa06d229)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:50.105019 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34966391-1114-411b-a007-8e061b810da7 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:50.106698 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 593/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:49 2022] GET /identity/v3/users/27c834e18c02440abaaf372ffa06d229 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:50.112989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500751-7595-4394-b2ee-b18aaa4d0c3d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:50.128780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:50.217710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500751-7595-4394-b2ee-b18aaa4d0c3d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:50.252219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052afd8-a03c-4e68-b573-ed60e6f981c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:50.252858 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052afd8-a03c-4e68-b573-ed60e6f981c3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:50.253134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052afd8-a03c-4e68-b573-ed60e6f981c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:50.253409 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052afd8-a03c-4e68-b573-ed60e6f981c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:50.321500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052afd8-a03c-4e68-b573-ed60e6f981c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:50.322971 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052afd8-a03c-4e68-b573-ed60e6f981c3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:50.336474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:50.425512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 590/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:03:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:03:50.431898 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34966391-1114-411b-a007-8e061b810da7 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:50.535356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34966391-1114-411b-a007-8e061b810da7 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:50.562811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:50.573224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca233aa-47e0-4c39-afdb-4419c77a1791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:50.574019 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca233aa-47e0-4c39-afdb-4419c77a1791 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:50.574292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca233aa-47e0-4c39-afdb-4419c77a1791 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:50.574560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca233aa-47e0-4c39-afdb-4419c77a1791 None admin] PATH_INFO: `/v3/projects/fdf66106f6c7471a956e5c8d249d5279` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:50.575915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca233aa-47e0-4c39-afdb-4419c77a1791 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf66106f6c7471a956e5c8d249d5279)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:50.577350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca233aa-47e0-4c39-afdb-4419c77a1791 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:50.579118 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 594/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:03:50 2022] GET /identity/v3/projects/fdf66106f6c7471a956e5c8d249d5279 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:50.585704 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052afd8-a03c-4e68-b573-ed60e6f981c3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:50.687475 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052afd8-a03c-4e68-b573-ed60e6f981c3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:50.700937 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:50.722744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d1119-b795-4bf6-8f3d-89299e55b22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:50.723397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d1119-b795-4bf6-8f3d-89299e55b22f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:50.723678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d1119-b795-4bf6-8f3d-89299e55b22f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:50.723952 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d1119-b795-4bf6-8f3d-89299e55b22f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:50.724785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d1119-b795-4bf6-8f3d-89299e55b22f None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=fdf66106f6c7471a956e5c8d249d5279, user.id=27c834e18c02440abaaf372ffa06d229) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:50.725097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d1119-b795-4bf6-8f3d-89299e55b22f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:50.726527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d1119-b795-4bf6-8f3d-89299e55b22f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:50.732141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 591/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:03:50 2022] GET /identity/v3/role_assignments?user.id=27c834e18c02440abaaf372ffa06d229&scope.project.id=fdf66106f6c7471a956e5c8d249d5279&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:52.698786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df2ee-81ad-4cfb-b2dc-013755a4e69f None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:52.699339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df2ee-81ad-4cfb-b2dc-013755a4e69f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:52.699339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df2ee-81ad-4cfb-b2dc-013755a4e69f None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:52.700702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 595/1186] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:52.706041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff1474-3cec-4c5c-b8d4-40748f93cec9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:52.706491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff1474-3cec-4c5c-b8d4-40748f93cec9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:52.706586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff1474-3cec-4c5c-b8d4-40748f93cec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:52.724415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b9ff1474-3cec-4c5c-b8d4-40748f93cec9 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:52.725544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b9ff1474-3cec-4c5c-b8d4-40748f93cec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:52.795845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 592/1187] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:52.819004 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df2ee-81ad-4cfb-b2dc-013755a4e69f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:52.934439 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df2ee-81ad-4cfb-b2dc-013755a4e69f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:52.969822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865f594-6ffc-4f5d-a7e0-6a2f5b696408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:52.970617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f594-6ffc-4f5d-a7e0-6a2f5b696408 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:52.970936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f594-6ffc-4f5d-a7e0-6a2f5b696408 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:52.971205 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f594-6ffc-4f5d-a7e0-6a2f5b696408 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:52.982076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865f594-6ffc-4f5d-a7e0-6a2f5b696408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-5865f594-6ffc-4f5d-a7e0-6a2f5b696408 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:03:52.989558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:52.990648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:52.991786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:52.991786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:52.991786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:52.991786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:52.991786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:03:52.991786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:03:52.991786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:03:52.991786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:03:52.991786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:03:52.991786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:03:52.991786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:52.991786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:03:52.991786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 596/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:03:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:52.997372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff1474-3cec-4c5c-b8d4-40748f93cec9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:53.099050 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff1474-3cec-4c5c-b8d4-40748f93cec9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:53.107105 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:53.135372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15831d-d2ed-42c1-9bb9-1a57a0e18c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:53.136047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15831d-d2ed-42c1-9bb9-1a57a0e18c86 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:53.136334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15831d-d2ed-42c1-9bb9-1a57a0e18c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:53.136607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15831d-d2ed-42c1-9bb9-1a57a0e18c86 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:53.137366 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15831d-d2ed-42c1-9bb9-1a57a0e18c86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:53.137679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15831d-d2ed-42c1-9bb9-1a57a0e18c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:53.139098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15831d-d2ed-42c1-9bb9-1a57a0e18c86 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:53.147932 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 593/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:03:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:53.154754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865f594-6ffc-4f5d-a7e0-6a2f5b696408 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:53.212557 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:53.258041 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865f594-6ffc-4f5d-a7e0-6a2f5b696408 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:53.293200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e01651-00bb-47b5-b517-4443276eb5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:53.294104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e01651-00bb-47b5-b517-4443276eb5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:53.294386 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e01651-00bb-47b5-b517-4443276eb5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:53.294693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e01651-00bb-47b5-b517-4443276eb5a0 None admin] PATH_INFO: `/v3/users/27c834e18c02440abaaf372ffa06d229` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:53.295983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e01651-00bb-47b5-b517-4443276eb5a0 None admin] RBAC: Authorizing `identity:get_user(user_id=27c834e18c02440abaaf372ffa06d229)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:53.297414 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e01651-00bb-47b5-b517-4443276eb5a0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:53.299098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 597/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:53 2022] GET /identity/v3/users/27c834e18c02440abaaf372ffa06d229 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:53.305302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15831d-d2ed-42c1-9bb9-1a57a0e18c86 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:53.409124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15831d-d2ed-42c1-9bb9-1a57a0e18c86 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:53.443722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa381f1e-de57-4795-9126-c9742c56322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:53.444596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa381f1e-de57-4795-9126-c9742c56322e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:53.445268 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa381f1e-de57-4795-9126-c9742c56322e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:53.445545 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa381f1e-de57-4795-9126-c9742c56322e None admin] PATH_INFO: `/v3/projects/fdf66106f6c7471a956e5c8d249d5279` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:53.446861 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa381f1e-de57-4795-9126-c9742c56322e None admin] RBAC: Authorizing `identity:get_project(project_id=fdf66106f6c7471a956e5c8d249d5279)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:53.448364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa381f1e-de57-4795-9126-c9742c56322e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:53.450048 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 594/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:03:53 2022] GET /identity/v3/projects/fdf66106f6c7471a956e5c8d249d5279 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:53.456272 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e01651-00bb-47b5-b517-4443276eb5a0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:53.559028 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e01651-00bb-47b5-b517-4443276eb5a0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:53.582412 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:53.594694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dbac0-d29c-4a57-8309-96e53c37cd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:53.595613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dbac0-d29c-4a57-8309-96e53c37cd81 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:53.595913 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dbac0-d29c-4a57-8309-96e53c37cd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:53.596191 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dbac0-d29c-4a57-8309-96e53c37cd81 None admin] PATH_INFO: `/v3/projects/fdf66106f6c7471a956e5c8d249d5279/users/27c834e18c02440abaaf372ffa06d229/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:53.598199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746dbac0-d29c-4a57-8309-96e53c37cd81 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdf66106f6c7471a956e5c8d249d5279, user_id=27c834e18c02440abaaf372ffa06d229, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:53.599660 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746dbac0-d29c-4a57-8309-96e53c37cd81 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:53.612540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 598/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:03:53 2022] PUT /identity/v3/projects/fdf66106f6c7471a956e5c8d249d5279/users/27c834e18c02440abaaf372ffa06d229/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:03:55.623980 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d1a60-a21d-493f-a2c3-f41fd37bd7c3 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:55.624570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d1a60-a21d-493f-a2c3-f41fd37bd7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:55.624570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d1a60-a21d-493f-a2c3-f41fd37bd7c3 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:55.625906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 595/1193] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:03:55.631812 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03e759-c873-445c-9c71-0e83986255c7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:55.632257 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03e759-c873-445c-9c71-0e83986255c7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:55.632357 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03e759-c873-445c-9c71-0e83986255c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:55.650824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8f03e759-c873-445c-9c71-0e83986255c7 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:03:55.652025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8f03e759-c873-445c-9c71-0e83986255c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:03:55.727470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 599/1194] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:03:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:03:55.750908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d1a60-a21d-493f-a2c3-f41fd37bd7c3 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:55.791013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:55.860956 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d1a60-a21d-493f-a2c3-f41fd37bd7c3 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:55.898331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333a254-94d7-4caa-aedb-faa70061921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:55.899186 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333a254-94d7-4caa-aedb-faa70061921e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:55.899463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333a254-94d7-4caa-aedb-faa70061921e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:55.899815 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333a254-94d7-4caa-aedb-faa70061921e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:55.912028 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333a254-94d7-4caa-aedb-faa70061921e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-4333a254-94d7-4caa-aedb-faa70061921e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:03:55.919733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:03:55.920867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:03:55.922029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:03:55.922029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:03:55.922029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:03:55.922029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:03:55.922029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:03:55.922029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:03:55.922029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:03:55.922029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:03:55.922029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:03:55.922029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:03:55.922029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:03:55.922029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:03:55.922029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 596/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:03:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:03:55.927424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03e759-c873-445c-9c71-0e83986255c7 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:56.031609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03e759-c873-445c-9c71-0e83986255c7 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:56.046174 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:56.066368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8d98f-2e1f-4ccf-a030-ea5d65ecb4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:56.067082 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8d98f-2e1f-4ccf-a030-ea5d65ecb4bd None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:56.067358 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8d98f-2e1f-4ccf-a030-ea5d65ecb4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:56.067634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8d98f-2e1f-4ccf-a030-ea5d65ecb4bd None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:56.068383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8d98f-2e1f-4ccf-a030-ea5d65ecb4bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:56.068693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8d98f-2e1f-4ccf-a030-ea5d65ecb4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:56.070449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8d98f-2e1f-4ccf-a030-ea5d65ecb4bd None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:56.078843 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 600/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:03:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:56.084960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333a254-94d7-4caa-aedb-faa70061921e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:56.182526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:56.189178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333a254-94d7-4caa-aedb-faa70061921e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:56.223845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3fc40-8018-40f2-aefb-f97257648cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:56.224725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3fc40-8018-40f2-aefb-f97257648cfc None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:56.224994 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3fc40-8018-40f2-aefb-f97257648cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:56.225279 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3fc40-8018-40f2-aefb-f97257648cfc None admin] PATH_INFO: `/v3/users/27c834e18c02440abaaf372ffa06d229` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:56.226537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3fc40-8018-40f2-aefb-f97257648cfc None admin] RBAC: Authorizing `identity:get_user(user_id=27c834e18c02440abaaf372ffa06d229)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:56.228099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3fc40-8018-40f2-aefb-f97257648cfc None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:56.229718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 597/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jul 21 12:03:56 2022] GET /identity/v3/users/27c834e18c02440abaaf372ffa06d229 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:03:56.235910 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8d98f-2e1f-4ccf-a030-ea5d65ecb4bd None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:56.343903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8d98f-2e1f-4ccf-a030-ea5d65ecb4bd None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:56.380228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf8adf-2c47-46e8-b489-26f3133b3f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:56.380892 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf8adf-2c47-46e8-b489-26f3133b3f30 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:56.381171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf8adf-2c47-46e8-b489-26f3133b3f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:56.381440 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf8adf-2c47-46e8-b489-26f3133b3f30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:56.429807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:56.456454 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf8adf-2c47-46e8-b489-26f3133b3f30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:56.457935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf8adf-2c47-46e8-b489-26f3133b3f30 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:56.557460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 601/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:03:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:03:56.563892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3fc40-8018-40f2-aefb-f97257648cfc None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:56.676252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3fc40-8018-40f2-aefb-f97257648cfc None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:56.712270 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8a8e4-4001-46c3-bb62-5406864aa5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:56.713167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8a8e4-4001-46c3-bb62-5406864aa5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:56.713452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8a8e4-4001-46c3-bb62-5406864aa5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:56.713729 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8a8e4-4001-46c3-bb62-5406864aa5f5 None admin] PATH_INFO: `/v3/projects/fdf66106f6c7471a956e5c8d249d5279` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:56.715000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8a8e4-4001-46c3-bb62-5406864aa5f5 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf66106f6c7471a956e5c8d249d5279)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:56.716443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8a8e4-4001-46c3-bb62-5406864aa5f5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:56.718158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 598/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jul 21 12:03:56 2022] GET /identity/v3/projects/fdf66106f6c7471a956e5c8d249d5279 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:03:56.724695 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf8adf-2c47-46e8-b489-26f3133b3f30 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:03:56.803964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:03:56.830027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf8adf-2c47-46e8-b489-26f3133b3f30 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:03:56.865346 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e94667-8e5d-4dff-b6f0-153bd6aafdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:03:56.866001 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e94667-8e5d-4dff-b6f0-153bd6aafdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:03:56.866284 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e94667-8e5d-4dff-b6f0-153bd6aafdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:03:56.866562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e94667-8e5d-4dff-b6f0-153bd6aafdb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:03:56.867434 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e94667-8e5d-4dff-b6f0-153bd6aafdb1 None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=fdf66106f6c7471a956e5c8d249d5279, user.id=27c834e18c02440abaaf372ffa06d229) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:03:56.867748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e94667-8e5d-4dff-b6f0-153bd6aafdb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:03:56.869224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e94667-8e5d-4dff-b6f0-153bd6aafdb1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:03:56.875340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 602/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:03:56 2022] GET /identity/v3/role_assignments?user.id=27c834e18c02440abaaf372ffa06d229&scope.project.id=fdf66106f6c7471a956e5c8d249d5279&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:04:06.707655 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=84 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:04:06.873161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=30 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:04:55.059140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aefaf7-e689-40ec-a96e-6b53c31fb148 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:04:55.059140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aefaf7-e689-40ec-a96e-6b53c31fb148 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:04:55.059140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aefaf7-e689-40ec-a96e-6b53c31fb148 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:04:55.059140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 599/1201] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:04:55.069061 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ec020-d2be-4b14-8b06-e517b94ceb29 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:04:55.069729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ec020-d2be-4b14-8b06-e517b94ceb29 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:04:55.070152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ec020-d2be-4b14-8b06-e517b94ceb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:04:55.104217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-409ec020-d2be-4b14-8b06-e517b94ceb29 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:04:55.106369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-409ec020-d2be-4b14-8b06-e517b94ceb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:04:55.231257 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 603/1202] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:04:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:04:55.260591 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aefaf7-e689-40ec-a96e-6b53c31fb148 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:04:55.472939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aefaf7-e689-40ec-a96e-6b53c31fb148 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:04:55.550194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22146fe-8f37-4cac-a307-9f279ab6af02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:04:55.551849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22146fe-8f37-4cac-a307-9f279ab6af02 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:04:55.552211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22146fe-8f37-4cac-a307-9f279ab6af02 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:04:55.552505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22146fe-8f37-4cac-a307-9f279ab6af02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:04:55.581465 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22146fe-8f37-4cac-a307-9f279ab6af02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:04:55.583575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22146fe-8f37-4cac-a307-9f279ab6af02 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-d22146fe-8f37-4cac-a307-9f279ab6af02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:04:55.610710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:04:55.623108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:04:55.624903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:04:55.624903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:04:55.624903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:04:55.624903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:04:55.624903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 600/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:04:55.625666 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ec020-d2be-4b14-8b06-e517b94ceb29 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:04:55.837676 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ec020-d2be-4b14-8b06-e517b94ceb29 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:04:55.875341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:04:55.883204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1b4aa-7c15-495f-bcef-1418236cf448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:04:55.887716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1b4aa-7c15-495f-bcef-1418236cf448 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:04:55.887716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1b4aa-7c15-495f-bcef-1418236cf448 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:04:55.887716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1b4aa-7c15-495f-bcef-1418236cf448 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:04:55.887716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1b4aa-7c15-495f-bcef-1418236cf448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:04:55.887716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1b4aa-7c15-495f-bcef-1418236cf448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:04:55.887716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1b4aa-7c15-495f-bcef-1418236cf448 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:04:55.906969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 604/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:04:55.908809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22146fe-8f37-4cac-a307-9f279ab6af02 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:04:55.997322 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:04:56.095216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22146fe-8f37-4cac-a307-9f279ab6af02 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:04:56.142568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4180c-9456-4d7b-a1e1-cd456e19f300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:04:56.142568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4180c-9456-4d7b-a1e1-cd456e19f300 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:04:56.142568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4180c-9456-4d7b-a1e1-cd456e19f300 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:04:56.142568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4180c-9456-4d7b-a1e1-cd456e19f300 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:04:56.143307 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4180c-9456-4d7b-a1e1-cd456e19f300 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:04:56.143307 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4180c-9456-4d7b-a1e1-cd456e19f300 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:04:56.173914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 601/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jul 21 12:04:55 2022] POST /identity/v3/users => generated 251 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:04:58.427397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c7723-a1f2-4502-8cea-5fbf72af423e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:04:58.428211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c7723-a1f2-4502-8cea-5fbf72af423e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:04:58.428211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c7723-a1f2-4502-8cea-5fbf72af423e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:04:58.429449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 605/1206] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:04:58.436021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ba8f2-a590-4935-946a-375a96f5c38f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:04:58.436573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ba8f2-a590-4935-946a-375a96f5c38f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:04:58.437140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ba8f2-a590-4935-946a-375a96f5c38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:04:58.467911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3e1ba8f2-a590-4935-946a-375a96f5c38f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:04:58.470813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3e1ba8f2-a590-4935-946a-375a96f5c38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:04:58.600656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 602/1207] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:04:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:04:58.632046 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c7723-a1f2-4502-8cea-5fbf72af423e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:04:58.796147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c7723-a1f2-4502-8cea-5fbf72af423e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:04:58.855028 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b80e7c-7935-4643-b061-6e4b60ae8c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:04:58.856483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b80e7c-7935-4643-b061-6e4b60ae8c15 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:04:58.856815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b80e7c-7935-4643-b061-6e4b60ae8c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:04:58.857114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b80e7c-7935-4643-b061-6e4b60ae8c15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:04:58.872791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b80e7c-7935-4643-b061-6e4b60ae8c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-13b80e7c-7935-4643-b061-6e4b60ae8c15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:04:58.885491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:04:58.887200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:04:58.890336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:04:58.890336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:04:58.890336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:04:58.890336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:04:58.890336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:04:58.890336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:04:58.890336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:04:58.890336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:04:58.890336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:04:58.890336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:04:58.890336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:04:58.890336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:04:58.890336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 606/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:04:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:04:58.898080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ba8f2-a590-4935-946a-375a96f5c38f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:04:58.962985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:04:59.039194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ba8f2-a590-4935-946a-375a96f5c38f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:04:59.092834 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de00406-1d87-40fc-9b90-fc87dddb0aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:04:59.092834 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de00406-1d87-40fc-9b90-fc87dddb0aab None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:04:59.092834 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de00406-1d87-40fc-9b90-fc87dddb0aab None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:04:59.092834 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de00406-1d87-40fc-9b90-fc87dddb0aab None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:04:59.096251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de00406-1d87-40fc-9b90-fc87dddb0aab None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:04:59.096251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de00406-1d87-40fc-9b90-fc87dddb0aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:04:59.096556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de00406-1d87-40fc-9b90-fc87dddb0aab None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:04:59.107795 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 603/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:04:59.116147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b80e7c-7935-4643-b061-6e4b60ae8c15 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:04:59.191616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:04:59.264273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b80e7c-7935-4643-b061-6e4b60ae8c15 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:04:59.328129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bced7a0-308b-48eb-b1cd-f898672af7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:04:59.329016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bced7a0-308b-48eb-b1cd-f898672af7ff None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:04:59.329301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bced7a0-308b-48eb-b1cd-f898672af7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:04:59.329609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bced7a0-308b-48eb-b1cd-f898672af7ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:04:59.353132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bced7a0-308b-48eb-b1cd-f898672af7ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:04:59.356195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bced7a0-308b-48eb-b1cd-f898672af7ff None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-2bced7a0-308b-48eb-b1cd-f898672af7ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:04:59.378294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:04:59.380154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:04:59.381950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:04:59.381950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:04:59.381950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:04:59.381950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:04:59.381950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 607/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:04:59.392010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de00406-1d87-40fc-9b90-fc87dddb0aab None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:04:59.559235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:04:59.563710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de00406-1d87-40fc-9b90-fc87dddb0aab None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:04:59.616659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073aba9-b368-4205-bf65-8e17c90ccd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:04:59.617373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073aba9-b368-4205-bf65-8e17c90ccd89 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:04:59.617654 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073aba9-b368-4205-bf65-8e17c90ccd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:04:59.617921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073aba9-b368-4205-bf65-8e17c90ccd89 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:04:59.618749 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073aba9-b368-4205-bf65-8e17c90ccd89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:04:59.619049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073aba9-b368-4205-bf65-8e17c90ccd89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:04:59.620527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073aba9-b368-4205-bf65-8e17c90ccd89 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:04:59.635765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 604/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:04:59.644187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bced7a0-308b-48eb-b1cd-f898672af7ff None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:04:59.840444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bced7a0-308b-48eb-b1cd-f898672af7ff None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:04:59.843193 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:04:59.888990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae06c4-ff82-47e1-b981-1356683d5797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:04:59.889875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae06c4-ff82-47e1-b981-1356683d5797 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:04:59.890160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae06c4-ff82-47e1-b981-1356683d5797 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:04:59.890429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae06c4-ff82-47e1-b981-1356683d5797 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:04:59.902959 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae06c4-ff82-47e1-b981-1356683d5797 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:04:59.903224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae06c4-ff82-47e1-b981-1356683d5797 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c1ae06c4-ff82-47e1-b981-1356683d5797 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:04:59.923876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:04:59.925694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:04:59.927811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:04:59.927811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:04:59.927811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:04:59.927811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:04:59.927811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:04:59.927811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:04:59.927811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:04:59.927811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:04:59.927811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 12:04:59.927811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:04:59.930914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 608/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:04:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:04:59.933910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073aba9-b368-4205-bf65-8e17c90ccd89 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:00.129336 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073aba9-b368-4205-bf65-8e17c90ccd89 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:00.180508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431525a-23d4-4142-b581-6a42e8898b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:00.181606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431525a-23d4-4142-b581-6a42e8898b1e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:00.182100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431525a-23d4-4142-b581-6a42e8898b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:00.182500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431525a-23d4-4142-b581-6a42e8898b1e None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:00.183462 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431525a-23d4-4142-b581-6a42e8898b1e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:00.183781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431525a-23d4-4142-b581-6a42e8898b1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:00.185583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431525a-23d4-4142-b581-6a42e8898b1e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:00.211917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 605/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jul 21 12:04:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:00.219409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae06c4-ff82-47e1-b981-1356683d5797 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:00.370214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae06c4-ff82-47e1-b981-1356683d5797 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:00.419551 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bb9ee-1ec5-43c6-ac15-641af95f23d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:00.420240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bb9ee-1ec5-43c6-ac15-641af95f23d9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:00.420517 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bb9ee-1ec5-43c6-ac15-641af95f23d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:00.420793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bb9ee-1ec5-43c6-ac15-641af95f23d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:00.455839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:00.525793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0bb9ee-1ec5-43c6-ac15-641af95f23d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:00.528922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0bb9ee-1ec5-43c6-ac15-641af95f23d9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:00.746170 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 609/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:05:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:05:00.754481 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431525a-23d4-4142-b581-6a42e8898b1e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:00.782939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:00.908646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431525a-23d4-4142-b581-6a42e8898b1e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:00.957896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095c624-d0fc-422f-9bf9-e43a63259a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:00.958844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c624-d0fc-422f-9bf9-e43a63259a4e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:00.959169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c624-d0fc-422f-9bf9-e43a63259a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:00.959464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c624-d0fc-422f-9bf9-e43a63259a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:00.976373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095c624-d0fc-422f-9bf9-e43a63259a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:00.977961 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095c624-d0fc-422f-9bf9-e43a63259a4e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-9095c624-d0fc-422f-9bf9-e43a63259a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:05:01.001258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:01.002447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:01.004009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:05:01.004009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:05:01.004009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:01.004009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:01.004009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 606/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:01.009103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bb9ee-1ec5-43c6-ac15-641af95f23d9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:01.126378 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:01.179864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bb9ee-1ec5-43c6-ac15-641af95f23d9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:01.231147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb344ad-75d8-49c2-b4bb-90a9d6c3457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:01.232988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb344ad-75d8-49c2-b4bb-90a9d6c3457f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:01.233527 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb344ad-75d8-49c2-b4bb-90a9d6c3457f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:01.234037 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb344ad-75d8-49c2-b4bb-90a9d6c3457f None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:01.235880 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb344ad-75d8-49c2-b4bb-90a9d6c3457f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:01.236367 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb344ad-75d8-49c2-b4bb-90a9d6c3457f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:01.238441 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb344ad-75d8-49c2-b4bb-90a9d6c3457f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:01.256498 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 610/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:01.261954 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095c624-d0fc-422f-9bf9-e43a63259a4e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:01.371627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:01.433761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095c624-d0fc-422f-9bf9-e43a63259a4e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:01.494287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5af3c4-4822-4737-8667-8da973068370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:01.495240 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5af3c4-4822-4737-8667-8da973068370 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:01.495504 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5af3c4-4822-4737-8667-8da973068370 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:01.495802 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5af3c4-4822-4737-8667-8da973068370 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:01.503880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5af3c4-4822-4737-8667-8da973068370 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:01.505397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5af3c4-4822-4737-8667-8da973068370 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-6f5af3c4-4822-4737-8667-8da973068370 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:05:01.521006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:01.523258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:01.524818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:05:01.524818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:05:01.524818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:05:01.524818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:05:01.524818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:05:01.524818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:05:01.524818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:05:01.524818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:01.527600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 607/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:05:01.528940 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb344ad-75d8-49c2-b4bb-90a9d6c3457f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:01.706987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb344ad-75d8-49c2-b4bb-90a9d6c3457f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:01.757926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:01.772575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519d97c-591b-488e-be65-fb798a735595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:01.773492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519d97c-591b-488e-be65-fb798a735595 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:01.773940 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519d97c-591b-488e-be65-fb798a735595 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:01.774289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519d97c-591b-488e-be65-fb798a735595 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:01.775173 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519d97c-591b-488e-be65-fb798a735595 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:01.775519 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519d97c-591b-488e-be65-fb798a735595 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:01.776997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519d97c-591b-488e-be65-fb798a735595 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:01.791747 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 611/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:01.797816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5af3c4-4822-4737-8667-8da973068370 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:01.940460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5af3c4-4822-4737-8667-8da973068370 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:01.982888 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:01.995346 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec8e0b-c2d1-4737-a749-ae2ff0f55e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:01.996554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec8e0b-c2d1-4737-a749-ae2ff0f55e92 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:01.996746 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec8e0b-c2d1-4737-a749-ae2ff0f55e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:01.997097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec8e0b-c2d1-4737-a749-ae2ff0f55e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:01.998262 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec8e0b-c2d1-4737-a749-ae2ff0f55e92 None admin] RBAC: Adding query filter params (role.id=8fc2e732d1b54ac193720d2652101798, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=06c172bcd99f469f83728c98d061a7c6) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:01.998698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec8e0b-c2d1-4737-a749-ae2ff0f55e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:02.000816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec8e0b-c2d1-4737-a749-ae2ff0f55e92 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:02.011520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 608/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:05:01 2022] GET /identity/v3/role_assignments?user.id=06c172bcd99f469f83728c98d061a7c6&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=8fc2e732d1b54ac193720d2652101798 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:04.135916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263c39b-8e23-4caa-b8f2-fe93c1dde77e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:04.136812 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263c39b-8e23-4caa-b8f2-fe93c1dde77e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:04.136812 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263c39b-8e23-4caa-b8f2-fe93c1dde77e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:04.137921 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 612/1220] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:05:04.145275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c01a5-b86d-4dcc-bbd2-1ce6edf923c9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:04.145912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c01a5-b86d-4dcc-bbd2-1ce6edf923c9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:04.146004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c01a5-b86d-4dcc-bbd2-1ce6edf923c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:04.172593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-107c01a5-b86d-4dcc-bbd2-1ce6edf923c9 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:05:04.173813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-107c01a5-b86d-4dcc-bbd2-1ce6edf923c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:05:04.264705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 609/1221] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:05:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:05:04.294406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263c39b-8e23-4caa-b8f2-fe93c1dde77e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:04.426563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263c39b-8e23-4caa-b8f2-fe93c1dde77e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:04.469704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec1a52-24f9-4926-93d1-577b31931125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:04.470594 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec1a52-24f9-4926-93d1-577b31931125 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:04.470926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec1a52-24f9-4926-93d1-577b31931125 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:04.471228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec1a52-24f9-4926-93d1-577b31931125 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:04.482534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec1a52-24f9-4926-93d1-577b31931125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-7bec1a52-24f9-4926-93d1-577b31931125 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:05:04.490350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:04.491883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:04.493154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:04.493154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:04.493154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:04.493154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:04.493154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:05:04.493154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:05:04.493154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:05:04.493154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:05:04.493154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:05:04.493154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:05:04.493154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:05:04.493154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:04.493154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 613/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:05:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:04.498139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c01a5-b86d-4dcc-bbd2-1ce6edf923c9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:04.644286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c01a5-b86d-4dcc-bbd2-1ce6edf923c9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:04.680943 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:04.697690 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7e154-82ae-4cb0-8e9c-3f50ef704756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:04.698681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7e154-82ae-4cb0-8e9c-3f50ef704756 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:04.699089 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7e154-82ae-4cb0-8e9c-3f50ef704756 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:04.699573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7e154-82ae-4cb0-8e9c-3f50ef704756 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:04.700777 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7e154-82ae-4cb0-8e9c-3f50ef704756 None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:04.701152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7e154-82ae-4cb0-8e9c-3f50ef704756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:04.703483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7e154-82ae-4cb0-8e9c-3f50ef704756 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:04.722693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 610/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:05:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:04.729974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec1a52-24f9-4926-93d1-577b31931125 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:04.793314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:04.882275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec1a52-24f9-4926-93d1-577b31931125 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:04.932761 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac09c40-fb4d-4591-8906-1095bf779395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:04.933524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac09c40-fb4d-4591-8906-1095bf779395 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:04.933790 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac09c40-fb4d-4591-8906-1095bf779395 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:04.934106 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac09c40-fb4d-4591-8906-1095bf779395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:04.946965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac09c40-fb4d-4591-8906-1095bf779395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:04.948473 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac09c40-fb4d-4591-8906-1095bf779395 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-8ac09c40-fb4d-4591-8906-1095bf779395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:05:04.968569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:04.970548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:04.972380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:05:04.972380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:05:04.972380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:04.972380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:04.972380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 614/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:04.981287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7e154-82ae-4cb0-8e9c-3f50ef704756 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:05.120821 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7e154-82ae-4cb0-8e9c-3f50ef704756 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:05.167821 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc44c6-6dbb-4560-9321-d7df008eac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:05.168530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc44c6-6dbb-4560-9321-d7df008eac6d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:05.168770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc44c6-6dbb-4560-9321-d7df008eac6d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:05.169046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc44c6-6dbb-4560-9321-d7df008eac6d None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:05.169791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc44c6-6dbb-4560-9321-d7df008eac6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:05.170096 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc44c6-6dbb-4560-9321-d7df008eac6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:05.171520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc44c6-6dbb-4560-9321-d7df008eac6d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:05.184824 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 611/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:05.190972 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac09c40-fb4d-4591-8906-1095bf779395 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:05.306198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:05.315232 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac09c40-fb4d-4591-8906-1095bf779395 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:05.363675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3d72e-a3c1-4c01-8a73-ebaff02159b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:05.364870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3d72e-a3c1-4c01-8a73-ebaff02159b1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:05.365338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3d72e-a3c1-4c01-8a73-ebaff02159b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:05.365781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3d72e-a3c1-4c01-8a73-ebaff02159b1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:05.377882 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3d72e-a3c1-4c01-8a73-ebaff02159b1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:05.380078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3d72e-a3c1-4c01-8a73-ebaff02159b1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-b8b3d72e-a3c1-4c01-8a73-ebaff02159b1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:05:05.397110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:05.398467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:05.399941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:05.399941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:05.399941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:05:05.399941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:05:05.399941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:05:05.399941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:05:05.399941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:05:05.399941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:05:05.399941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 12:05:05.399941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:05.399941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 615/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:05.406794 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc44c6-6dbb-4560-9321-d7df008eac6d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:05.473770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:05.550365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc44c6-6dbb-4560-9321-d7df008eac6d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:05.594918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838c341-14a9-404a-96f9-461c89819954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:05.595621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c341-14a9-404a-96f9-461c89819954 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:05.595903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c341-14a9-404a-96f9-461c89819954 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:05.596180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c341-14a9-404a-96f9-461c89819954 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:05.597046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838c341-14a9-404a-96f9-461c89819954 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:05.597360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838c341-14a9-404a-96f9-461c89819954 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:05.598842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838c341-14a9-404a-96f9-461c89819954 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:05.640089 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 612/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jul 21 12:05:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:05.642242 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3d72e-a3c1-4c01-8a73-ebaff02159b1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:05.784697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3d72e-a3c1-4c01-8a73-ebaff02159b1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:05.834006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f0b7a-69fe-4dc3-9681-8387adaf7420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:05.835186 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f0b7a-69fe-4dc3-9681-8387adaf7420 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:05.835678 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f0b7a-69fe-4dc3-9681-8387adaf7420 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:05.836002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f0b7a-69fe-4dc3-9681-8387adaf7420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:05.849666 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f0b7a-69fe-4dc3-9681-8387adaf7420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:05.851223 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f0b7a-69fe-4dc3-9681-8387adaf7420 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f83f0b7a-69fe-4dc3-9681-8387adaf7420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:05:05.870530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:05.871694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:05.872642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:05:05.872642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:05:05.872642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:05.872642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:05.872642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 616/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:05.879661 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838c341-14a9-404a-96f9-461c89819954 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:06.054227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838c341-14a9-404a-96f9-461c89819954 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:06.059682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:06.128265 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a56dd-ced6-40d4-8b5b-bdfd0eb8cfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:06.128950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a56dd-ced6-40d4-8b5b-bdfd0eb8cfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:06.129268 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a56dd-ced6-40d4-8b5b-bdfd0eb8cfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:06.129545 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a56dd-ced6-40d4-8b5b-bdfd0eb8cfd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:06.130358 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a56dd-ced6-40d4-8b5b-bdfd0eb8cfd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:06.130667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a56dd-ced6-40d4-8b5b-bdfd0eb8cfd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:06.132230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a56dd-ced6-40d4-8b5b-bdfd0eb8cfd9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:06.146233 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 613/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:06.152667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f0b7a-69fe-4dc3-9681-8387adaf7420 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:06.164299 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:06.284090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f0b7a-69fe-4dc3-9681-8387adaf7420 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:06.326618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca5832-d4ef-4056-b914-abab68dcea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:06.327443 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca5832-d4ef-4056-b914-abab68dcea29 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:06.327725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca5832-d4ef-4056-b914-abab68dcea29 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:06.328116 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca5832-d4ef-4056-b914-abab68dcea29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:06.335883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca5832-d4ef-4056-b914-abab68dcea29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:06.337689 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca5832-d4ef-4056-b914-abab68dcea29 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f9ca5832-d4ef-4056-b914-abab68dcea29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:05:06.356715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:06.358177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:06.359141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:05:06.359141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:05:06.359141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:05:06.359141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:05:06.359141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:05:06.359141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:05:06.359141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:05:06.359141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:06.359141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 617/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:06.364825 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a56dd-ced6-40d4-8b5b-bdfd0eb8cfd9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:06.502032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a56dd-ced6-40d4-8b5b-bdfd0eb8cfd9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:06.543848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268b0a9-35ec-4e9f-8d21-03ad806b57e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:06.544665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268b0a9-35ec-4e9f-8d21-03ad806b57e2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:06.544982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268b0a9-35ec-4e9f-8d21-03ad806b57e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:06.545219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268b0a9-35ec-4e9f-8d21-03ad806b57e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:06.546053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268b0a9-35ec-4e9f-8d21-03ad806b57e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:06.546359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268b0a9-35ec-4e9f-8d21-03ad806b57e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:06.547900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268b0a9-35ec-4e9f-8d21-03ad806b57e2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:06.563557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 614/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:06.570637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca5832-d4ef-4056-b914-abab68dcea29 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:06.657444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:06.703735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca5832-d4ef-4056-b914-abab68dcea29 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:06.759694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a69441-3832-43b1-9101-87cdda4291f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:06.761655 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a69441-3832-43b1-9101-87cdda4291f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:06.762144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a69441-3832-43b1-9101-87cdda4291f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:06.762613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a69441-3832-43b1-9101-87cdda4291f1 None admin] PATH_INFO: `/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/06c172bcd99f469f83728c98d061a7c6/roles/8fc2e732d1b54ac193720d2652101798` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:06.788011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a69441-3832-43b1-9101-87cdda4291f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0946df6ba381401e8e4958d11c63cb2b, user_id=06c172bcd99f469f83728c98d061a7c6, role_id=8fc2e732d1b54ac193720d2652101798)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:06.789480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a69441-3832-43b1-9101-87cdda4291f1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:06.806384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 618/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:05:06 2022] PUT /identity/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/06c172bcd99f469f83728c98d061a7c6/roles/8fc2e732d1b54ac193720d2652101798 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:05:09.009978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec198315-5687-48bc-b374-82b11f45f33c None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:09.010573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec198315-5687-48bc-b374-82b11f45f33c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:09.010573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec198315-5687-48bc-b374-82b11f45f33c None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:09.012184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 615/1233] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:05:09.021209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803b0d5-71d2-4cdc-95b8-3a967da67a5a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:09.022149 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803b0d5-71d2-4cdc-95b8-3a967da67a5a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:09.024496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803b0d5-71d2-4cdc-95b8-3a967da67a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:09.046717 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a803b0d5-71d2-4cdc-95b8-3a967da67a5a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:05:09.048115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a803b0d5-71d2-4cdc-95b8-3a967da67a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:05:09.157496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 619/1234] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:05:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:05:09.184711 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec198315-5687-48bc-b374-82b11f45f33c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:09.215194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:09.332137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec198315-5687-48bc-b374-82b11f45f33c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:09.371263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bea8a1-d688-4fe6-a6aa-d74d160b44a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:09.372090 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bea8a1-d688-4fe6-a6aa-d74d160b44a3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:09.372375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bea8a1-d688-4fe6-a6aa-d74d160b44a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:09.372663 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bea8a1-d688-4fe6-a6aa-d74d160b44a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:09.384745 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bea8a1-d688-4fe6-a6aa-d74d160b44a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-09bea8a1-d688-4fe6-a6aa-d74d160b44a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:05:09.393615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:09.395156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:09.396328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:09.396328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:09.396328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:09.396328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:09.396328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:05:09.396328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:05:09.396328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:05:09.396328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:05:09.396328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:05:09.396328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:05:09.396328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 12:05:09.396328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:09.396328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 616/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jul 21 12:05:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:09.403338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803b0d5-71d2-4cdc-95b8-3a967da67a5a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:09.465643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:09.529363 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803b0d5-71d2-4cdc-95b8-3a967da67a5a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:09.565959 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cfcfb-f376-40b2-b930-f443efb79381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:09.567027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cfcfb-f376-40b2-b930-f443efb79381 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:09.567313 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cfcfb-f376-40b2-b930-f443efb79381 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:09.567589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cfcfb-f376-40b2-b930-f443efb79381 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:09.568359 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11cfcfb-f376-40b2-b930-f443efb79381 None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:09.568667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11cfcfb-f376-40b2-b930-f443efb79381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:09.570099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11cfcfb-f376-40b2-b930-f443efb79381 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:09.580590 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 620/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jul 21 12:05:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:09.588292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bea8a1-d688-4fe6-a6aa-d74d160b44a3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:09.702223 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:09.724706 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bea8a1-d688-4fe6-a6aa-d74d160b44a3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:09.781718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a31a1-4a5a-42bc-833e-151e2f03b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:09.782632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a31a1-4a5a-42bc-833e-151e2f03b8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:09.782962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a31a1-4a5a-42bc-833e-151e2f03b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:09.783301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a31a1-4a5a-42bc-833e-151e2f03b8a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:09.796579 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a31a1-4a5a-42bc-833e-151e2f03b8a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:09.798322 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a31a1-4a5a-42bc-833e-151e2f03b8a2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-b11a31a1-4a5a-42bc-833e-151e2f03b8a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:05:09.819173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:09.821167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:09.823198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:05:09.823198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:05:09.823198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:09.823198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:09.825489 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 617/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:09.826500 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cfcfb-f376-40b2-b930-f443efb79381 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:09.940779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cfcfb-f376-40b2-b930-f443efb79381 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:09.953424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:09.983628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9ccd9-c268-481f-9eb7-04d5bad8dd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:09.984501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9ccd9-c268-481f-9eb7-04d5bad8dd92 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:09.984988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9ccd9-c268-481f-9eb7-04d5bad8dd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:09.985469 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9ccd9-c268-481f-9eb7-04d5bad8dd92 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:09.986589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9ccd9-c268-481f-9eb7-04d5bad8dd92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:09.987044 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9ccd9-c268-481f-9eb7-04d5bad8dd92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:09.988756 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9ccd9-c268-481f-9eb7-04d5bad8dd92 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:10.011990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 621/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:05:10.013280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a31a1-4a5a-42bc-833e-151e2f03b8a2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:10.170622 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a31a1-4a5a-42bc-833e-151e2f03b8a2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:10.217761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024e189-293c-4f38-9a56-32c2159229e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:10.218742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024e189-293c-4f38-9a56-32c2159229e4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:10.219108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024e189-293c-4f38-9a56-32c2159229e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:10.219678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024e189-293c-4f38-9a56-32c2159229e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:10.223505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:10.230415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024e189-293c-4f38-9a56-32c2159229e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:10.232077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024e189-293c-4f38-9a56-32c2159229e4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-9024e189-293c-4f38-9a56-32c2159229e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:05:10.248615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:10.249826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:10.251230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:10.251230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:10.251230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:05:10.251230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:05:10.251230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:05:10.251230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:05:10.251230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:05:10.251230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:05:10.251230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 12:05:10.251230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:10.251230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 618/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:05:10.257901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9ccd9-c268-481f-9eb7-04d5bad8dd92 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:10.387072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9ccd9-c268-481f-9eb7-04d5bad8dd92 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:10.438755 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512d7ae-8b6a-4bdc-b8bb-3e67684f062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:10.440110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512d7ae-8b6a-4bdc-b8bb-3e67684f062c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:10.440609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512d7ae-8b6a-4bdc-b8bb-3e67684f062c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:10.441101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512d7ae-8b6a-4bdc-b8bb-3e67684f062c None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:10.443032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512d7ae-8b6a-4bdc-b8bb-3e67684f062c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:10.443602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512d7ae-8b6a-4bdc-b8bb-3e67684f062c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:10.446515 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512d7ae-8b6a-4bdc-b8bb-3e67684f062c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:10.484242 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 622/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jul 21 12:05:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:10.485621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024e189-293c-4f38-9a56-32c2159229e4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:10.617649 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024e189-293c-4f38-9a56-32c2159229e4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:10.659482 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eaa3cc-974a-40d6-9f87-764c32faf49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:10.660386 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaa3cc-974a-40d6-9f87-764c32faf49b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:10.660734 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaa3cc-974a-40d6-9f87-764c32faf49b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:10.661024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaa3cc-974a-40d6-9f87-764c32faf49b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:10.747743 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:10.760298 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eaa3cc-974a-40d6-9f87-764c32faf49b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:10.762535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eaa3cc-974a-40d6-9f87-764c32faf49b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:10.913244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 619/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:05:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:05:10.921219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512d7ae-8b6a-4bdc-b8bb-3e67684f062c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:10.951491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:11.051034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512d7ae-8b6a-4bdc-b8bb-3e67684f062c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:11.110119 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff479d55-544a-4b7f-9761-972c40f042a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:11.111162 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff479d55-544a-4b7f-9761-972c40f042a0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:11.111508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff479d55-544a-4b7f-9761-972c40f042a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:11.111789 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff479d55-544a-4b7f-9761-972c40f042a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:11.129865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff479d55-544a-4b7f-9761-972c40f042a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:11.131860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff479d55-544a-4b7f-9761-972c40f042a0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-ff479d55-544a-4b7f-9761-972c40f042a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:05:11.155744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:11.156826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:11.158033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:05:11.158033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:05:11.158033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:11.158033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:11.158033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 623/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:11.165230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eaa3cc-974a-40d6-9f87-764c32faf49b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:11.306002 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:11.318174 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eaa3cc-974a-40d6-9f87-764c32faf49b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:11.361796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4193f61-cfd1-4472-8721-db48abcf0013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:11.362497 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193f61-cfd1-4472-8721-db48abcf0013 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:11.362806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193f61-cfd1-4472-8721-db48abcf0013 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:11.363079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193f61-cfd1-4472-8721-db48abcf0013 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:11.363877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4193f61-cfd1-4472-8721-db48abcf0013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:11.364192 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4193f61-cfd1-4472-8721-db48abcf0013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:11.365620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4193f61-cfd1-4472-8721-db48abcf0013 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:11.378613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 620/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:11.385977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff479d55-544a-4b7f-9761-972c40f042a0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:11.497557 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:11.524174 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff479d55-544a-4b7f-9761-972c40f042a0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:11.565732 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5474705-da03-49d8-9116-27a973a946b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:11.566950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5474705-da03-49d8-9116-27a973a946b2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:11.567232 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5474705-da03-49d8-9116-27a973a946b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:11.567632 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5474705-da03-49d8-9116-27a973a946b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:11.575923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5474705-da03-49d8-9116-27a973a946b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:11.577532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5474705-da03-49d8-9116-27a973a946b2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f5474705-da03-49d8-9116-27a973a946b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:05:11.593524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:11.595400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:11.599107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:05:11.599107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:05:11.599107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:05:11.599107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:05:11.599107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:05:11.599107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:05:11.599107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:05:11.599107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:11.599107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 624/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:11.602533 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4193f61-cfd1-4472-8721-db48abcf0013 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:11.757880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4193f61-cfd1-4472-8721-db48abcf0013 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:11.823535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9268c4f-3931-4658-8ea0-2668eb91dc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:11.824274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9268c4f-3931-4658-8ea0-2668eb91dc3e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:11.824593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9268c4f-3931-4658-8ea0-2668eb91dc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:11.824978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9268c4f-3931-4658-8ea0-2668eb91dc3e None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:11.825978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9268c4f-3931-4658-8ea0-2668eb91dc3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:11.826355 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9268c4f-3931-4658-8ea0-2668eb91dc3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:11.827947 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9268c4f-3931-4658-8ea0-2668eb91dc3e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:11.842572 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 621/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:11.850068 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5474705-da03-49d8-9116-27a973a946b2 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:11.992495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5474705-da03-49d8-9116-27a973a946b2 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:12.050353 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bf528-731a-404f-9a19-85f91147c4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:12.051460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bf528-731a-404f-9a19-85f91147c4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:12.053249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bf528-731a-404f-9a19-85f91147c4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:12.053626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bf528-731a-404f-9a19-85f91147c4c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:12.055054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bf528-731a-404f-9a19-85f91147c4c8 None admin] RBAC: Adding query filter params (role.id=8fc2e732d1b54ac193720d2652101798, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=06c172bcd99f469f83728c98d061a7c6) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:12.055705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bf528-731a-404f-9a19-85f91147c4c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:12.058158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bf528-731a-404f-9a19-85f91147c4c8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:12.082798 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 625/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:05:11 2022] GET /identity/v3/role_assignments?user.id=06c172bcd99f469f83728c98d061a7c6&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=8fc2e732d1b54ac193720d2652101798 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:05:14.342855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8d96c-6256-4782-8f56-cd88573a8e4d None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:14.344069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8d96c-6256-4782-8f56-cd88573a8e4d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:14.344069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8d96c-6256-4782-8f56-cd88573a8e4d None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:14.344900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 622/1247] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:05:14.351304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6880c-0207-4fef-9695-0efdbd2ba0ef None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:14.351921 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6880c-0207-4fef-9695-0efdbd2ba0ef None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:14.352052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6880c-0207-4fef-9695-0efdbd2ba0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:14.358889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:14.374315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c3e6880c-0207-4fef-9695-0efdbd2ba0ef None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:05:14.375657 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c3e6880c-0207-4fef-9695-0efdbd2ba0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:05:14.474166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 626/1248] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:05:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:05:14.511653 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8d96c-6256-4782-8f56-cd88573a8e4d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:14.534429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:14.665934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8d96c-6256-4782-8f56-cd88573a8e4d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:14.713939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48024eb6-469f-424f-b2c4-9fae4731001d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:14.715134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48024eb6-469f-424f-b2c4-9fae4731001d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:14.715498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48024eb6-469f-424f-b2c4-9fae4731001d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:14.715888 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48024eb6-469f-424f-b2c4-9fae4731001d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:14.730188 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48024eb6-469f-424f-b2c4-9fae4731001d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-48024eb6-469f-424f-b2c4-9fae4731001d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:05:14.739474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:14.742324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:14.743976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:14.743976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:14.743976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:14.743976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:14.743976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:05:14.743976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:05:14.743976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:05:14.743976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:05:14.743976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:05:14.743976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:05:14.743976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:05:14.743976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:14.743976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 623/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:05:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:14.747917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6880c-0207-4fef-9695-0efdbd2ba0ef None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:14.876291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6880c-0207-4fef-9695-0efdbd2ba0ef None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:14.918253 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:14.924980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663515b-d4fc-43f0-b8f6-b6b725c069b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:14.925872 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663515b-d4fc-43f0-b8f6-b6b725c069b8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:14.926295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663515b-d4fc-43f0-b8f6-b6b725c069b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:14.926786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663515b-d4fc-43f0-b8f6-b6b725c069b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:14.927772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663515b-d4fc-43f0-b8f6-b6b725c069b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:14.928157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663515b-d4fc-43f0-b8f6-b6b725c069b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:14.929614 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663515b-d4fc-43f0-b8f6-b6b725c069b8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:14.942605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 627/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:05:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:05:14.949677 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48024eb6-469f-424f-b2c4-9fae4731001d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:15.050420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:15.091680 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48024eb6-469f-424f-b2c4-9fae4731001d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:15.165755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06fea1-81d2-4adb-969a-72c4fc8d642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:15.167111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06fea1-81d2-4adb-969a-72c4fc8d642e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:15.167683 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06fea1-81d2-4adb-969a-72c4fc8d642e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:15.168451 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06fea1-81d2-4adb-969a-72c4fc8d642e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:15.186250 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06fea1-81d2-4adb-969a-72c4fc8d642e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:15.187879 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06fea1-81d2-4adb-969a-72c4fc8d642e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ad06fea1-81d2-4adb-969a-72c4fc8d642e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:05:15.211216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:15.212332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:15.213907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:05:15.213907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:05:15.213907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:15.213907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:15.213907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 624/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:15.220075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663515b-d4fc-43f0-b8f6-b6b725c069b8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:15.377489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663515b-d4fc-43f0-b8f6-b6b725c069b8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:15.419790 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e586b-a486-405c-997a-8d41ee325e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:15.420416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e586b-a486-405c-997a-8d41ee325e1c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:15.420708 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e586b-a486-405c-997a-8d41ee325e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:15.421025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e586b-a486-405c-997a-8d41ee325e1c None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:15.421769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e586b-a486-405c-997a-8d41ee325e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:15.422158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e586b-a486-405c-997a-8d41ee325e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:15.423710 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e586b-a486-405c-997a-8d41ee325e1c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:15.437980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 628/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:15.448197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06fea1-81d2-4adb-969a-72c4fc8d642e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:15.627127 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06fea1-81d2-4adb-969a-72c4fc8d642e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:15.662463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:15.673198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b2bd1-1df5-490a-aa9a-ed1b7b79f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:15.673999 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b2bd1-1df5-490a-aa9a-ed1b7b79f219 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:15.674308 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b2bd1-1df5-490a-aa9a-ed1b7b79f219 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:15.674589 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b2bd1-1df5-490a-aa9a-ed1b7b79f219 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:15.685848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b2bd1-1df5-490a-aa9a-ed1b7b79f219 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:15.687633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b2bd1-1df5-490a-aa9a-ed1b7b79f219 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-4a0b2bd1-1df5-490a-aa9a-ed1b7b79f219 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:05:15.706689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:15.708896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:15.710202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:15.710202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:15.710202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:05:15.710202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:05:15.710202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:05:15.710202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:05:15.710202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:05:15.710202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:05:15.710202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 12:05:15.710202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:15.710202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 625/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:15.715459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e586b-a486-405c-997a-8d41ee325e1c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:15.790891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:15.847209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e586b-a486-405c-997a-8d41ee325e1c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:15.886446 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dcb26-22e7-4163-aad8-2eda4f899ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:15.887159 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dcb26-22e7-4163-aad8-2eda4f899ede None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:15.887437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dcb26-22e7-4163-aad8-2eda4f899ede None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:15.887711 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dcb26-22e7-4163-aad8-2eda4f899ede None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:15.888616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dcb26-22e7-4163-aad8-2eda4f899ede None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:15.888971 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dcb26-22e7-4163-aad8-2eda4f899ede None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:15.890455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dcb26-22e7-4163-aad8-2eda4f899ede None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:15.915039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 629/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jul 21 12:05:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:05:15.922527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b2bd1-1df5-490a-aa9a-ed1b7b79f219 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:16.055303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b2bd1-1df5-490a-aa9a-ed1b7b79f219 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:16.106089 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067fdbb-dfff-422b-81d8-92cdde9d33d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:16.107590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067fdbb-dfff-422b-81d8-92cdde9d33d8 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:16.108320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067fdbb-dfff-422b-81d8-92cdde9d33d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:16.109002 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067fdbb-dfff-422b-81d8-92cdde9d33d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:16.193945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:16.207428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067fdbb-dfff-422b-81d8-92cdde9d33d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:16.209973 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067fdbb-dfff-422b-81d8-92cdde9d33d8 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:16.343346 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 626/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:05:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 12:05:16.349332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dcb26-22e7-4163-aad8-2eda4f899ede None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:16.492749 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dcb26-22e7-4163-aad8-2eda4f899ede None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:16.510411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:16.538287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a512037-fd5a-4a9d-b544-ee5f11d872d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:16.539293 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512037-fd5a-4a9d-b544-ee5f11d872d3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:16.539571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512037-fd5a-4a9d-b544-ee5f11d872d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:16.539891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512037-fd5a-4a9d-b544-ee5f11d872d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:16.552688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a512037-fd5a-4a9d-b544-ee5f11d872d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:16.554334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a512037-fd5a-4a9d-b544-ee5f11d872d3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-0a512037-fd5a-4a9d-b544-ee5f11d872d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:05:16.576957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:16.578124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:16.585195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:05:16.585195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:05:16.585195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:16.585195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:16.585195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 630/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:16.585632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067fdbb-dfff-422b-81d8-92cdde9d33d8 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:16.726429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:16.746358 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067fdbb-dfff-422b-81d8-92cdde9d33d8 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:16.794896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea9d57-440c-40b2-a825-678a64bb8d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:16.795653 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea9d57-440c-40b2-a825-678a64bb8d99 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:16.795980 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea9d57-440c-40b2-a825-678a64bb8d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:16.796250 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea9d57-440c-40b2-a825-678a64bb8d99 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:16.797008 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea9d57-440c-40b2-a825-678a64bb8d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:16.797320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea9d57-440c-40b2-a825-678a64bb8d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:16.799408 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea9d57-440c-40b2-a825-678a64bb8d99 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:16.818703 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 627/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:05:16.824939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a512037-fd5a-4a9d-b544-ee5f11d872d3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:16.984417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a512037-fd5a-4a9d-b544-ee5f11d872d3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:17.042764 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cbb4b-3c20-4df6-9201-8280ee08d3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:17.043709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cbb4b-3c20-4df6-9201-8280ee08d3db None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:17.044141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cbb4b-3c20-4df6-9201-8280ee08d3db None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:17.044429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cbb4b-3c20-4df6-9201-8280ee08d3db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:17.052856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795cbb4b-3c20-4df6-9201-8280ee08d3db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:17.054440 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795cbb4b-3c20-4df6-9201-8280ee08d3db None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-795cbb4b-3c20-4df6-9201-8280ee08d3db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:05:17.072135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:17.074741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:17.076506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:05:17.076506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:05:17.076506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:05:17.076506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:05:17.076506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:05:17.076506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:05:17.076506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:05:17.076506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:17.076506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 631/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:17.080254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea9d57-440c-40b2-a825-678a64bb8d99 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:17.206111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea9d57-440c-40b2-a825-678a64bb8d99 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:17.255349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138d6f7-a4c9-48e6-8492-12329e0b58ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:17.256211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d6f7-a4c9-48e6-8492-12329e0b58ac None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:17.256727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d6f7-a4c9-48e6-8492-12329e0b58ac None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:17.257137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d6f7-a4c9-48e6-8492-12329e0b58ac None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:17.258069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138d6f7-a4c9-48e6-8492-12329e0b58ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:17.258567 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138d6f7-a4c9-48e6-8492-12329e0b58ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:17.260676 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138d6f7-a4c9-48e6-8492-12329e0b58ac None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:17.278194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 628/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:05:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:05:17.284654 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cbb4b-3c20-4df6-9201-8280ee08d3db None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:17.320072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:17.418845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cbb4b-3c20-4df6-9201-8280ee08d3db None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:17.467119 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970464c-f92c-4b4f-98a1-2c6aedf4f99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:17.468220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970464c-f92c-4b4f-98a1-2c6aedf4f99d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:17.468785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970464c-f92c-4b4f-98a1-2c6aedf4f99d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:17.469222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970464c-f92c-4b4f-98a1-2c6aedf4f99d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:17.470254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970464c-f92c-4b4f-98a1-2c6aedf4f99d None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=06c172bcd99f469f83728c98d061a7c6) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:17.470801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970464c-f92c-4b4f-98a1-2c6aedf4f99d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:17.472535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970464c-f92c-4b4f-98a1-2c6aedf4f99d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:17.479948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 632/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:05:17 2022] GET /identity/v3/role_assignments?user.id=06c172bcd99f469f83728c98d061a7c6&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:19.607422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c947f-5500-48bb-a130-10879df1f0f8 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:19.607996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c947f-5500-48bb-a130-10879df1f0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:19.607996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c947f-5500-48bb-a130-10879df1f0f8 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:19.609338 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 629/1261] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:05:19.614936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c3393-5476-40b5-b53d-86a73684c7e2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:19.615537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c3393-5476-40b5-b53d-86a73684c7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:19.615537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c3393-5476-40b5-b53d-86a73684c7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:19.633676 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f28c3393-5476-40b5-b53d-86a73684c7e2 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:05:19.634898 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f28c3393-5476-40b5-b53d-86a73684c7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:05:19.707611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 633/1262] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:05:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:05:19.734678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c947f-5500-48bb-a130-10879df1f0f8 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:19.747672 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:19.847362 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c947f-5500-48bb-a130-10879df1f0f8 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:19.886260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77def2f-ab7e-4fca-979b-ec799f9f763a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:19.887348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77def2f-ab7e-4fca-979b-ec799f9f763a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:19.887654 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77def2f-ab7e-4fca-979b-ec799f9f763a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:19.887927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77def2f-ab7e-4fca-979b-ec799f9f763a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:19.901665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77def2f-ab7e-4fca-979b-ec799f9f763a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e77def2f-ab7e-4fca-979b-ec799f9f763a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:05:19.909214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:19.910319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:19.911252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:19.911252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:19.911252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:19.911252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:19.911252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:05:19.911252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:05:19.911252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:05:19.911252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:05:19.911252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:05:19.911252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:05:19.911252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:05:19.911252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:19.911252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 630/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:05:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:19.916833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c3393-5476-40b5-b53d-86a73684c7e2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:19.935856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:20.020455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c3393-5476-40b5-b53d-86a73684c7e2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:20.056195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fba165-5362-4d3f-adcc-8f7332114479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:20.056904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fba165-5362-4d3f-adcc-8f7332114479 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:20.057157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fba165-5362-4d3f-adcc-8f7332114479 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:20.057435 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fba165-5362-4d3f-adcc-8f7332114479 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:20.058204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fba165-5362-4d3f-adcc-8f7332114479 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:20.058529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fba165-5362-4d3f-adcc-8f7332114479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:20.059986 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fba165-5362-4d3f-adcc-8f7332114479 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:20.072756 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 634/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:05:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:05:20.077652 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77def2f-ab7e-4fca-979b-ec799f9f763a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:20.154358 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:20.193618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77def2f-ab7e-4fca-979b-ec799f9f763a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:20.227774 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbe747-325a-49c7-8a51-c7513a14494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:20.228572 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbe747-325a-49c7-8a51-c7513a14494d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:20.228859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbe747-325a-49c7-8a51-c7513a14494d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:20.229140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbe747-325a-49c7-8a51-c7513a14494d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:20.239793 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbe747-325a-49c7-8a51-c7513a14494d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:20.241305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbe747-325a-49c7-8a51-c7513a14494d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e3dbe747-325a-49c7-8a51-c7513a14494d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:05:20.258542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:20.259590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:20.260531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:05:20.260531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:05:20.260531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:20.260531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:20.260531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 631/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:20.265914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fba165-5362-4d3f-adcc-8f7332114479 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:20.350988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:20.371141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fba165-5362-4d3f-adcc-8f7332114479 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:20.403840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19495da-ecdc-4a0b-8318-ad2d4b9b666e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:20.404502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19495da-ecdc-4a0b-8318-ad2d4b9b666e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:20.404781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19495da-ecdc-4a0b-8318-ad2d4b9b666e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:20.405054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19495da-ecdc-4a0b-8318-ad2d4b9b666e None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:20.405780 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19495da-ecdc-4a0b-8318-ad2d4b9b666e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:20.406092 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19495da-ecdc-4a0b-8318-ad2d4b9b666e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:20.407469 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19495da-ecdc-4a0b-8318-ad2d4b9b666e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:20.420587 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 635/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:20.426617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbe747-325a-49c7-8a51-c7513a14494d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:20.535459 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbe747-325a-49c7-8a51-c7513a14494d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:20.555632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:20.571941 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35538bc-9753-4b70-906e-dec1a5ad1201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:20.572873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35538bc-9753-4b70-906e-dec1a5ad1201 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:20.573159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35538bc-9753-4b70-906e-dec1a5ad1201 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:20.573432 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35538bc-9753-4b70-906e-dec1a5ad1201 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:20.581364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35538bc-9753-4b70-906e-dec1a5ad1201 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:20.582839 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35538bc-9753-4b70-906e-dec1a5ad1201 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-b35538bc-9753-4b70-906e-dec1a5ad1201 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:05:20.597369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:20.598436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:20.599484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:20.599484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:20.599484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:05:20.599484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:05:20.599484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:05:20.599484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:05:20.599484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:05:20.599484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:05:20.599484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 12:05:20.599484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:20.599484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 632/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:20.604712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19495da-ecdc-4a0b-8318-ad2d4b9b666e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:20.712720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19495da-ecdc-4a0b-8318-ad2d4b9b666e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:20.751264 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b08eb-973d-4537-90c5-dd74e58053b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:20.751935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b08eb-973d-4537-90c5-dd74e58053b1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:20.752211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b08eb-973d-4537-90c5-dd74e58053b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:20.752480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b08eb-973d-4537-90c5-dd74e58053b1 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:20.753320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b08eb-973d-4537-90c5-dd74e58053b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:20.753624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b08eb-973d-4537-90c5-dd74e58053b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:20.755067 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b08eb-973d-4537-90c5-dd74e58053b1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:20.763948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:20.772720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 636/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jul 21 12:05:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:20.778871 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35538bc-9753-4b70-906e-dec1a5ad1201 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:20.892495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35538bc-9753-4b70-906e-dec1a5ad1201 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:20.926814 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5f0a3-dd10-4d26-9a71-53f7fec18dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:20.927603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5f0a3-dd10-4d26-9a71-53f7fec18dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:20.927971 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5f0a3-dd10-4d26-9a71-53f7fec18dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:20.928203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5f0a3-dd10-4d26-9a71-53f7fec18dd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:20.940043 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5f0a3-dd10-4d26-9a71-53f7fec18dd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:20.941840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5f0a3-dd10-4d26-9a71-53f7fec18dd2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-eae5f0a3-dd10-4d26-9a71-53f7fec18dd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:05:20.959396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:20.960480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:20.961518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:05:20.961518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:05:20.961518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:20.961518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:20.961518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 633/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:20.967000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b08eb-973d-4537-90c5-dd74e58053b1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:21.072168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b08eb-973d-4537-90c5-dd74e58053b1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:21.113585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85b25b-357e-47d3-81ba-3726e3472585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:21.114262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b25b-357e-47d3-81ba-3726e3472585 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:21.114554 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b25b-357e-47d3-81ba-3726e3472585 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:21.114863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b25b-357e-47d3-81ba-3726e3472585 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:21.115630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85b25b-357e-47d3-81ba-3726e3472585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:21.115935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85b25b-357e-47d3-81ba-3726e3472585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:21.117300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85b25b-357e-47d3-81ba-3726e3472585 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:21.129380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 637/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:05:21.135397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5f0a3-dd10-4d26-9a71-53f7fec18dd2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:21.170101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:21.246547 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5f0a3-dd10-4d26-9a71-53f7fec18dd2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:21.282434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b47f3-e256-4dca-8e05-da85a748cf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:21.283266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b47f3-e256-4dca-8e05-da85a748cf9b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:21.283581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b47f3-e256-4dca-8e05-da85a748cf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:21.283815 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b47f3-e256-4dca-8e05-da85a748cf9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:21.290848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b47f3-e256-4dca-8e05-da85a748cf9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:21.292300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b47f3-e256-4dca-8e05-da85a748cf9b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-044b47f3-e256-4dca-8e05-da85a748cf9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:05:21.306501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:21.307568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:21.308623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:05:21.308623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:05:21.308623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:05:21.308623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:05:21.308623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:05:21.308623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:05:21.308623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:05:21.308623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:21.308623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 634/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:05:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:21.313957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85b25b-357e-47d3-81ba-3726e3472585 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:21.375943 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:21.428476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85b25b-357e-47d3-81ba-3726e3472585 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:21.465552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb999704-4a4d-4cac-8ae2-b02e05b68bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:21.466388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb999704-4a4d-4cac-8ae2-b02e05b68bda None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:21.466633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb999704-4a4d-4cac-8ae2-b02e05b68bda None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:21.466960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb999704-4a4d-4cac-8ae2-b02e05b68bda None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:21.467744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb999704-4a4d-4cac-8ae2-b02e05b68bda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:21.468047 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb999704-4a4d-4cac-8ae2-b02e05b68bda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:21.469457 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb999704-4a4d-4cac-8ae2-b02e05b68bda None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:21.483548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 638/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:05:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:21.492353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b47f3-e256-4dca-8e05-da85a748cf9b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:21.590961 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:21.601120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b47f3-e256-4dca-8e05-da85a748cf9b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:21.637696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925d143-cc0d-4d7e-b38a-a964dfc920c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:21.638598 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d143-cc0d-4d7e-b38a-a964dfc920c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:21.639569 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d143-cc0d-4d7e-b38a-a964dfc920c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:21.639569 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d143-cc0d-4d7e-b38a-a964dfc920c4 None admin] PATH_INFO: `/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/06c172bcd99f469f83728c98d061a7c6/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:21.641927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925d143-cc0d-4d7e-b38a-a964dfc920c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0946df6ba381401e8e4958d11c63cb2b, user_id=06c172bcd99f469f83728c98d061a7c6, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:21.643871 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925d143-cc0d-4d7e-b38a-a964dfc920c4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:21.661235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 635/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jul 21 12:05:21 2022] PUT /identity/v3/projects/0946df6ba381401e8e4958d11c63cb2b/users/06c172bcd99f469f83728c98d061a7c6/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:05:23.742285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532fd82-f74c-4b7b-9b7d-3566aac609a0 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:23.742856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532fd82-f74c-4b7b-9b7d-3566aac609a0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:23.742856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532fd82-f74c-4b7b-9b7d-3566aac609a0 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:23.744484 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 639/1274] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:05:23.751795 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2f965-705c-405f-b75c-d30bec57f6cf None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:23.752328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2f965-705c-405f-b75c-d30bec57f6cf None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:23.752328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2f965-705c-405f-b75c-d30bec57f6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:23.770026 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-12f2f965-705c-405f-b75c-d30bec57f6cf None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:05:23.771270 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-12f2f965-705c-405f-b75c-d30bec57f6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:05:23.840691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 636/1275] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:05:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:05:23.867034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532fd82-f74c-4b7b-9b7d-3566aac609a0 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:23.973764 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532fd82-f74c-4b7b-9b7d-3566aac609a0 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:23.991746 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:24.009319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25657fe3-3de1-453b-a972-20be74b259a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:24.010120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25657fe3-3de1-453b-a972-20be74b259a1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:24.010399 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25657fe3-3de1-453b-a972-20be74b259a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:24.010694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25657fe3-3de1-453b-a972-20be74b259a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:24.021164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25657fe3-3de1-453b-a972-20be74b259a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-25657fe3-3de1-453b-a972-20be74b259a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 12:05:24.028719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:24.029763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:24.030795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:24.030795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:24.030795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:24.030795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:24.030795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 12:05:24.030795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 12:05:24.030795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 12:05:24.030795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 12:05:24.030795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 12:05:24.030795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 12:05:24.030795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 12:05:24.030795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:24.034830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 640/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jul 21 12:05:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:24.036836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2f965-705c-405f-b75c-d30bec57f6cf None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:24.141039 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:24.159444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2f965-705c-405f-b75c-d30bec57f6cf None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:24.192728 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909babb8-7d3c-41c3-aac2-c5ee76e52e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:24.193469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909babb8-7d3c-41c3-aac2-c5ee76e52e0b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:24.193748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909babb8-7d3c-41c3-aac2-c5ee76e52e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:24.194022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909babb8-7d3c-41c3-aac2-c5ee76e52e0b None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:24.194808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909babb8-7d3c-41c3-aac2-c5ee76e52e0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:24.195109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909babb8-7d3c-41c3-aac2-c5ee76e52e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:24.196507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909babb8-7d3c-41c3-aac2-c5ee76e52e0b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:24.205364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 637/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jul 21 12:05:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:24.211354 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25657fe3-3de1-453b-a972-20be74b259a1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:24.318834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25657fe3-3de1-453b-a972-20be74b259a1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:24.354978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a438ab-14b4-43fc-85bd-39b0c238e925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:24.355821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a438ab-14b4-43fc-85bd-39b0c238e925 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:24.356097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a438ab-14b4-43fc-85bd-39b0c238e925 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:24.356370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a438ab-14b4-43fc-85bd-39b0c238e925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:24.368459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a438ab-14b4-43fc-85bd-39b0c238e925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:24.369909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a438ab-14b4-43fc-85bd-39b0c238e925 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-e6a438ab-14b4-43fc-85bd-39b0c238e925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:05:24.387247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:24.388342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:24.389426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:05:24.389426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:05:24.389426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:24.389426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:24.390859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 641/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 12:05:24.394408 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909babb8-7d3c-41c3-aac2-c5ee76e52e0b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:24.496843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909babb8-7d3c-41c3-aac2-c5ee76e52e0b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:24.531671 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93add131-6963-456b-aefb-b4c24f4876cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:24.532332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93add131-6963-456b-aefb-b4c24f4876cc None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:24.532613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93add131-6963-456b-aefb-b4c24f4876cc None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:24.532887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93add131-6963-456b-aefb-b4c24f4876cc None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:24.533614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93add131-6963-456b-aefb-b4c24f4876cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:24.533918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93add131-6963-456b-aefb-b4c24f4876cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:24.535318 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93add131-6963-456b-aefb-b4c24f4876cc None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:24.548479 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 638/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:24.556213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a438ab-14b4-43fc-85bd-39b0c238e925 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:24.591809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:24.666363 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a438ab-14b4-43fc-85bd-39b0c238e925 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:24.702503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc4f58-cacc-4300-b550-acdfef726ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:24.703396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc4f58-cacc-4300-b550-acdfef726ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:24.703736 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc4f58-cacc-4300-b550-acdfef726ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:24.704055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc4f58-cacc-4300-b550-acdfef726ed1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:24.716618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc4f58-cacc-4300-b550-acdfef726ed1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:24.718684 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc4f58-cacc-4300-b550-acdfef726ed1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-7acc4f58-cacc-4300-b550-acdfef726ed1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 12:05:24.735226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:24.737100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:24.739352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:24.739352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:24.739352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 12:05:24.739352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 12:05:24.739352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 12:05:24.739352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 12:05:24.739352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 12:05:24.739352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 12:05:24.739352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 12:05:24.739352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:24.739352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 642/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:24.745020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93add131-6963-456b-aefb-b4c24f4876cc None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:24.749138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:24.854576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93add131-6963-456b-aefb-b4c24f4876cc None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:24.893554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb82ae-cad3-4736-b8fd-0a5736b63d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:24.894228 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb82ae-cad3-4736-b8fd-0a5736b63d51 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:24.894506 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb82ae-cad3-4736-b8fd-0a5736b63d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:24.894814 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb82ae-cad3-4736-b8fd-0a5736b63d51 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:24.895700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb82ae-cad3-4736-b8fd-0a5736b63d51 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:24.895998 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb82ae-cad3-4736-b8fd-0a5736b63d51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:24.897429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb82ae-cad3-4736-b8fd-0a5736b63d51 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:24.916642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 639/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jul 21 12:05:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:24.923140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc4f58-cacc-4300-b550-acdfef726ed1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:25.025857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:25.036567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc4f58-cacc-4300-b550-acdfef726ed1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:25.075749 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efd11d-a708-410c-a4ff-8097593d7b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:25.076449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd11d-a708-410c-a4ff-8097593d7b15 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:25.076850 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd11d-a708-410c-a4ff-8097593d7b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:25.077162 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd11d-a708-410c-a4ff-8097593d7b15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:25.153925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efd11d-a708-410c-a4ff-8097593d7b15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:25.155506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efd11d-a708-410c-a4ff-8097593d7b15 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:25.247147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:25.259582 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 643/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jul 21 12:05:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 12:05:25.265695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb82ae-cad3-4736-b8fd-0a5736b63d51 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:25.332429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:25.375669 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb82ae-cad3-4736-b8fd-0a5736b63d51 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:25.411847 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6449b2d-a0a6-4d46-b0df-7e0e46e6ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:25.412563 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449b2d-a0a6-4d46-b0df-7e0e46e6ac29 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:25.412847 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449b2d-a0a6-4d46-b0df-7e0e46e6ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:25.413121 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449b2d-a0a6-4d46-b0df-7e0e46e6ac29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:25.428561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6449b2d-a0a6-4d46-b0df-7e0e46e6ac29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:25.431058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6449b2d-a0a6-4d46-b0df-7e0e46e6ac29 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e6449b2d-a0a6-4d46-b0df-7e0e46e6ac29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 12:05:25.454473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:25.455581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:25.456809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 12:05:25.456809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 12:05:25.456809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 12:05:25.456809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:25.456809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 640/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:25.461707 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efd11d-a708-410c-a4ff-8097593d7b15 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:25.565648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efd11d-a708-410c-a4ff-8097593d7b15 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:25.601602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f9ba2-a04b-4398-a8b4-cb21aa44e3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:25.602273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f9ba2-a04b-4398-a8b4-cb21aa44e3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:25.602552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f9ba2-a04b-4398-a8b4-cb21aa44e3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:25.602852 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f9ba2-a04b-4398-a8b4-cb21aa44e3e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:25.603577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f9ba2-a04b-4398-a8b4-cb21aa44e3e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:25.603879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f9ba2-a04b-4398-a8b4-cb21aa44e3e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:25.605201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f9ba2-a04b-4398-a8b4-cb21aa44e3e6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:25.618027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 644/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jul 21 12:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:25.624212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6449b2d-a0a6-4d46-b0df-7e0e46e6ac29 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:25.731004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6449b2d-a0a6-4d46-b0df-7e0e46e6ac29 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:25.745377 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:25.766244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b66ed-392f-4d51-9772-64ccca005029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:25.767079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b66ed-392f-4d51-9772-64ccca005029 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:25.767355 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b66ed-392f-4d51-9772-64ccca005029 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:25.767624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b66ed-392f-4d51-9772-64ccca005029 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:25.774545 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b66ed-392f-4d51-9772-64ccca005029 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:25.776011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b66ed-392f-4d51-9772-64ccca005029 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-fe8b66ed-392f-4d51-9772-64ccca005029 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 12:05:25.789911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:25.791035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:25.791975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 12:05:25.791975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 12:05:25.791975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 12:05:25.791975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 12:05:25.791975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 12:05:25.791975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 12:05:25.791975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 12:05:25.791975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 21 12:05:25.791975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 641/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jul 21 12:05:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:25.797968 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f9ba2-a04b-4398-a8b4-cb21aa44e3e6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:25.852024 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:25.909056 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f9ba2-a04b-4398-a8b4-cb21aa44e3e6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:25.944514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf4339-fe3e-4f51-8786-ed990939e19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:25.945184 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf4339-fe3e-4f51-8786-ed990939e19b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:25.945455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf4339-fe3e-4f51-8786-ed990939e19b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:25.945735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf4339-fe3e-4f51-8786-ed990939e19b None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:25.946531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf4339-fe3e-4f51-8786-ed990939e19b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:25.946873 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf4339-fe3e-4f51-8786-ed990939e19b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:25.948321 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf4339-fe3e-4f51-8786-ed990939e19b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:25.961257 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 645/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jul 21 12:05:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:25.968157 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b66ed-392f-4d51-9772-64ccca005029 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:26.077931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b66ed-392f-4d51-9772-64ccca005029 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:26.111911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b5b23-44f4-4dd3-a1ef-58af90a5ff37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:26.112592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b5b23-44f4-4dd3-a1ef-58af90a5ff37 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:26.112851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b5b23-44f4-4dd3-a1ef-58af90a5ff37 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:26.113122 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b5b23-44f4-4dd3-a1ef-58af90a5ff37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:26.113986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b5b23-44f4-4dd3-a1ef-58af90a5ff37 None admin] RBAC: Adding query filter params (role.id=371a7ac4f7194ce89bcdc3cc5084bf31, scope.project.id=0946df6ba381401e8e4958d11c63cb2b, user.id=06c172bcd99f469f83728c98d061a7c6) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:26.114299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b5b23-44f4-4dd3-a1ef-58af90a5ff37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:26.115899 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b5b23-44f4-4dd3-a1ef-58af90a5ff37 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:26.123008 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 642/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jul 21 12:05:25 2022] GET /identity/v3/role_assignments?user.id=06c172bcd99f469f83728c98d061a7c6&scope.project.id=0946df6ba381401e8e4958d11c63cb2b&role.id=371a7ac4f7194ce89bcdc3cc5084bf31 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:28.189280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec32d76-5576-4876-b55d-d579121953ed None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:28.189877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec32d76-5576-4876-b55d-d579121953ed None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:28.189877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec32d76-5576-4876-b55d-d579121953ed None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:28.191586 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 646/1288] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:05:28.198061 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68a2f0-366f-4e4e-a3c9-d25029de57bb None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:28.198511 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68a2f0-366f-4e4e-a3c9-d25029de57bb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:28.198622 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68a2f0-366f-4e4e-a3c9-d25029de57bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:28.220035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ac68a2f0-366f-4e4e-a3c9-d25029de57bb None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:05:28.221764 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ac68a2f0-366f-4e4e-a3c9-d25029de57bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:05:28.264459 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:28.306539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 643/1289] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:05:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:05:28.330688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec32d76-5576-4876-b55d-d579121953ed None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:28.439412 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec32d76-5576-4876-b55d-d579121953ed None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:28.451028 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:28.476747 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41de223-7443-4e07-ae38-e69135c06cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:28.480081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41de223-7443-4e07-ae38-e69135c06cff None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:28.480081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41de223-7443-4e07-ae38-e69135c06cff None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:28.480081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41de223-7443-4e07-ae38-e69135c06cff None admin] PATH_INFO: `/v3/services/placement` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:28.480081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41de223-7443-4e07-ae38-e69135c06cff None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:28.480081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41de223-7443-4e07-ae38-e69135c06cff None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-d41de223-7443-4e07-ae38-e69135c06cff None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:28.493617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:28.494889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:28.502214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 647/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jul 21 12:05:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:28.503258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68a2f0-366f-4e4e-a3c9-d25029de57bb None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:28.610734 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68a2f0-366f-4e4e-a3c9-d25029de57bb None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:28.646154 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead09e0c-0a4b-414d-b37b-d7d26d0899df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:28.646898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09e0c-0a4b-414d-b37b-d7d26d0899df None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:28.647178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09e0c-0a4b-414d-b37b-d7d26d0899df None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:28.647450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09e0c-0a4b-414d-b37b-d7d26d0899df None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:28.648250 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead09e0c-0a4b-414d-b37b-d7d26d0899df None admin] RBAC: Adding query filter params (name=placement) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:28.648558 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead09e0c-0a4b-414d-b37b-d7d26d0899df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:28.649932 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead09e0c-0a4b-414d-b37b-d7d26d0899df None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:28.655482 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 644/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Jul 21 12:05:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:28.661453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41de223-7443-4e07-ae38-e69135c06cff None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:28.788589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41de223-7443-4e07-ae38-e69135c06cff None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:28.826307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded8323-4f89-4fd4-b38d-0efbcb61bf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:28.827070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded8323-4f89-4fd4-b38d-0efbcb61bf85 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:28.827357 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded8323-4f89-4fd4-b38d-0efbcb61bf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:28.827641 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded8323-4f89-4fd4-b38d-0efbcb61bf85 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:28.828364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded8323-4f89-4fd4-b38d-0efbcb61bf85 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:28.828664 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded8323-4f89-4fd4-b38d-0efbcb61bf85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:28.830080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded8323-4f89-4fd4-b38d-0efbcb61bf85 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:28.835895 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 648/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Jul 21 12:05:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:30.856628 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37a8c4-1099-4979-9205-8c979250722b None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:30.857190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37a8c4-1099-4979-9205-8c979250722b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:30.857190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37a8c4-1099-4979-9205-8c979250722b None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:30.858536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 645/1293] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:05:30.864026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be65d3a-bcfe-4d1b-a6f4-94255bd4779e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:30.864468 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be65d3a-bcfe-4d1b-a6f4-94255bd4779e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:30.864577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be65d3a-bcfe-4d1b-a6f4-94255bd4779e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:30.881907 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9be65d3a-bcfe-4d1b-a6f4-94255bd4779e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:05:30.883116 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9be65d3a-bcfe-4d1b-a6f4-94255bd4779e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:05:30.915924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:30.956086 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 649/1294] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:05:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 12:05:30.979564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37a8c4-1099-4979-9205-8c979250722b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:31.015161 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:31.116155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37a8c4-1099-4979-9205-8c979250722b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:31.159810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc54031-a73d-4797-b050-073b21fbbfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:31.160477 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc54031-a73d-4797-b050-073b21fbbfd2 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:31.160710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc54031-a73d-4797-b050-073b21fbbfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:31.161004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc54031-a73d-4797-b050-073b21fbbfd2 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:31.161756 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc54031-a73d-4797-b050-073b21fbbfd2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:31.163163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc54031-a73d-4797-b050-073b21fbbfd2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:31.177072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 646/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jul 21 12:05:30 2022] POST /identity/v3/services => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:05:33.281497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0601b6-0cea-49c3-b700-4957cc184143 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:33.282384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0601b6-0cea-49c3-b700-4957cc184143 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:33.282384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0601b6-0cea-49c3-b700-4957cc184143 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:33.284639 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 650/1296] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:05:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:05:33.290297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3a53-fef8-4513-84ca-82eec5bf0e3d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:33.290765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3a53-fef8-4513-84ca-82eec5bf0e3d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:33.290882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3a53-fef8-4513-84ca-82eec5bf0e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:33.309999 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-324f3a53-fef8-4513-84ca-82eec5bf0e3d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:05:33.311220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-324f3a53-fef8-4513-84ca-82eec5bf0e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:05:33.388673 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 647/1297] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:05:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:05:33.411786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0601b6-0cea-49c3-b700-4957cc184143 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:33.519924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0601b6-0cea-49c3-b700-4957cc184143 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:33.561180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcc535-d2c4-419a-b735-941a31943fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:33.561896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcc535-d2c4-419a-b735-941a31943fcc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:33.562179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcc535-d2c4-419a-b735-941a31943fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:33.562450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcc535-d2c4-419a-b735-941a31943fcc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:33.563145 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcc535-d2c4-419a-b735-941a31943fcc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:33.564516 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcc535-d2c4-419a-b735-941a31943fcc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-0bbcc535-d2c4-419a-b735-941a31943fcc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:33.581241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:33.582889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:33.584181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 651/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jul 21 12:05:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:33.589203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f3a53-fef8-4513-84ca-82eec5bf0e3d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:33.616626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:33.713081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f3a53-fef8-4513-84ca-82eec5bf0e3d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:33.747894 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ba17c-83a6-4ee7-834d-db803ce288df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:33.748562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ba17c-83a6-4ee7-834d-db803ce288df None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:33.748836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ba17c-83a6-4ee7-834d-db803ce288df None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:33.749104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ba17c-83a6-4ee7-834d-db803ce288df None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:33.749819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ba17c-83a6-4ee7-834d-db803ce288df None admin] RBAC: Adding query filter params (name=placement) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:33.750109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ba17c-83a6-4ee7-834d-db803ce288df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:33.751511 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ba17c-83a6-4ee7-834d-db803ce288df None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:33.756874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 648/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Jul 21 12:05:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:33.764313 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcc535-d2c4-419a-b735-941a31943fcc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:33.805245 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:33.883084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcc535-d2c4-419a-b735-941a31943fcc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:33.918720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de251929-46fc-488c-856f-f416347ee962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:33.919381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de251929-46fc-488c-856f-f416347ee962 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:33.919666 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de251929-46fc-488c-856f-f416347ee962 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:33.919953 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de251929-46fc-488c-856f-f416347ee962 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:33.920743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de251929-46fc-488c-856f-f416347ee962 None admin] RBAC: Adding query filter params (interface=public, service_id=6d1d84d1916f49bcb38c41398328b8cc, region_id=RegionOne) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:33.921057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de251929-46fc-488c-856f-f416347ee962 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:33.922416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de251929-46fc-488c-856f-f416347ee962 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:33.927643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 652/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jul 21 12:05:33 2022] GET /identity/v3/endpoints?service_id=6d1d84d1916f49bcb38c41398328b8cc&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:33.936278 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ba17c-83a6-4ee7-834d-db803ce288df None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:34.040450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:34.064238 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ba17c-83a6-4ee7-834d-db803ce288df None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:34.107911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340957e7-11b3-4e1d-934a-cf7c1e2972d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:34.108667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340957e7-11b3-4e1d-934a-cf7c1e2972d5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:34.109156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340957e7-11b3-4e1d-934a-cf7c1e2972d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:34.109679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340957e7-11b3-4e1d-934a-cf7c1e2972d5 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:34.111020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340957e7-11b3-4e1d-934a-cf7c1e2972d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:34.113046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340957e7-11b3-4e1d-934a-cf7c1e2972d5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:34.125083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 649/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jul 21 12:05:33 2022] GET /identity/v3/services => generated 2191 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:05:36.129325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc2cdf-e82b-4803-9e0f-3f86526311b3 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:36.129898 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc2cdf-e82b-4803-9e0f-3f86526311b3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:36.129898 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc2cdf-e82b-4803-9e0f-3f86526311b3 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:36.131371 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 653/1302] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:05:36.137773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc321ffd-bc4d-4be9-9ffd-4f954effd420 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:36.138296 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc321ffd-bc4d-4be9-9ffd-4f954effd420 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:36.138389 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc321ffd-bc4d-4be9-9ffd-4f954effd420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:36.164252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-bc321ffd-bc4d-4be9-9ffd-4f954effd420 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:05:36.165445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bc321ffd-bc4d-4be9-9ffd-4f954effd420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:05:36.238241 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 650/1303] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:05:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 12:05:36.261719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc2cdf-e82b-4803-9e0f-3f86526311b3 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:36.362547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:36.371181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc2cdf-e82b-4803-9e0f-3f86526311b3 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:36.411962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cfc37-9657-410a-ac08-592d96fdd102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:36.412655 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cfc37-9657-410a-ac08-592d96fdd102 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:36.412932 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cfc37-9657-410a-ac08-592d96fdd102 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:36.413202 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cfc37-9657-410a-ac08-592d96fdd102 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:36.413941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cfc37-9657-410a-ac08-592d96fdd102 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:36.415250 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cfc37-9657-410a-ac08-592d96fdd102 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-085cfc37-9657-410a-ac08-592d96fdd102 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 12:05:36.427045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 12:05:36.428383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 21 12:05:36.429228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 654/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jul 21 12:05:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 12:05:36.434478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc321ffd-bc4d-4be9-9ffd-4f954effd420 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:36.511853 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:36.535599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc321ffd-bc4d-4be9-9ffd-4f954effd420 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:36.571320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af25c6-9bb5-4c81-a3e6-ce804ad45fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:36.571993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af25c6-9bb5-4c81-a3e6-ce804ad45fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:36.572278 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af25c6-9bb5-4c81-a3e6-ce804ad45fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:36.572553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af25c6-9bb5-4c81-a3e6-ce804ad45fc7 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:36.573267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af25c6-9bb5-4c81-a3e6-ce804ad45fc7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:05:36.573576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af25c6-9bb5-4c81-a3e6-ce804ad45fc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:36.575001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af25c6-9bb5-4c81-a3e6-ce804ad45fc7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:36.580488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 651/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Jul 21 12:05:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:05:36.586499 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cfc37-9657-410a-ac08-592d96fdd102 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:05:36.691435 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cfc37-9657-410a-ac08-592d96fdd102 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:05:36.726757 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f9c62-b086-4165-9131-a68c1a999c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:05:36.727450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9c62-b086-4165-9131-a68c1a999c0c None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:05:36.727734 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9c62-b086-4165-9131-a68c1a999c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:05:36.728009 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9c62-b086-4165-9131-a68c1a999c0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:05:36.728785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f9c62-b086-4165-9131-a68c1a999c0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:05:36.730210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f9c62-b086-4165-9131-a68c1a999c0c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:05:36.752982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 655/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jul 21 12:05:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:05:46.577923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=30 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:05:46.747827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:06:45.445380 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912db36-3045-45ee-a46b-d46e490cd4aa None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:45.445837 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912db36-3045-45ee-a46b-d46e490cd4aa None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:45.446121 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912db36-3045-45ee-a46b-d46e490cd4aa None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:45.448495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 652/1307] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:06:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:06:45.454743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834a892-b57e-4e9d-aa37-521ec1d12bc5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:45.455765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834a892-b57e-4e9d-aa37-521ec1d12bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:45.456218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834a892-b57e-4e9d-aa37-521ec1d12bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:45.669450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3834a892-b57e-4e9d-aa37-521ec1d12bc5 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:06:45.670757 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3834a892-b57e-4e9d-aa37-521ec1d12bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:45.982319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 656/1308] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:06:46.058572 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0425db-745b-47e2-ba23-2a545af84021 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:46.059518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0425db-745b-47e2-ba23-2a545af84021 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:46.059518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0425db-745b-47e2-ba23-2a545af84021 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:46.062375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 653/1309] 10.222.0.15 () {54 vars in 965 bytes} [Thu Jul 21 12:06:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:06:46.073675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e090b8e-6297-4473-86cc-e87343426921 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:46.074097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e090b8e-6297-4473-86cc-e87343426921 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:46.074500 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e090b8e-6297-4473-86cc-e87343426921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:46.196929 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3e090b8e-6297-4473-86cc-e87343426921 None None] MFA Rules not processed for user `88cfd88c19fd4c979e921e3d8cd9cc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:06:46.199240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3e090b8e-6297-4473-86cc-e87343426921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:46.230794 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:06:46.309455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 657/1310] 10.222.0.15 () {58 vars in 1062 bytes} [Thu Jul 21 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:06:46.319486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0425db-745b-47e2-ba23-2a545af84021 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:06:46.321618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bc0425db-745b-47e2-ba23-2a545af84021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:46.490795 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0425db-745b-47e2-ba23-2a545af84021 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:06:46.597428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b529f4-e16e-4255-8df5-6544f28254c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:06:46.598142 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b529f4-e16e-4255-8df5-6544f28254c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:46.598463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b529f4-e16e-4255-8df5-6544f28254c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:46.598774 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b529f4-e16e-4255-8df5-6544f28254c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:46.600583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d7b529f4-e16e-4255-8df5-6544f28254c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:46.672106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:06:46.741243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b529f4-e16e-4255-8df5-6544f28254c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:06:46.742739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b529f4-e16e-4255-8df5-6544f28254c7 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:06:46.764093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 654/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:06:49.575850 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fd09d-6cc6-473d-8ab4-669bba0bbe5e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:49.576456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fd09d-6cc6-473d-8ab4-669bba0bbe5e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:49.576679 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fd09d-6cc6-473d-8ab4-669bba0bbe5e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:49.578261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 658/1312] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:06:49.584303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86e5bb-b610-4ea0-a80a-597ba962aeb4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:49.584857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86e5bb-b610-4ea0-a80a-597ba962aeb4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:49.584857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86e5bb-b610-4ea0-a80a-597ba962aeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:49.672627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8c86e5bb-b610-4ea0-a80a-597ba962aeb4 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:06:49.673908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8c86e5bb-b610-4ea0-a80a-597ba962aeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:49.797121 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 655/1313] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:06:49.849339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9437a5-e979-4d91-ac80-c22c5ec8cbce None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:49.849733 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9437a5-e979-4d91-ac80-c22c5ec8cbce None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:49.850712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9437a5-e979-4d91-ac80-c22c5ec8cbce None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:49.851460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 659/1314] 10.222.0.15 () {54 vars in 965 bytes} [Thu Jul 21 12:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:06:49.857962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633abd6d-af73-410c-af05-1af9e71c86a9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:49.858243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633abd6d-af73-410c-af05-1af9e71c86a9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:49.858521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633abd6d-af73-410c-af05-1af9e71c86a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:49.869457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:06:49.937144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-633abd6d-af73-410c-af05-1af9e71c86a9 None None] MFA Rules not processed for user `88cfd88c19fd4c979e921e3d8cd9cc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:06:49.938735 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-633abd6d-af73-410c-af05-1af9e71c86a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:50.024666 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 656/1315] 10.222.0.15 () {58 vars in 1062 bytes} [Thu Jul 21 12:06:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:06:50.033898 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9437a5-e979-4d91-ac80-c22c5ec8cbce None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:06:50.035516 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0e9437a5-e979-4d91-ac80-c22c5ec8cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:50.151606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9437a5-e979-4d91-ac80-c22c5ec8cbce None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:06:50.224489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:06:50.227043 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a302fe0-09bf-4c60-93c2-fd3210cb58ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:06:50.227681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a302fe0-09bf-4c60-93c2-fd3210cb58ab service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:50.227978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a302fe0-09bf-4c60-93c2-fd3210cb58ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:50.228256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a302fe0-09bf-4c60-93c2-fd3210cb58ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:50.230493 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8a302fe0-09bf-4c60-93c2-fd3210cb58ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:50.345108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a302fe0-09bf-4c60-93c2-fd3210cb58ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:06:50.346456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a302fe0-09bf-4c60-93c2-fd3210cb58ab service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:06:50.365445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 660/1316] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:06:52.916768 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da2c3a-aa4f-44bc-88f9-6b81c6271fcd None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:52.917329 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da2c3a-aa4f-44bc-88f9-6b81c6271fcd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:52.917329 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da2c3a-aa4f-44bc-88f9-6b81c6271fcd None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:52.918719 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 657/1317] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:06:52.924654 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635b780-84df-440b-afe6-c3d4d873e657 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:52.925092 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635b780-84df-440b-afe6-c3d4d873e657 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:52.925180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635b780-84df-440b-afe6-c3d4d873e657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:52.994509 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4635b780-84df-440b-afe6-c3d4d873e657 None None] MFA Rules not processed for user `657bc6f8a9e94103a48d2fc9f788ad38`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:06:52.995755 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4635b780-84df-440b-afe6-c3d4d873e657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:53.050209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:06:53.100008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 661/1318] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:06:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:06:53.140683 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da2c3a-aa4f-44bc-88f9-6b81c6271fcd None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:06:53.142468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-10da2c3a-aa4f-44bc-88f9-6b81c6271fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:53.251418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da2c3a-aa4f-44bc-88f9-6b81c6271fcd None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:06:53.254619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:06:53.330697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87e5c2-f3bf-450f-a51e-adf93a5fc544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:06:53.331414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87e5c2-f3bf-450f-a51e-adf93a5fc544 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:53.331694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87e5c2-f3bf-450f-a51e-adf93a5fc544 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:53.331970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87e5c2-f3bf-450f-a51e-adf93a5fc544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:53.333659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6b87e5c2-f3bf-450f-a51e-adf93a5fc544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:53.448908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87e5c2-f3bf-450f-a51e-adf93a5fc544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:06:53.450431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87e5c2-f3bf-450f-a51e-adf93a5fc544 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:06:53.475080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 658/1319] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:06:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:06:56.102256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d06cf-27d0-4148-9c38-bd5b137e3198 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:56.102723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d06cf-27d0-4148-9c38-bd5b137e3198 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:56.103003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d06cf-27d0-4148-9c38-bd5b137e3198 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:56.104247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 662/1320] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:06:56.111052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b671c8-e401-4ffc-922f-0b7159bdf6be None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:56.111754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b671c8-e401-4ffc-922f-0b7159bdf6be None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:56.111911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b671c8-e401-4ffc-922f-0b7159bdf6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:56.156124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:06:56.184376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-28b671c8-e401-4ffc-922f-0b7159bdf6be None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:06:56.185613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-28b671c8-e401-4ffc-922f-0b7159bdf6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:56.300640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 659/1321] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:06:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:06:56.340758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d06cf-27d0-4148-9c38-bd5b137e3198 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:06:56.343195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bd8d06cf-27d0-4148-9c38-bd5b137e3198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:56.450983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d06cf-27d0-4148-9c38-bd5b137e3198 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:06:56.526768 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc61a0-a00d-4c76-9f64-0186c407677b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:06:56.527417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc61a0-a00d-4c76-9f64-0186c407677b service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:56.527706 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc61a0-a00d-4c76-9f64-0186c407677b service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:56.527974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc61a0-a00d-4c76-9f64-0186c407677b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:56.529624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-51bc61a0-a00d-4c76-9f64-0186c407677b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:56.537804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:06:56.649884 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc61a0-a00d-4c76-9f64-0186c407677b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:06:56.651365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc61a0-a00d-4c76-9f64-0186c407677b service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:06:56.670554 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 663/1322] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:06:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:06:59.487993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffce42-3ba1-4370-b58a-bfaba8c61e4d None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:59.488646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffce42-3ba1-4370-b58a-bfaba8c61e4d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:59.488646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffce42-3ba1-4370-b58a-bfaba8c61e4d None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:59.490002 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 660/1323] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:06:59.495679 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546050d4-6418-4957-acbf-696da4cf114b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:59.496293 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546050d4-6418-4957-acbf-696da4cf114b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:59.496293 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546050d4-6418-4957-acbf-696da4cf114b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:59.565165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-546050d4-6418-4957-acbf-696da4cf114b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:06:59.566426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-546050d4-6418-4957-acbf-696da4cf114b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:59.648659 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:06:59.700555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 664/1324] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:06:59.738413 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffce42-3ba1-4370-b58a-bfaba8c61e4d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:06:59.740112 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-74ffce42-3ba1-4370-b58a-bfaba8c61e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:06:59.873305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffce42-3ba1-4370-b58a-bfaba8c61e4d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:06:59.888645 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:06:59.959255 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a682a-5222-4030-8392-5c6bd3b4bc3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:06:59.959921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a682a-5222-4030-8392-5c6bd3b4bc3d service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:06:59.960205 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a682a-5222-4030-8392-5c6bd3b4bc3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:06:59.960478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a682a-5222-4030-8392-5c6bd3b4bc3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:06:59.962172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c68a682a-5222-4030-8392-5c6bd3b4bc3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:00.093525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a682a-5222-4030-8392-5c6bd3b4bc3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:00.095047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a682a-5222-4030-8392-5c6bd3b4bc3d service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:00.116817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 661/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:07:02.258132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa6177-3a01-43cc-8c0e-b2bbd1de992f None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:02.258736 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa6177-3a01-43cc-8c0e-b2bbd1de992f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:02.258736 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa6177-3a01-43cc-8c0e-b2bbd1de992f None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:02.260131 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 665/1326] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:02.265815 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27f29-c2e9-4286-b448-bb1d4c298766 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:02.266320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27f29-c2e9-4286-b448-bb1d4c298766 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:02.266320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27f29-c2e9-4286-b448-bb1d4c298766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:02.319319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:02.339565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-84a27f29-c2e9-4286-b448-bb1d4c298766 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:02.340805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-84a27f29-c2e9-4286-b448-bb1d4c298766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:02.463886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 662/1327] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:02.500978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa6177-3a01-43cc-8c0e-b2bbd1de992f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:07:02.502557 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-73fa6177-3a01-43cc-8c0e-b2bbd1de992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:02.623240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa6177-3a01-43cc-8c0e-b2bbd1de992f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:07:02.703148 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0278fb0-ef7b-4800-9c4f-b6cb33ae9301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:07:02.703843 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0278fb0-ef7b-4800-9c4f-b6cb33ae9301 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:02.704126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0278fb0-ef7b-4800-9c4f-b6cb33ae9301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:02.704398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0278fb0-ef7b-4800-9c4f-b6cb33ae9301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:02.706226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b0278fb0-ef7b-4800-9c4f-b6cb33ae9301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:02.728344 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:02.843091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0278fb0-ef7b-4800-9c4f-b6cb33ae9301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:02.844574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0278fb0-ef7b-4800-9c4f-b6cb33ae9301 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:02.865630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 666/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:07:04.990770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95896a57-200b-4609-b8f2-d59971c3e519 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:04.991428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95896a57-200b-4609-b8f2-d59971c3e519 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:04.991428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95896a57-200b-4609-b8f2-d59971c3e519 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:04.992770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 663/1329] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:04.998871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206c67d-7e5e-4d3d-a5f7-0d328178d5ad None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:04.999423 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206c67d-7e5e-4d3d-a5f7-0d328178d5ad None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:04.999544 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206c67d-7e5e-4d3d-a5f7-0d328178d5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:05.075708 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9206c67d-7e5e-4d3d-a5f7-0d328178d5ad None None] MFA Rules not processed for user `657bc6f8a9e94103a48d2fc9f788ad38`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:05.076997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9206c67d-7e5e-4d3d-a5f7-0d328178d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:05.155145 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:05.217596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 667/1330] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:07:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:05.259869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95896a57-200b-4609-b8f2-d59971c3e519 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:07:05.261876 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-95896a57-200b-4609-b8f2-d59971c3e519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:05.379036 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95896a57-200b-4609-b8f2-d59971c3e519 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:07:05.403283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:05.477631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40849322-165e-48fd-a6b8-e7b5f72ee740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:07:05.478306 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40849322-165e-48fd-a6b8-e7b5f72ee740 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:05.478588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40849322-165e-48fd-a6b8-e7b5f72ee740 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:05.478892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40849322-165e-48fd-a6b8-e7b5f72ee740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:05.480654 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-40849322-165e-48fd-a6b8-e7b5f72ee740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:05.628068 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40849322-165e-48fd-a6b8-e7b5f72ee740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:05.629661 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40849322-165e-48fd-a6b8-e7b5f72ee740 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:05.654279 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 664/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:07:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:07:08.160200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16959-b508-4571-897f-6266dde5dc61 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:08.160808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16959-b508-4571-897f-6266dde5dc61 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:08.160808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16959-b508-4571-897f-6266dde5dc61 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:08.163082 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 668/1332] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:08.168930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6e22-8d0f-43c8-901b-88dfb95f974a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:08.169436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6e22-8d0f-43c8-901b-88dfb95f974a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:08.169436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6e22-8d0f-43c8-901b-88dfb95f974a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:08.238618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:08.241121 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d84b6e22-8d0f-43c8-901b-88dfb95f974a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:08.242899 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d84b6e22-8d0f-43c8-901b-88dfb95f974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:08.351328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 665/1333] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:08.387990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce16959-b508-4571-897f-6266dde5dc61 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:07:08.389622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-cce16959-b508-4571-897f-6266dde5dc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:08.517149 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce16959-b508-4571-897f-6266dde5dc61 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:07:08.594084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4234b5-c905-4fbe-b18d-899a0a760de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:07:08.594847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4234b5-c905-4fbe-b18d-899a0a760de2 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:08.595133 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4234b5-c905-4fbe-b18d-899a0a760de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:08.595403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4234b5-c905-4fbe-b18d-899a0a760de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:08.597108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8c4234b5-c905-4fbe-b18d-899a0a760de2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:08.625851 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:08.716319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4234b5-c905-4fbe-b18d-899a0a760de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:08.717659 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4234b5-c905-4fbe-b18d-899a0a760de2 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:08.736781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 669/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:07:10.795156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e685517-4cc3-41b7-bfe4-c2ab7a58b572 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:10.795733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e685517-4cc3-41b7-bfe4-c2ab7a58b572 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:10.795733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e685517-4cc3-41b7-bfe4-c2ab7a58b572 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:10.797098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 666/1335] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:10.802758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bc9f0-e7af-4d03-9bcf-b0deeeb80520 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:10.803226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bc9f0-e7af-4d03-9bcf-b0deeeb80520 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:10.803317 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bc9f0-e7af-4d03-9bcf-b0deeeb80520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:10.874974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b57bc9f0-e7af-4d03-9bcf-b0deeeb80520 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:10.876238 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b57bc9f0-e7af-4d03-9bcf-b0deeeb80520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:10.964905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:10.993080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 670/1336] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:11.034384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e685517-4cc3-41b7-bfe4-c2ab7a58b572 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:07:11.036024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4e685517-4cc3-41b7-bfe4-c2ab7a58b572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:11.145038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e685517-4cc3-41b7-bfe4-c2ab7a58b572 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:07:11.174411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:11.226533 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06492e-f578-4c73-8e3e-e96fb076f9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:07:11.227245 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06492e-f578-4c73-8e3e-e96fb076f9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:11.227530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06492e-f578-4c73-8e3e-e96fb076f9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:11.227834 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06492e-f578-4c73-8e3e-e96fb076f9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:11.229618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cb06492e-f578-4c73-8e3e-e96fb076f9b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:11.367015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06492e-f578-4c73-8e3e-e96fb076f9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:11.368490 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06492e-f578-4c73-8e3e-e96fb076f9b8 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:11.388866 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 667/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:07:13.770996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd2fc2-d8be-434d-b9d2-f847bc1dda3c None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:13.771565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd2fc2-d8be-434d-b9d2-f847bc1dda3c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:13.771565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd2fc2-d8be-434d-b9d2-f847bc1dda3c None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:13.772920 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 671/1338] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:13.778599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df209b-643b-4c19-ae08-22e5a382b49f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:13.779379 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df209b-643b-4c19-ae08-22e5a382b49f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:13.779564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df209b-643b-4c19-ae08-22e5a382b49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:13.856050 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-38df209b-643b-4c19-ae08-22e5a382b49f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:13.857277 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-38df209b-643b-4c19-ae08-22e5a382b49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:13.866461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:13.968429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 668/1339] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:07:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:14.004709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd2fc2-d8be-434d-b9d2-f847bc1dda3c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:07:14.006256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6ebd2fc2-d8be-434d-b9d2-f847bc1dda3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:14.123425 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd2fc2-d8be-434d-b9d2-f847bc1dda3c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:07:14.205405 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2a8a5-2556-4657-8bba-65bd8befd480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:07:14.206071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a8a5-2556-4657-8bba-65bd8befd480 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:14.206358 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a8a5-2556-4657-8bba-65bd8befd480 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:14.206804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a8a5-2556-4657-8bba-65bd8befd480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:14.208508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-45d2a8a5-2556-4657-8bba-65bd8befd480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:14.250072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:14.341144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2a8a5-2556-4657-8bba-65bd8befd480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:14.342584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2a8a5-2556-4657-8bba-65bd8befd480 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:14.362626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 672/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:07:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:07:18.803429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882507-f2fe-4b2d-b76b-5175ea5ab867 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:18.804052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882507-f2fe-4b2d-b76b-5175ea5ab867 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:18.804052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882507-f2fe-4b2d-b76b-5175ea5ab867 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:18.806227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 669/1341] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:07:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:18.813279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60186ee0-5f5c-4620-89a3-20dcc57e59e5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:18.814379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60186ee0-5f5c-4620-89a3-20dcc57e59e5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:18.814901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60186ee0-5f5c-4620-89a3-20dcc57e59e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:18.901738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-60186ee0-5f5c-4620-89a3-20dcc57e59e5 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:18.903142 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-60186ee0-5f5c-4620-89a3-20dcc57e59e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:19.014724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:19.028097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 673/1342] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:07:19.069501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882507-f2fe-4b2d-b76b-5175ea5ab867 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:07:19.071463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-45882507-f2fe-4b2d-b76b-5175ea5ab867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:19.204536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882507-f2fe-4b2d-b76b-5175ea5ab867 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:07:19.249601 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:19.293185 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b1214-af0a-4bd9-a326-0cf43f2aa09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:07:19.293855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b1214-af0a-4bd9-a326-0cf43f2aa09b service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:19.294132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b1214-af0a-4bd9-a326-0cf43f2aa09b service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:19.294401 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b1214-af0a-4bd9-a326-0cf43f2aa09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:19.296183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4d9b1214-af0a-4bd9-a326-0cf43f2aa09b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:19.440006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b1214-af0a-4bd9-a326-0cf43f2aa09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:19.441614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b1214-af0a-4bd9-a326-0cf43f2aa09b service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:19.465113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 670/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:07:22.333731 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6befc31-3b92-4fc7-899a-9b5c0ef03112 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:22.334417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6befc31-3b92-4fc7-899a-9b5c0ef03112 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:22.334417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6befc31-3b92-4fc7-899a-9b5c0ef03112 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:22.336423 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 674/1344] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:22.342950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34bfad-afc4-4e63-b074-1093d22d7807 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:22.343650 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34bfad-afc4-4e63-b074-1093d22d7807 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:22.343650 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34bfad-afc4-4e63-b074-1093d22d7807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:22.425312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ee34bfad-afc4-4e63-b074-1093d22d7807 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:22.426544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ee34bfad-afc4-4e63-b074-1093d22d7807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:22.452802 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:22.553559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 671/1345] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:07:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:22.591679 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6befc31-3b92-4fc7-899a-9b5c0ef03112 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:07:22.593273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f6befc31-3b92-4fc7-899a-9b5c0ef03112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:22.717085 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6befc31-3b92-4fc7-899a-9b5c0ef03112 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:07:22.812361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779c5fc-4eda-407c-8cbc-4e0b3b3aca22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:07:22.813106 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779c5fc-4eda-407c-8cbc-4e0b3b3aca22 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:22.813397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779c5fc-4eda-407c-8cbc-4e0b3b3aca22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:22.813679 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779c5fc-4eda-407c-8cbc-4e0b3b3aca22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:22.815438 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3779c5fc-4eda-407c-8cbc-4e0b3b3aca22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:22.863389 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:22.939391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779c5fc-4eda-407c-8cbc-4e0b3b3aca22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:22.940977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779c5fc-4eda-407c-8cbc-4e0b3b3aca22 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:22.962166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 675/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:07:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:07:27.295875 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93997bad-09e6-469d-a800-5ba8c2714f5a None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:27.296478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93997bad-09e6-469d-a800-5ba8c2714f5a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:27.296478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93997bad-09e6-469d-a800-5ba8c2714f5a None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:27.297847 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 672/1347] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:27.303738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d757f5-0614-4832-80a1-f5ec493347c0 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:27.304273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d757f5-0614-4832-80a1-f5ec493347c0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:27.304273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d757f5-0614-4832-80a1-f5ec493347c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:27.390031 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-15d757f5-0614-4832-80a1-f5ec493347c0 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:27.391280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-15d757f5-0614-4832-80a1-f5ec493347c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:27.513861 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:27.517213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 676/1348] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:27.559920 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93997bad-09e6-469d-a800-5ba8c2714f5a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:07:27.561898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-93997bad-09e6-469d-a800-5ba8c2714f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:27.686927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93997bad-09e6-469d-a800-5ba8c2714f5a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:07:27.740971 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:27.770977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0f5ed-0d0f-4438-9473-7c80d247c1d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:07:27.771649 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0f5ed-0d0f-4438-9473-7c80d247c1d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:27.771904 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0f5ed-0d0f-4438-9473-7c80d247c1d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:27.772180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0f5ed-0d0f-4438-9473-7c80d247c1d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:27.773908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-78b0f5ed-0d0f-4438-9473-7c80d247c1d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:27.914470 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0f5ed-0d0f-4438-9473-7c80d247c1d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:27.916093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0f5ed-0d0f-4438-9473-7c80d247c1d2 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:27.940342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 673/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:07:33.232634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169ee46-558d-4f3a-8c1a-1eef7cda8b72 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:33.233166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169ee46-558d-4f3a-8c1a-1eef7cda8b72 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:33.233166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169ee46-558d-4f3a-8c1a-1eef7cda8b72 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:33.234919 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 677/1350] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jul 21 12:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:07:33.244500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4bcd6-c304-4fac-8967-4d1040b3cb74 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:33.245558 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4bcd6-c304-4fac-8967-4d1040b3cb74 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:33.246033 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4bcd6-c304-4fac-8967-4d1040b3cb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:33.364052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2ee4bcd6-c304-4fac-8967-4d1040b3cb74 None None] MFA Rules not processed for user `06c172bcd99f469f83728c98d061a7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:33.365661 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2ee4bcd6-c304-4fac-8967-4d1040b3cb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:33.392059 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:33.542713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 674/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jul 21 12:07:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:07:39.213138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa94705-308c-452c-a8ee-8ade03f2738c None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:39.213138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa94705-308c-452c-a8ee-8ade03f2738c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:39.214104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa94705-308c-452c-a8ee-8ade03f2738c None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:39.215033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 678/1352] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jul 21 12:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:39.221237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acdc5b-517d-40b3-a785-7a45a92de17e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:39.222586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acdc5b-517d-40b3-a785-7a45a92de17e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:39.222586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acdc5b-517d-40b3-a785-7a45a92de17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:39.312472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-88acdc5b-517d-40b3-a785-7a45a92de17e None None] MFA Rules not processed for user `06c172bcd99f469f83728c98d061a7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:39.313709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-88acdc5b-517d-40b3-a785-7a45a92de17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:39.392586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:39.440311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 675/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jul 21 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:40.810297 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432e027-93a5-4811-b5cd-3b45d0f24d0a None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:40.811178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432e027-93a5-4811-b5cd-3b45d0f24d0a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:40.811178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432e027-93a5-4811-b5cd-3b45d0f24d0a None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:40.812653 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 679/1354] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jul 21 12:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:40.819224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a9f9c-7363-4104-9860-b6a8d1a7ccc3 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:40.819873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a9f9c-7363-4104-9860-b6a8d1a7ccc3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:40.820309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a9f9c-7363-4104-9860-b6a8d1a7ccc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:40.946802 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c67a9f9c-7363-4104-9860-b6a8d1a7ccc3 None None] MFA Rules not processed for user `06c172bcd99f469f83728c98d061a7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:40.948188 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c67a9f9c-7363-4104-9860-b6a8d1a7ccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:41.092028 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 676/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jul 21 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:44.530506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a1584-55a7-4529-8575-0a2144ae6370 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:44.531095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a1584-55a7-4529-8575-0a2144ae6370 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:44.531432 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a1584-55a7-4529-8575-0a2144ae6370 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:44.533103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 680/1356] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:07:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:44.539433 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1833a-1564-468f-948e-ef7d4556e040 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:44.540171 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1833a-1564-468f-948e-ef7d4556e040 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:44.540171 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1833a-1564-468f-948e-ef7d4556e040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:44.609530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:44.668621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-85e1833a-1564-468f-948e-ef7d4556e040 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:44.672592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-85e1833a-1564-468f-948e-ef7d4556e040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:44.835067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 677/1357] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:44.892388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab3c60-9cd9-4052-b9b3-2ab0b4299c84 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:44.893163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab3c60-9cd9-4052-b9b3-2ab0b4299c84 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:44.893796 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab3c60-9cd9-4052-b9b3-2ab0b4299c84 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:44.895831 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 681/1358] 10.222.0.15 () {54 vars in 962 bytes} [Thu Jul 21 12:07:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:44.909013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ef655-c37e-45c0-bdab-d0c8024e4c21 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:44.910833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ef655-c37e-45c0-bdab-d0c8024e4c21 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:44.911706 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ef655-c37e-45c0-bdab-d0c8024e4c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:45.040104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4b4ef655-c37e-45c0-bdab-d0c8024e4c21 None None] MFA Rules not processed for user `f3fb1d091b27472081549f4166ca172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:45.042603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4b4ef655-c37e-45c0-bdab-d0c8024e4c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:45.125571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:45.225302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 678/1359] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Jul 21 12:07:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:45.236187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab3c60-9cd9-4052-b9b3-2ab0b4299c84 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:07:45.237949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a4ab3c60-9cd9-4052-b9b3-2ab0b4299c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:45.485065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab3c60-9cd9-4052-b9b3-2ab0b4299c84 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:07:45.616706 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:45.687274 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34f5b4-6672-457d-8b9d-2bf8052c6790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:07:45.688178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f5b4-6672-457d-8b9d-2bf8052c6790 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:45.688491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f5b4-6672-457d-8b9d-2bf8052c6790 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:45.688762 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f5b4-6672-457d-8b9d-2bf8052c6790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:45.691073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1a34f5b4-6672-457d-8b9d-2bf8052c6790 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:45.867398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34f5b4-6672-457d-8b9d-2bf8052c6790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:45.870168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34f5b4-6672-457d-8b9d-2bf8052c6790 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:45.900297 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 682/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:07:48.715603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dac36-718d-4558-9de7-4c7120fd52b9 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:48.717123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dac36-718d-4558-9de7-4c7120fd52b9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:48.717766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dac36-718d-4558-9de7-4c7120fd52b9 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:48.720481 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 679/1361] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:07:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:48.728240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5006594-9876-4908-a595-282723ab0d03 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:48.728969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5006594-9876-4908-a595-282723ab0d03 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:48.729141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5006594-9876-4908-a595-282723ab0d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:48.825107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c5006594-9876-4908-a595-282723ab0d03 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:48.826763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c5006594-9876-4908-a595-282723ab0d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:48.904575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:49.020658 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 683/1362] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:49.073470 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dac36-718d-4558-9de7-4c7120fd52b9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:07:49.075224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-195dac36-718d-4558-9de7-4c7120fd52b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:49.305321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dac36-718d-4558-9de7-4c7120fd52b9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:07:49.324018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:49.498015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86359523-cab0-4a1f-b2b1-3df072cfe724 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:07:49.498783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86359523-cab0-4a1f-b2b1-3df072cfe724 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:49.499065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86359523-cab0-4a1f-b2b1-3df072cfe724 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:49.499315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86359523-cab0-4a1f-b2b1-3df072cfe724 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:49.501070 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-86359523-cab0-4a1f-b2b1-3df072cfe724 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:49.610009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86359523-cab0-4a1f-b2b1-3df072cfe724 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:49.611646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86359523-cab0-4a1f-b2b1-3df072cfe724 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:49.643852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 680/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:07:52.066194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3d1e1-8b00-4422-b665-d0a8efb3ef05 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:52.067006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3d1e1-8b00-4422-b665-d0a8efb3ef05 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:52.067445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3d1e1-8b00-4422-b665-d0a8efb3ef05 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:52.069919 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 684/1364] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:07:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:52.076813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6faa7-7495-42e5-8627-7416d567fa27 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:52.077640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6faa7-7495-42e5-8627-7416d567fa27 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:52.077640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6faa7-7495-42e5-8627-7416d567fa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:52.093238 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:52.156167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1aa6faa7-7495-42e5-8627-7416d567fa27 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:52.157692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1aa6faa7-7495-42e5-8627-7416d567fa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:52.316766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 681/1365] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:07:52.387817 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1eb73-2819-489a-aa48-4d41b6d404b3 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:52.388300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1eb73-2819-489a-aa48-4d41b6d404b3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:52.388774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1eb73-2819-489a-aa48-4d41b6d404b3 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:52.391491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 685/1366] 10.222.0.15 () {54 vars in 962 bytes} [Thu Jul 21 12:07:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:52.401739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4b93c-413f-4d08-b5e5-55cde646cad9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:52.402574 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4b93c-413f-4d08-b5e5-55cde646cad9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:52.403233 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4b93c-413f-4d08-b5e5-55cde646cad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:52.538221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ceb4b93c-413f-4d08-b5e5-55cde646cad9 None None] MFA Rules not processed for user `f3fb1d091b27472081549f4166ca172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:52.539925 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ceb4b93c-413f-4d08-b5e5-55cde646cad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:52.590081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:52.712119 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 682/1367] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Jul 21 12:07:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:52.733462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1eb73-2819-489a-aa48-4d41b6d404b3 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:07:52.738213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-99c1eb73-2819-489a-aa48-4d41b6d404b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:52.987559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1eb73-2819-489a-aa48-4d41b6d404b3 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:07:53.034478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:53.185663 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa540ac7-d15f-47a3-897b-8e853ed61243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:07:53.187231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa540ac7-d15f-47a3-897b-8e853ed61243 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:53.187706 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa540ac7-d15f-47a3-897b-8e853ed61243 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:53.188176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa540ac7-d15f-47a3-897b-8e853ed61243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:53.192048 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-fa540ac7-d15f-47a3-897b-8e853ed61243 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:53.345340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa540ac7-d15f-47a3-897b-8e853ed61243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:53.347453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa540ac7-d15f-47a3-897b-8e853ed61243 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:53.372300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 686/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:07:53.627082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f38da-5499-4284-b336-def390e15592 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:53.627926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f38da-5499-4284-b336-def390e15592 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:53.627926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f38da-5499-4284-b336-def390e15592 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:53.629567 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 683/1369] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:53.635905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d51bb-7163-469d-ac6b-a122c9d38154 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:53.636257 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d51bb-7163-469d-ac6b-a122c9d38154 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:53.636464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d51bb-7163-469d-ac6b-a122c9d38154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:53.683767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:53.731162 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-aa2d51bb-7163-469d-ac6b-a122c9d38154 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:53.732881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-aa2d51bb-7163-469d-ac6b-a122c9d38154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:53.846710 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 687/1370] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:07:54.154143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0e785-00ca-4967-a5ca-421a6a7a0b51 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:54.154464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0e785-00ca-4967-a5ca-421a6a7a0b51 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:54.154934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0e785-00ca-4967-a5ca-421a6a7a0b51 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:54.156655 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 684/1371] 10.222.0.15 () {54 vars in 964 bytes} [Thu Jul 21 12:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:54.167147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516b846-78d3-4392-8762-62106bbac78a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:54.167728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516b846-78d3-4392-8762-62106bbac78a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:54.168044 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516b846-78d3-4392-8762-62106bbac78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:54.263311 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0516b846-78d3-4392-8762-62106bbac78a None None] MFA Rules not processed for user `2af1aad6bd5c486192345b3747ed3e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:54.264561 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0516b846-78d3-4392-8762-62106bbac78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:54.340131 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:54.371880 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 688/1372] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Jul 21 12:07:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:54.379490 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0e785-00ca-4967-a5ca-421a6a7a0b51 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:07:54.381018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-02f0e785-00ca-4967-a5ca-421a6a7a0b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:54.522100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0e785-00ca-4967-a5ca-421a6a7a0b51 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:07:54.601141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:54.660564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39582cfe-e7bf-4bdf-a544-003321179771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:07:54.661219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39582cfe-e7bf-4bdf-a544-003321179771 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:54.662117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39582cfe-e7bf-4bdf-a544-003321179771 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:54.662117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39582cfe-e7bf-4bdf-a544-003321179771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:54.664501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-39582cfe-e7bf-4bdf-a544-003321179771 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:54.802309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39582cfe-e7bf-4bdf-a544-003321179771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:54.803988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39582cfe-e7bf-4bdf-a544-003321179771 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:54.826163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 685/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:07:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:07:56.012535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de488b66-fabb-49eb-9c3a-717fe259bd84 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:56.013328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de488b66-fabb-49eb-9c3a-717fe259bd84 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:56.013328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de488b66-fabb-49eb-9c3a-717fe259bd84 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:56.015269 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 689/1374] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:56.023426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75da9e-ff41-4cc4-aed8-2497c9253fc8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:56.023983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75da9e-ff41-4cc4-aed8-2497c9253fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:56.024442 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75da9e-ff41-4cc4-aed8-2497c9253fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:56.111634 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2b75da9e-ff41-4cc4-aed8-2497c9253fc8 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:56.112940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2b75da9e-ff41-4cc4-aed8-2497c9253fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:56.135766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:56.232340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 686/1375] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:56.282519 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de488b66-fabb-49eb-9c3a-717fe259bd84 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:07:56.284413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-de488b66-fabb-49eb-9c3a-717fe259bd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:56.481589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de488b66-fabb-49eb-9c3a-717fe259bd84 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:07:56.546833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:56.625769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a795-4c4d-4e9b-9245-a3f2906a957a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:07:56.626449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a795-4c4d-4e9b-9245-a3f2906a957a service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:56.626752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a795-4c4d-4e9b-9245-a3f2906a957a service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:56.627039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a795-4c4d-4e9b-9245-a3f2906a957a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:56.628842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9480a795-4c4d-4e9b-9245-a3f2906a957a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:56.736021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480a795-4c4d-4e9b-9245-a3f2906a957a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:56.737784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480a795-4c4d-4e9b-9245-a3f2906a957a service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:56.759619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 690/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:07:58.925118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4f2f0-1d68-44ad-a66e-7a9f3cf1a069 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:58.925787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4f2f0-1d68-44ad-a66e-7a9f3cf1a069 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:58.925960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4f2f0-1d68-44ad-a66e-7a9f3cf1a069 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:58.927467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 687/1377] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:07:58.934444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d54e38-2361-4c8f-a190-1a9b2d18350c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:58.935564 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d54e38-2361-4c8f-a190-1a9b2d18350c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:58.935564 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d54e38-2361-4c8f-a190-1a9b2d18350c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:59.012499 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-e8d54e38-2361-4c8f-a190-1a9b2d18350c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:07:59.013694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e8d54e38-2361-4c8f-a190-1a9b2d18350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:59.024385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:59.154056 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 691/1378] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:07:59.207108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4f2f0-1d68-44ad-a66e-7a9f3cf1a069 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:07:59.208766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-93b4f2f0-1d68-44ad-a66e-7a9f3cf1a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:59.430159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4f2f0-1d68-44ad-a66e-7a9f3cf1a069 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:07:59.442608 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:07:59.589981 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09a491-fd96-4243-8a1b-57fa9a61e8df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:07:59.590638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09a491-fd96-4243-8a1b-57fa9a61e8df service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:07:59.590989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09a491-fd96-4243-8a1b-57fa9a61e8df service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:07:59.591321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09a491-fd96-4243-8a1b-57fa9a61e8df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:07:59.593298 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ce09a491-fd96-4243-8a1b-57fa9a61e8df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:07:59.709414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09a491-fd96-4243-8a1b-57fa9a61e8df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:07:59.711372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09a491-fd96-4243-8a1b-57fa9a61e8df service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:07:59.736776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 688/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:08:02.264327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd1de0-904e-463c-ad51-27b3c30a7782 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:02.265174 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd1de0-904e-463c-ad51-27b3c30a7782 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:02.265174 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd1de0-904e-463c-ad51-27b3c30a7782 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:02.266481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 692/1380] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:08:02.272041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264dfd5-2c49-4014-9dd3-cd0040b71c1a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:02.272711 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264dfd5-2c49-4014-9dd3-cd0040b71c1a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:02.272711 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264dfd5-2c49-4014-9dd3-cd0040b71c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:02.283372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:02.349213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5264dfd5-2c49-4014-9dd3-cd0040b71c1a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:02.350433 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5264dfd5-2c49-4014-9dd3-cd0040b71c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:02.501248 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 689/1381] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:08:02.550412 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd1de0-904e-463c-ad51-27b3c30a7782 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:02.552340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5ebd1de0-904e-463c-ad51-27b3c30a7782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:02.711304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:02.725345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd1de0-904e-463c-ad51-27b3c30a7782 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:02.891817 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcfa8a-da90-4f88-a57b-d5b9881b2133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:02.892446 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcfa8a-da90-4f88-a57b-d5b9881b2133 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:02.892742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcfa8a-da90-4f88-a57b-d5b9881b2133 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:02.893221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcfa8a-da90-4f88-a57b-d5b9881b2133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:02.895133 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-57dcfa8a-da90-4f88-a57b-d5b9881b2133 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:03.014516 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcfa8a-da90-4f88-a57b-d5b9881b2133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:03.016347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcfa8a-da90-4f88-a57b-d5b9881b2133 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:03.033904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:03.047075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 693/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:05.323532 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b219e5-37cb-4985-b0aa-6ed999b7a20b None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:05.324202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b219e5-37cb-4985-b0aa-6ed999b7a20b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:05.324202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b219e5-37cb-4985-b0aa-6ed999b7a20b None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:05.325720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 690/1383] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:08:05.332170 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8eb1c-b384-42d2-9653-151846c7a54b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:05.332800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8eb1c-b384-42d2-9653-151846c7a54b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:05.332800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8eb1c-b384-42d2-9653-151846c7a54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:05.418777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d8b8eb1c-b384-42d2-9653-151846c7a54b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:05.420091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d8b8eb1c-b384-42d2-9653-151846c7a54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:05.542560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 694/1384] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:05.590112 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b219e5-37cb-4985-b0aa-6ed999b7a20b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:05.592320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a0b219e5-37cb-4985-b0aa-6ed999b7a20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:05.697334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:05.777315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b219e5-37cb-4985-b0aa-6ed999b7a20b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:05.933331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50fe9c-2c91-4f3d-8077-5cba4fceadaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:05.934214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50fe9c-2c91-4f3d-8077-5cba4fceadaa service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:05.934595 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50fe9c-2c91-4f3d-8077-5cba4fceadaa service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:05.934991 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50fe9c-2c91-4f3d-8077-5cba4fceadaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:05.937427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1c50fe9c-2c91-4f3d-8077-5cba4fceadaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:06.002290 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:06.050547 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50fe9c-2c91-4f3d-8077-5cba4fceadaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:06.052357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50fe9c-2c91-4f3d-8077-5cba4fceadaa service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:06.074854 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 691/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:08:08.181149 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140f139-c70e-4b6a-a460-0ec215ac2547 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:08.181865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140f139-c70e-4b6a-a460-0ec215ac2547 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:08.181865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140f139-c70e-4b6a-a460-0ec215ac2547 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:08.183136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 695/1386] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:08.190548 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48621bd9-ad31-42a7-a4cc-0f0e0bd6b1ba None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:08.192424 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48621bd9-ad31-42a7-a4cc-0f0e0bd6b1ba None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:08.192424 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48621bd9-ad31-42a7-a4cc-0f0e0bd6b1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:08.271714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-48621bd9-ad31-42a7-a4cc-0f0e0bd6b1ba None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:08.273609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-48621bd9-ad31-42a7-a4cc-0f0e0bd6b1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:08.383542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 692/1387] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:08.445610 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140f139-c70e-4b6a-a460-0ec215ac2547 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:08.448356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e140f139-c70e-4b6a-a460-0ec215ac2547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:08.552072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:08.675849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140f139-c70e-4b6a-a460-0ec215ac2547 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:08.841692 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940ed42-c55e-4167-a824-d70d580debd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:08.842388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940ed42-c55e-4167-a824-d70d580debd4 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:08.842702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940ed42-c55e-4167-a824-d70d580debd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:08.842992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940ed42-c55e-4167-a824-d70d580debd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:08.844717 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2940ed42-c55e-4167-a824-d70d580debd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:08.892466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:08.966953 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940ed42-c55e-4167-a824-d70d580debd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:08.968847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940ed42-c55e-4167-a824-d70d580debd4 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:08.994628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 696/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:11.161841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cd51f-16dd-425b-85b1-28ee744d54a5 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:11.162476 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cd51f-16dd-425b-85b1-28ee744d54a5 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:11.162476 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cd51f-16dd-425b-85b1-28ee744d54a5 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:11.163931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 693/1389] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:11.170100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635382ee-7c2e-4199-8207-386564356e87 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:11.171244 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635382ee-7c2e-4199-8207-386564356e87 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:11.171244 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635382ee-7c2e-4199-8207-386564356e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:11.271995 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-635382ee-7c2e-4199-8207-386564356e87 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:11.273940 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-635382ee-7c2e-4199-8207-386564356e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:11.409183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 697/1390] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:11.477144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cd51f-16dd-425b-85b1-28ee744d54a5 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:11.478928 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f35cd51f-16dd-425b-85b1-28ee744d54a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:11.516138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:11.667131 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cd51f-16dd-425b-85b1-28ee744d54a5 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:11.803497 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:11.822173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecad71b-513b-4895-9cb1-378862aa5157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:11.823128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecad71b-513b-4895-9cb1-378862aa5157 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:11.823507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecad71b-513b-4895-9cb1-378862aa5157 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:11.823893 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecad71b-513b-4895-9cb1-378862aa5157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:11.826261 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6ecad71b-513b-4895-9cb1-378862aa5157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:11.945130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecad71b-513b-4895-9cb1-378862aa5157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:11.948134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecad71b-513b-4895-9cb1-378862aa5157 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:11.970586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 694/1391] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:14.113500 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafd5eb-878f-4910-9ac1-5117e91402b3 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:14.114236 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafd5eb-878f-4910-9ac1-5117e91402b3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:14.114236 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafd5eb-878f-4910-9ac1-5117e91402b3 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:14.115732 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 698/1392] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:14.121966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef443e0c-d0c7-4cf0-a6c2-eb003a9f54ae None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:14.122815 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef443e0c-d0c7-4cf0-a6c2-eb003a9f54ae None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:14.122969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef443e0c-d0c7-4cf0-a6c2-eb003a9f54ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:14.213689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ef443e0c-d0c7-4cf0-a6c2-eb003a9f54ae None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:14.215080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ef443e0c-d0c7-4cf0-a6c2-eb003a9f54ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:14.296800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:14.347325 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 695/1393] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:14.394974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafd5eb-878f-4910-9ac1-5117e91402b3 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:14.396585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5dafd5eb-878f-4910-9ac1-5117e91402b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:14.412511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:14.576822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafd5eb-878f-4910-9ac1-5117e91402b3 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:14.671366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:14.701031 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4498e29-5f07-4d1c-8097-b872c7361adc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:14.701718 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4498e29-5f07-4d1c-8097-b872c7361adc service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:14.702001 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4498e29-5f07-4d1c-8097-b872c7361adc service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:14.702276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4498e29-5f07-4d1c-8097-b872c7361adc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:14.704017 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b4498e29-5f07-4d1c-8097-b872c7361adc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:14.829782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4498e29-5f07-4d1c-8097-b872c7361adc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:14.831470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4498e29-5f07-4d1c-8097-b872c7361adc service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:14.852186 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 699/1394] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:16.134643 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6ad1-1c85-47dc-8278-5c3b956da9f9 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:16.135368 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6ad1-1c85-47dc-8278-5c3b956da9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:16.135533 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6ad1-1c85-47dc-8278-5c3b956da9f9 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:16.138014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 696/1395] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:08:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:16.146138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9f260-4d5f-4a79-aeb9-1d6f01e99db0 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:16.147008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9f260-4d5f-4a79-aeb9-1d6f01e99db0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:16.147188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9f260-4d5f-4a79-aeb9-1d6f01e99db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:16.220281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f1f9f260-4d5f-4a79-aeb9-1d6f01e99db0 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:16.221545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f1f9f260-4d5f-4a79-aeb9-1d6f01e99db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:16.278073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:16.330281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 700/1396] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:16.395946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d31bf-309a-4c76-9e71-1a70aef3583b None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:16.396229 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d31bf-309a-4c76-9e71-1a70aef3583b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:16.396570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d31bf-309a-4c76-9e71-1a70aef3583b None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:16.398345 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 697/1397] 10.222.0.15 () {54 vars in 966 bytes} [Thu Jul 21 12:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:16.404282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b011ef-a091-4867-93b3-e68d09e8b793 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:16.404732 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b011ef-a091-4867-93b3-e68d09e8b793 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:16.405566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b011ef-a091-4867-93b3-e68d09e8b793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:16.518143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-70b011ef-a091-4867-93b3-e68d09e8b793 None None] MFA Rules not processed for user `10611bf25b9e4604ad769a6902f7f457`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:16.519478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-70b011ef-a091-4867-93b3-e68d09e8b793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:16.627370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 701/1398] 10.222.0.15 () {58 vars in 1063 bytes} [Thu Jul 21 12:08:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:16.636311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d31bf-309a-4c76-9e71-1a70aef3583b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:16.639094 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-884d31bf-309a-4c76-9e71-1a70aef3583b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:16.776987 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d31bf-309a-4c76-9e71-1a70aef3583b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:16.897460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6084927-9ca1-4002-8866-4417e02d4a65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10611bf25b9e4604ad769a6902f7f457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:16.898807 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6084927-9ca1-4002-8866-4417e02d4a65 service glance] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:16.899831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6084927-9ca1-4002-8866-4417e02d4a65 service glance] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:16.900427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6084927-9ca1-4002-8866-4417e02d4a65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:16.903923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f6084927-9ca1-4002-8866-4417e02d4a65 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:16.939694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:16.968833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031e341-46d9-40c4-a850-8cfaa4c00221 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:16.969090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031e341-46d9-40c4-a850-8cfaa4c00221 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:16.969428 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031e341-46d9-40c4-a850-8cfaa4c00221 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:16.971233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 702/1399] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:08:16.978796 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95601cb3-7f9b-49dd-a425-49f6a7b9a0e3 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:16.979395 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95601cb3-7f9b-49dd-a425-49f6a7b9a0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:16.980009 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95601cb3-7f9b-49dd-a425-49f6a7b9a0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:17.064769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:17.069537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6084927-9ca1-4002-8866-4417e02d4a65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:17.071265 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6084927-9ca1-4002-8866-4417e02d4a65 service glance] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:17.076818 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-95601cb3-7f9b-49dd-a425-49f6a7b9a0e3 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:17.078058 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-95601cb3-7f9b-49dd-a425-49f6a7b9a0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:17.092589 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 698/1400] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:17.225693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 703/1401] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:08:17.271353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6084927-9ca1-4002-8866-4417e02d4a65 service glance] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:17.273136 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f6084927-9ca1-4002-8866-4417e02d4a65 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:17.420813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6084927-9ca1-4002-8866-4417e02d4a65 service glance] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:17.453163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:17.578179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547767ec-ba08-4c34-997d-581cd87ab668 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:17.578882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547767ec-ba08-4c34-997d-581cd87ab668 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:17.579173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547767ec-ba08-4c34-997d-581cd87ab668 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:17.579456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547767ec-ba08-4c34-997d-581cd87ab668 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:17.581128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-547767ec-ba08-4c34-997d-581cd87ab668 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:17.688996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547767ec-ba08-4c34-997d-581cd87ab668 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:17.690449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547767ec-ba08-4c34-997d-581cd87ab668 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:17.711177 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 699/1402] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:17.896163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d0113-bade-49b7-8cb0-7fc6737a31e6 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:17.896524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d0113-bade-49b7-8cb0-7fc6737a31e6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:17.896748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d0113-bade-49b7-8cb0-7fc6737a31e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:17.976691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-317d0113-bade-49b7-8cb0-7fc6737a31e6 None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:17.977853 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-317d0113-bade-49b7-8cb0-7fc6737a31e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:18.058503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:18.073492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 704/1403] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:08:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:18.118076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337734c-f134-4a8a-8889-76e3ba9281c3 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:18.118371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337734c-f134-4a8a-8889-76e3ba9281c3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:18.118684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337734c-f134-4a8a-8889-76e3ba9281c3 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:18.120126 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 700/1404] 10.222.0.15 () {54 vars in 943 bytes} [Thu Jul 21 12:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:18.126862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62113e-f04e-4cff-8122-ffeeec6ded42 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:18.127151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62113e-f04e-4cff-8122-ffeeec6ded42 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:18.127450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62113e-f04e-4cff-8122-ffeeec6ded42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:18.218921 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8b62113e-f04e-4cff-8122-ffeeec6ded42 None None] MFA Rules not processed for user `2dd659c33e0f49dc8edf30bd47737e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:18.220262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8b62113e-f04e-4cff-8122-ffeeec6ded42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:18.349885 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 705/1405] 10.222.0.15 () {58 vars in 1040 bytes} [Thu Jul 21 12:08:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:08:18.360423 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337734c-f134-4a8a-8889-76e3ba9281c3 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:18.363056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7337734c-f134-4a8a-8889-76e3ba9281c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:18.404814 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:18.542201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337734c-f134-4a8a-8889-76e3ba9281c3 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:18.680907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a61aaa-6474-49ba-b592-5dfd57788d9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:18.681459 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61aaa-6474-49ba-b592-5dfd57788d9a service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:18.681734 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61aaa-6474-49ba-b592-5dfd57788d9a service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:18.682002 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61aaa-6474-49ba-b592-5dfd57788d9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:18.683771 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c8a61aaa-6474-49ba-b592-5dfd57788d9a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:18.705114 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:18.796922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a61aaa-6474-49ba-b592-5dfd57788d9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:18.798983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a61aaa-6474-49ba-b592-5dfd57788d9a service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:18.815252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 701/1406] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:08:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 12:08:19.946926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0ff0c-95e0-4dd8-9660-aea7868b2804 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:19.947503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0ff0c-95e0-4dd8-9660-aea7868b2804 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:19.947503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0ff0c-95e0-4dd8-9660-aea7868b2804 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:19.948885 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 706/1407] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:08:19.956426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12d96c-421e-42af-b212-c62d055f44d3 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:19.957542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12d96c-421e-42af-b212-c62d055f44d3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:19.958013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12d96c-421e-42af-b212-c62d055f44d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:20.064052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2d12d96c-421e-42af-b212-c62d055f44d3 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:20.065334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2d12d96c-421e-42af-b212-c62d055f44d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:20.239159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 702/1408] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:20.319802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0ff0c-95e0-4dd8-9660-aea7868b2804 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:20.323727 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-eff0ff0c-95e0-4dd8-9660-aea7868b2804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:20.431526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:20.564572 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0ff0c-95e0-4dd8-9660-aea7868b2804 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:20.716318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb08c4-baaf-40d4-b374-2870245414b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:20.716977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb08c4-baaf-40d4-b374-2870245414b1 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:20.717258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb08c4-baaf-40d4-b374-2870245414b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:20.717530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb08c4-baaf-40d4-b374-2870245414b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:20.719231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4beb08c4-baaf-40d4-b374-2870245414b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:20.729582 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:20.853259 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb08c4-baaf-40d4-b374-2870245414b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:20.855387 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb08c4-baaf-40d4-b374-2870245414b1 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:20.880590 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 707/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:08:30.233576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:30.877815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=41 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:41.000609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee356ad-924f-4699-868a-e7e7ef0f34fa None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:41.001219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee356ad-924f-4699-868a-e7e7ef0f34fa None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:41.001219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee356ad-924f-4699-868a-e7e7ef0f34fa None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:41.002573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 703/1410] 10.222.0.15 () {54 vars in 918 bytes} [Thu Jul 21 12:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:41.008081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97375bd0-75e4-46e7-b328-d257cd736d6e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:41.008549 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97375bd0-75e4-46e7-b328-d257cd736d6e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:41.008655 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97375bd0-75e4-46e7-b328-d257cd736d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:41.085385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-97375bd0-75e4-46e7-b328-d257cd736d6e None None] MFA Rules not processed for user `06c172bcd99f469f83728c98d061a7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:41.086617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-97375bd0-75e4-46e7-b328-d257cd736d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:41.198452 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 708/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Jul 21 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:41.213350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53853b7-9398-4eba-bae4-08db2a56f416 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:41.213648 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53853b7-9398-4eba-bae4-08db2a56f416 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:41.213918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53853b7-9398-4eba-bae4-08db2a56f416 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:41.215351 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 704/1412] 10.222.0.15 () {54 vars in 918 bytes} [Thu Jul 21 12:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:41.221365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b1765-0d70-4b71-8ac5-74debce7df31 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:41.221660 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b1765-0d70-4b71-8ac5-74debce7df31 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:41.221943 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b1765-0d70-4b71-8ac5-74debce7df31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:41.294966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:41.300003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0b1b1765-0d70-4b71-8ac5-74debce7df31 None None] MFA Rules not processed for user `f3fb1d091b27472081549f4166ca172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:41.301999 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0b1b1765-0d70-4b71-8ac5-74debce7df31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:41.427080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 709/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Jul 21 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:43.966171 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcefe8-5d73-4920-b118-d7bcfcf4b3f9 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:43.966842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcefe8-5d73-4920-b118-d7bcfcf4b3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:43.966842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcefe8-5d73-4920-b118-d7bcfcf4b3f9 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:43.968142 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:43.974860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60806db-a9d5-42f8-a471-f5f27107e44e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:43.975408 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60806db-a9d5-42f8-a471-f5f27107e44e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:43.975408 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60806db-a9d5-42f8-a471-f5f27107e44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:44.056604 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a60806db-a9d5-42f8-a471-f5f27107e44e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:44.057852 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a60806db-a9d5-42f8-a471-f5f27107e44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:44.117263 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:44.161218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:44.205527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcefe8-5d73-4920-b118-d7bcfcf4b3f9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:44.207322 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e0dcefe8-5d73-4920-b118-d7bcfcf4b3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:44.366282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcefe8-5d73-4920-b118-d7bcfcf4b3f9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:44.442637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:44.487014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc87f8-44e8-43e9-bc75-1f5f3933de0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:44.487657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc87f8-44e8-43e9-bc75-1f5f3933de0c service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:44.488058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc87f8-44e8-43e9-bc75-1f5f3933de0c service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:44.488350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc87f8-44e8-43e9-bc75-1f5f3933de0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:44.490058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b6fc87f8-44e8-43e9-bc75-1f5f3933de0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:44.584681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc87f8-44e8-43e9-bc75-1f5f3933de0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:44.586297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc87f8-44e8-43e9-bc75-1f5f3933de0c service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:44.605219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 706/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:45.521563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db5704-3ca2-4486-9ef0-ef7a0f615f24 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:45.522140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db5704-3ca2-4486-9ef0-ef7a0f615f24 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:45.522244 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db5704-3ca2-4486-9ef0-ef7a0f615f24 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:45.523673 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 12:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:45.529094 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5687791-6b6e-4a33-8cb5-3b80a2320811 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:45.529568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5687791-6b6e-4a33-8cb5-3b80a2320811 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:45.529663 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5687791-6b6e-4a33-8cb5-3b80a2320811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:45.609516 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b5687791-6b6e-4a33-8cb5-3b80a2320811 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:45.610776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b5687791-6b6e-4a33-8cb5-3b80a2320811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:45.643235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:45.727024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 12:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:45.881423 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db5704-3ca2-4486-9ef0-ef7a0f615f24 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:45.882988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-32db5704-3ca2-4486-9ef0-ef7a0f615f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:46.031295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db5704-3ca2-4486-9ef0-ef7a0f615f24 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:46.072550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:46.159371 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd650ec-5dbd-4f85-bcd4-6759a22a5e4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:46.160027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd650ec-5dbd-4f85-bcd4-6759a22a5e4e service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:46.160307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd650ec-5dbd-4f85-bcd4-6759a22a5e4e service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:46.160586 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd650ec-5dbd-4f85-bcd4-6759a22a5e4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:46.162295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8bd650ec-5dbd-4f85-bcd4-6759a22a5e4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:46.261788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd650ec-5dbd-4f85-bcd4-6759a22a5e4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:46.263562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd650ec-5dbd-4f85-bcd4-6759a22a5e4e service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:46.282791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 712/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:47.177108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613d09e-c984-4e6a-82d7-52695845cc8f None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:47.177671 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613d09e-c984-4e6a-82d7-52695845cc8f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:47.177671 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613d09e-c984-4e6a-82d7-52695845cc8f None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:47.178996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 12:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:47.184282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446f4dc-b6ac-4ded-acc5-e3159732e97c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:47.184726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446f4dc-b6ac-4ded-acc5-e3159732e97c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:47.184884 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446f4dc-b6ac-4ded-acc5-e3159732e97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:47.248783 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:47.277923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c446f4dc-b6ac-4ded-acc5-e3159732e97c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:47.279226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c446f4dc-b6ac-4ded-acc5-e3159732e97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:47.412218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 12:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:47.563599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613d09e-c984-4e6a-82d7-52695845cc8f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:47.565135 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3613d09e-c984-4e6a-82d7-52695845cc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:47.730775 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613d09e-c984-4e6a-82d7-52695845cc8f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:47.743761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:47.851915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d15f4-82d1-4866-8657-0a55122d3975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:47.852720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d15f4-82d1-4866-8657-0a55122d3975 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:47.853107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d15f4-82d1-4866-8657-0a55122d3975 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:47.853592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d15f4-82d1-4866-8657-0a55122d3975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:47.856067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d85d15f4-82d1-4866-8657-0a55122d3975 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:47.952864 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d15f4-82d1-4866-8657-0a55122d3975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:47.954485 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d15f4-82d1-4866-8657-0a55122d3975 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:47.974861 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 709/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:48.836835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe7d33-8ec7-4d92-8608-dcac91b8aed0 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:48.837448 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe7d33-8ec7-4d92-8608-dcac91b8aed0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:48.837448 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe7d33-8ec7-4d92-8608-dcac91b8aed0 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:48.838806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 12:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:48.844959 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e40a3a-b340-4061-b084-8981a4f5e3d1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:48.845686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e40a3a-b340-4061-b084-8981a4f5e3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:48.845796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e40a3a-b340-4061-b084-8981a4f5e3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:48.868524 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:48.936692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-28e40a3a-b340-4061-b084-8981a4f5e3d1 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:48.938268 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-28e40a3a-b340-4061-b084-8981a4f5e3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:49.045974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 12:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:49.195805 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe7d33-8ec7-4d92-8608-dcac91b8aed0 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:49.197254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5cfe7d33-8ec7-4d92-8608-dcac91b8aed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:49.319930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:49.357774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe7d33-8ec7-4d92-8608-dcac91b8aed0 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:49.503673 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17cea5-f4db-4db8-bdc6-db3c9f4fff31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:49.504331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17cea5-f4db-4db8-bdc6-db3c9f4fff31 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:49.504615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17cea5-f4db-4db8-bdc6-db3c9f4fff31 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:49.504886 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17cea5-f4db-4db8-bdc6-db3c9f4fff31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:49.506700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8b17cea5-f4db-4db8-bdc6-db3c9f4fff31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:49.588925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:49.603504 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17cea5-f4db-4db8-bdc6-db3c9f4fff31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:49.605122 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17cea5-f4db-4db8-bdc6-db3c9f4fff31 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:49.624335 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 715/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:50.501986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316cd41-f7c9-468b-8320-89e81315cea0 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:50.502614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316cd41-f7c9-468b-8320-89e81315cea0 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:50.502614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316cd41-f7c9-468b-8320-89e81315cea0 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:50.504023 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 12:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:50.509864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8af59-b341-4e82-a8e9-10a21bd8d14a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:50.510437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8af59-b341-4e82-a8e9-10a21bd8d14a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:50.510437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8af59-b341-4e82-a8e9-10a21bd8d14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:50.592178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-fca8af59-b341-4e82-a8e9-10a21bd8d14a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:50.593400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-fca8af59-b341-4e82-a8e9-10a21bd8d14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:50.696679 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 12:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:50.848632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316cd41-f7c9-468b-8320-89e81315cea0 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:50.850316 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1316cd41-f7c9-468b-8320-89e81315cea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:50.937766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:51.002940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316cd41-f7c9-468b-8320-89e81315cea0 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:51.130297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110b539-43fe-4253-a0bb-524e37e98d8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:51.130855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b539-43fe-4253-a0bb-524e37e98d8e service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:51.131134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b539-43fe-4253-a0bb-524e37e98d8e service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:51.131470 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b539-43fe-4253-a0bb-524e37e98d8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:51.134964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5110b539-43fe-4253-a0bb-524e37e98d8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:51.184833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:51.228439 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110b539-43fe-4253-a0bb-524e37e98d8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:51.230079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110b539-43fe-4253-a0bb-524e37e98d8e service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:51.248840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 712/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:52.069364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f538-749e-42f5-8917-744e2fdde301 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:52.070203 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f538-749e-42f5-8917-744e2fdde301 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:52.070203 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f538-749e-42f5-8917-744e2fdde301 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:52.071416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 12:08:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:52.077990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a08e-5ff8-45d8-9bf3-df9d3505087c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:52.078757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a08e-5ff8-45d8-9bf3-df9d3505087c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:52.078757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a08e-5ff8-45d8-9bf3-df9d3505087c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:52.158224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-71e9a08e-5ff8-45d8-9bf3-df9d3505087c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:52.159491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-71e9a08e-5ff8-45d8-9bf3-df9d3505087c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:52.259443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 12:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:52.416017 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0f538-749e-42f5-8917-744e2fdde301 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:52.417445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-65d0f538-749e-42f5-8917-744e2fdde301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:52.468323 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:52.566526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0f538-749e-42f5-8917-744e2fdde301 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:52.684566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5b0fd-bb9a-4578-8883-f69a1c181027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:52.685143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5b0fd-bb9a-4578-8883-f69a1c181027 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:52.685414 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5b0fd-bb9a-4578-8883-f69a1c181027 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:52.685686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5b0fd-bb9a-4578-8883-f69a1c181027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:52.687730 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0ed5b0fd-bb9a-4578-8883-f69a1c181027 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:52.695265 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:52.781118 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5b0fd-bb9a-4578-8883-f69a1c181027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:52.782762 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5b0fd-bb9a-4578-8883-f69a1c181027 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:52.801132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 718/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:53.615915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8ae4e-2901-4abc-a053-4a1bd921b108 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:53.616498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8ae4e-2901-4abc-a053-4a1bd921b108 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:53.616498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8ae4e-2901-4abc-a053-4a1bd921b108 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:53.617862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 12:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:53.623620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8572b5-d585-403e-aec0-ffb52fc6199a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:53.624281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8572b5-d585-403e-aec0-ffb52fc6199a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:53.624281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8572b5-d585-403e-aec0-ffb52fc6199a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:53.703160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0c8572b5-d585-403e-aec0-ffb52fc6199a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:53.704357 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0c8572b5-d585-403e-aec0-ffb52fc6199a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:53.791317 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:53.822745 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 12:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:53.972716 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8ae4e-2901-4abc-a053-4a1bd921b108 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:53.974492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-32d8ae4e-2901-4abc-a053-4a1bd921b108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:53.994697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:54.132912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8ae4e-2901-4abc-a053-4a1bd921b108 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:54.226674 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:54.253809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12fdb4-df65-4f49-bca7-b6ee0d1891da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:54.254467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12fdb4-df65-4f49-bca7-b6ee0d1891da service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:54.254783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12fdb4-df65-4f49-bca7-b6ee0d1891da service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:54.255057 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12fdb4-df65-4f49-bca7-b6ee0d1891da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:54.256718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ed12fdb4-df65-4f49-bca7-b6ee0d1891da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:54.350180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12fdb4-df65-4f49-bca7-b6ee0d1891da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:54.351807 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12fdb4-df65-4f49-bca7-b6ee0d1891da service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:54.370241 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 715/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:55.180388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2719-8762-44b0-8feb-c8f975ee2ec4 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:55.180966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2719-8762-44b0-8feb-c8f975ee2ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:55.180966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2719-8762-44b0-8feb-c8f975ee2ec4 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:55.182390 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 12:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:55.188936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1197cd-2c6a-445f-afa7-d22982f5308b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:55.189542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1197cd-2c6a-445f-afa7-d22982f5308b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:55.189542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1197cd-2c6a-445f-afa7-d22982f5308b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:55.281670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8b1197cd-2c6a-445f-afa7-d22982f5308b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:55.282918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8b1197cd-2c6a-445f-afa7-d22982f5308b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:55.328444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:55.386629 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 12:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:55.537675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b2719-8762-44b0-8feb-c8f975ee2ec4 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:55.539193 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-790b2719-8762-44b0-8feb-c8f975ee2ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:55.693979 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b2719-8762-44b0-8feb-c8f975ee2ec4 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:55.752941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:55.814644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e62a5-c333-4d10-809b-e3b86750a4bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:55.815234 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e62a5-c333-4d10-809b-e3b86750a4bd service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:55.815520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e62a5-c333-4d10-809b-e3b86750a4bd service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:55.815787 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e62a5-c333-4d10-809b-e3b86750a4bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:55.817454 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f15e62a5-c333-4d10-809b-e3b86750a4bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:55.915740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e62a5-c333-4d10-809b-e3b86750a4bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:55.917338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e62a5-c333-4d10-809b-e3b86750a4bd service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:55.936066 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 721/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:56.734641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab6940-248c-4625-81da-c98d43bcbd9e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:56.735249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab6940-248c-4625-81da-c98d43bcbd9e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:56.735249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab6940-248c-4625-81da-c98d43bcbd9e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:56.736580 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 12:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:56.742068 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc7c86-8e85-4e4c-b34e-11e27ff0f0c4 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:56.742559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc7c86-8e85-4e4c-b34e-11e27ff0f0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:56.742698 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc7c86-8e85-4e4c-b34e-11e27ff0f0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:56.821257 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c6bc7c86-8e85-4e4c-b34e-11e27ff0f0c4 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:56.822478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c6bc7c86-8e85-4e4c-b34e-11e27ff0f0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:56.824642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:56.920176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 12:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:57.073624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab6940-248c-4625-81da-c98d43bcbd9e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:57.076174 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-daab6940-248c-4625-81da-c98d43bcbd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:57.244719 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab6940-248c-4625-81da-c98d43bcbd9e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:57.280970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:57.372716 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0759f-4a74-47cc-995b-a33c58ebc4d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:57.373249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0759f-4a74-47cc-995b-a33c58ebc4d9 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:57.373550 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0759f-4a74-47cc-995b-a33c58ebc4d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:57.373819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0759f-4a74-47cc-995b-a33c58ebc4d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:57.375534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f2b0759f-4a74-47cc-995b-a33c58ebc4d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:57.474510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0759f-4a74-47cc-995b-a33c58ebc4d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:57.476178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0759f-4a74-47cc-995b-a33c58ebc4d9 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:08:57.495480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 718/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:08:59.431270 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12ba1-ebc4-4930-8df9-57c7ff853421 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:59.431916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12ba1-ebc4-4930-8df9-57c7ff853421 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:59.431916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12ba1-ebc4-4930-8df9-57c7ff853421 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:59.433590 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:08:59.439224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9af800-a694-4b22-b509-78e5251db367 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:59.439689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9af800-a694-4b22-b509-78e5251db367 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:59.439780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9af800-a694-4b22-b509-78e5251db367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:59.482986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:59.513063 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9a9af800-a694-4b22-b509-78e5251db367 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:08:59.514293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9a9af800-a694-4b22-b509-78e5251db367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:59.623914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:08:59.663008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12ba1-ebc4-4930-8df9-57c7ff853421 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:08:59.664541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-92d12ba1-ebc4-4930-8df9-57c7ff853421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:59.769496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12ba1-ebc4-4930-8df9-57c7ff853421 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:08:59.802903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:08:59.849319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbf127-a0f2-46dc-b633-8ecbad0792e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:08:59.849983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbf127-a0f2-46dc-b633-8ecbad0792e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:08:59.850264 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbf127-a0f2-46dc-b633-8ecbad0792e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:08:59.850537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbf127-a0f2-46dc-b633-8ecbad0792e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:08:59.852211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a9cbf127-a0f2-46dc-b633-8ecbad0792e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:08:59.981974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbf127-a0f2-46dc-b633-8ecbad0792e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:08:59.983503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbf127-a0f2-46dc-b633-8ecbad0792e8 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:00.002520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 724/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:08:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:09:02.329989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae669-6614-4ef3-a4b7-b9d1220d3002 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:02.330617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae669-6614-4ef3-a4b7-b9d1220d3002 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:02.330617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae669-6614-4ef3-a4b7-b9d1220d3002 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:02.331952 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:02.337616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fb746-a644-4e21-b93a-1dc8864321f5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:02.338075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fb746-a644-4e21-b93a-1dc8864321f5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:02.338227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fb746-a644-4e21-b93a-1dc8864321f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:02.406040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c23fb746-a644-4e21-b93a-1dc8864321f5 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:02.407317 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c23fb746-a644-4e21-b93a-1dc8864321f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:02.420907 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:02.510873 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:02.549269 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ae669-6614-4ef3-a4b7-b9d1220d3002 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:02.550832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5f8ae669-6614-4ef3-a4b7-b9d1220d3002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:02.662379 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ae669-6614-4ef3-a4b7-b9d1220d3002 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:02.674958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:02.743004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d4cbf-cbae-4660-96f0-f8037ba6414d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:02.743570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d4cbf-cbae-4660-96f0-f8037ba6414d service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:02.743848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d4cbf-cbae-4660-96f0-f8037ba6414d service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:02.744117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d4cbf-cbae-4660-96f0-f8037ba6414d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:02.745770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7f9d4cbf-cbae-4660-96f0-f8037ba6414d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:03.003244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d4cbf-cbae-4660-96f0-f8037ba6414d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:03.004612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d4cbf-cbae-4660-96f0-f8037ba6414d service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:03.024315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 721/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:09:05.425077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d70fa0-9d3e-41cf-9fc7-f6a7d14b07f1 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:05.425661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d70fa0-9d3e-41cf-9fc7-f6a7d14b07f1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:05.425661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d70fa0-9d3e-41cf-9fc7-f6a7d14b07f1 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:05.427089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:05.432486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3de9d-eebb-464e-8889-bfc743375b93 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:05.432937 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3de9d-eebb-464e-8889-bfc743375b93 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:05.433045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3de9d-eebb-464e-8889-bfc743375b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:05.482687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:05.501895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-6dd3de9d-eebb-464e-8889-bfc743375b93 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:05.503137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6dd3de9d-eebb-464e-8889-bfc743375b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:05.604423 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:05.645314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d70fa0-9d3e-41cf-9fc7-f6a7d14b07f1 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:05.647034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f0d70fa0-9d3e-41cf-9fc7-f6a7d14b07f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:05.764840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d70fa0-9d3e-41cf-9fc7-f6a7d14b07f1 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:05.806201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:05.842624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bce0-ade9-4d96-9e57-ba45acec0634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:05.843314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bce0-ade9-4d96-9e57-ba45acec0634 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:05.843601 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bce0-ade9-4d96-9e57-ba45acec0634 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:05.843863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bce0-ade9-4d96-9e57-ba45acec0634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:05.845538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7c56bce0-ade9-4d96-9e57-ba45acec0634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:05.986505 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56bce0-ade9-4d96-9e57-ba45acec0634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:05.987983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56bce0-ade9-4d96-9e57-ba45acec0634 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:06.008414 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 727/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:09:08.160861 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46824192-ac25-4e68-8283-ef3f524b396c None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:08.161532 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46824192-ac25-4e68-8283-ef3f524b396c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:08.161532 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46824192-ac25-4e68-8283-ef3f524b396c None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:08.162964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:08.168416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602fb75-fbf5-49a9-9f5c-eed2a5ef6d4b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:08.168866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602fb75-fbf5-49a9-9f5c-eed2a5ef6d4b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:08.168966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602fb75-fbf5-49a9-9f5c-eed2a5ef6d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:08.239561 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a602fb75-fbf5-49a9-9f5c-eed2a5ef6d4b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:08.240959 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a602fb75-fbf5-49a9-9f5c-eed2a5ef6d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:08.263163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:08.343800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:08.388077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46824192-ac25-4e68-8283-ef3f524b396c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:08.389665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-46824192-ac25-4e68-8283-ef3f524b396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:08.506514 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46824192-ac25-4e68-8283-ef3f524b396c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:08.527326 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:08.583529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d07f57-5fe4-4fa9-927d-2e10b7bd8236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:08.584183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07f57-5fe4-4fa9-927d-2e10b7bd8236 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:08.584461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07f57-5fe4-4fa9-927d-2e10b7bd8236 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:08.584731 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07f57-5fe4-4fa9-927d-2e10b7bd8236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:08.586375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-30d07f57-5fe4-4fa9-927d-2e10b7bd8236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:08.701637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d07f57-5fe4-4fa9-927d-2e10b7bd8236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:08.703793 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d07f57-5fe4-4fa9-927d-2e10b7bd8236 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:08.725840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 724/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:09:10.942178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbca864-6219-447a-9306-1133aacd877b None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:10.942838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbca864-6219-447a-9306-1133aacd877b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:10.942838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbca864-6219-447a-9306-1133aacd877b None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:10.944423 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:10.950481 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8010d-2863-4a4f-9431-3ad5961f1642 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:10.950995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8010d-2863-4a4f-9431-3ad5961f1642 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:10.951099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8010d-2863-4a4f-9431-3ad5961f1642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:11.016562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:11.019960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8ca8010d-2863-4a4f-9431-3ad5961f1642 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:11.021833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8ca8010d-2863-4a4f-9431-3ad5961f1642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:11.130474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:11.172046 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbca864-6219-447a-9306-1133aacd877b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:11.173603 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-afbca864-6219-447a-9306-1133aacd877b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:11.287722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbca864-6219-447a-9306-1133aacd877b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:11.340142 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:11.369695 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b4cbd-1786-44bd-9bb2-88a584e0fdca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:11.370358 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b4cbd-1786-44bd-9bb2-88a584e0fdca service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:11.370642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b4cbd-1786-44bd-9bb2-88a584e0fdca service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:11.370945 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b4cbd-1786-44bd-9bb2-88a584e0fdca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:11.372685 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ca0b4cbd-1786-44bd-9bb2-88a584e0fdca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:11.488643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b4cbd-1786-44bd-9bb2-88a584e0fdca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:11.490491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b4cbd-1786-44bd-9bb2-88a584e0fdca service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:11.510537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 730/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:09:13.596782 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b54cd-9225-48ea-8726-66765d8b5ec7 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:13.597396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b54cd-9225-48ea-8726-66765d8b5ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:13.597396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b54cd-9225-48ea-8726-66765d8b5ec7 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:13.598686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:13.604300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8467a-b591-467b-adb1-f94be91dfc6d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:13.604779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8467a-b591-467b-adb1-f94be91dfc6d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:13.604892 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8467a-b591-467b-adb1-f94be91dfc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:13.673013 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-86e8467a-b591-467b-adb1-f94be91dfc6d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:13.674241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-86e8467a-b591-467b-adb1-f94be91dfc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:13.705558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:13.778475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:13.817383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b54cd-9225-48ea-8726-66765d8b5ec7 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:13.819016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e14b54cd-9225-48ea-8726-66765d8b5ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:13.932483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b54cd-9225-48ea-8726-66765d8b5ec7 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:13.964219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:14.020741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5057fcf-b413-4938-b144-967389835615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:14.021471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5057fcf-b413-4938-b144-967389835615 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:14.021753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5057fcf-b413-4938-b144-967389835615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:14.022019 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5057fcf-b413-4938-b144-967389835615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:14.023682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f5057fcf-b413-4938-b144-967389835615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:14.145478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5057fcf-b413-4938-b144-967389835615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:14.146909 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5057fcf-b413-4938-b144-967389835615 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:14.166286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 727/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:09:16.326641 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfb673-0d75-488d-939e-12cf80408bd4 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:16.327231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfb673-0d75-488d-939e-12cf80408bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:16.327231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfb673-0d75-488d-939e-12cf80408bd4 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:16.328576 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:16.334406 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3383f-c44c-4c1c-8977-f43620ac7307 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:16.334927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3383f-c44c-4c1c-8977-f43620ac7307 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:16.335030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3383f-c44c-4c1c-8977-f43620ac7307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:16.399964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f2a3383f-c44c-4c1c-8977-f43620ac7307 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:16.401191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f2a3383f-c44c-4c1c-8977-f43620ac7307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:16.409989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:16.508554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:09:16.554372 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfb673-0d75-488d-939e-12cf80408bd4 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:16.556872 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-03dfb673-0d75-488d-939e-12cf80408bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:16.678508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfb673-0d75-488d-939e-12cf80408bd4 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:16.740984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:16.759955 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaf302-ceac-4ffb-bd1d-eb2f6d863160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:16.760616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaf302-ceac-4ffb-bd1d-eb2f6d863160 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:16.760897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaf302-ceac-4ffb-bd1d-eb2f6d863160 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:16.761171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaf302-ceac-4ffb-bd1d-eb2f6d863160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:16.762865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-eadaf302-ceac-4ffb-bd1d-eb2f6d863160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:16.881153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadaf302-ceac-4ffb-bd1d-eb2f6d863160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:16.882739 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadaf302-ceac-4ffb-bd1d-eb2f6d863160 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:16.905425 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 733/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:09:19.031769 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b685e24-3ab9-4c32-8906-768d89cd4e2a None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:19.032328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b685e24-3ab9-4c32-8906-768d89cd4e2a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:19.032328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b685e24-3ab9-4c32-8906-768d89cd4e2a None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:19.033740 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:19.039409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0e6a1-f0b6-4535-bfbd-2a6ba983775f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:19.039837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0e6a1-f0b6-4535-bfbd-2a6ba983775f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:19.039946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0e6a1-f0b6-4535-bfbd-2a6ba983775f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:19.109395 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ffe0e6a1-f0b6-4535-bfbd-2a6ba983775f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:19.110621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ffe0e6a1-f0b6-4535-bfbd-2a6ba983775f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:19.151451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:19.216740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:19.255365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b685e24-3ab9-4c32-8906-768d89cd4e2a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:19.257132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0b685e24-3ab9-4c32-8906-768d89cd4e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:19.367109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b685e24-3ab9-4c32-8906-768d89cd4e2a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:19.406963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:19.449226 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b16419-2073-435b-8ccb-e2ee8bbbe904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:19.449972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16419-2073-435b-8ccb-e2ee8bbbe904 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:19.450243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16419-2073-435b-8ccb-e2ee8bbbe904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:19.450405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16419-2073-435b-8ccb-e2ee8bbbe904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:19.452160 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d4b16419-2073-435b-8ccb-e2ee8bbbe904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:19.572157 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b16419-2073-435b-8ccb-e2ee8bbbe904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:19.573629 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b16419-2073-435b-8ccb-e2ee8bbbe904 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:19.595135 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 730/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:09:21.639543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bcca5-0249-4fb2-bc5a-0c9a03816549 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:21.640167 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bcca5-0249-4fb2-bc5a-0c9a03816549 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:21.640167 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bcca5-0249-4fb2-bc5a-0c9a03816549 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:21.641501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:21.647545 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b3300-10df-4043-b296-f82ae5e3dc6d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:21.648015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b3300-10df-4043-b296-f82ae5e3dc6d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:21.648129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b3300-10df-4043-b296-f82ae5e3dc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:21.715010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d31b3300-10df-4043-b296-f82ae5e3dc6d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:21.716122 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d31b3300-10df-4043-b296-f82ae5e3dc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:21.735008 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:21.815651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:21.854112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bcca5-0249-4fb2-bc5a-0c9a03816549 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:21.855849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7e9bcca5-0249-4fb2-bc5a-0c9a03816549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:21.979949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bcca5-0249-4fb2-bc5a-0c9a03816549 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:22.055105 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:22.063061 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81df67-279f-49dc-89a2-006ac9ce832a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:22.063722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81df67-279f-49dc-89a2-006ac9ce832a service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:22.064004 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81df67-279f-49dc-89a2-006ac9ce832a service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:22.064277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81df67-279f-49dc-89a2-006ac9ce832a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:22.066015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0d81df67-279f-49dc-89a2-006ac9ce832a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:22.185022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81df67-279f-49dc-89a2-006ac9ce832a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:22.186485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81df67-279f-49dc-89a2-006ac9ce832a service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:22.207401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 736/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:09:24.295428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6514e-7661-4643-a520-f164f012b97e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:24.295990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6514e-7661-4643-a520-f164f012b97e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:24.296114 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6514e-7661-4643-a520-f164f012b97e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:24.297504 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:24.303454 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8694a-1383-42fd-a0a8-d8487052a4dd None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:24.303950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8694a-1383-42fd-a0a8-d8487052a4dd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:24.303950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8694a-1383-42fd-a0a8-d8487052a4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:24.373809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-bbb8694a-1383-42fd-a0a8-d8487052a4dd None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:24.375072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bbb8694a-1383-42fd-a0a8-d8487052a4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:24.425662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:24.477757 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:24.515104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6514e-7661-4643-a520-f164f012b97e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:24.516704 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e4f6514e-7661-4643-a520-f164f012b97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:24.629316 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6514e-7661-4643-a520-f164f012b97e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:24.684669 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:24.712396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affa4bb-90cd-43cb-8bc3-129e6addfbfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:24.713138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affa4bb-90cd-43cb-8bc3-129e6addfbfa service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:24.713287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affa4bb-90cd-43cb-8bc3-129e6addfbfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:24.713547 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affa4bb-90cd-43cb-8bc3-129e6addfbfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:24.715249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3affa4bb-90cd-43cb-8bc3-129e6addfbfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:24.832439 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affa4bb-90cd-43cb-8bc3-129e6addfbfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:24.833986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affa4bb-90cd-43cb-8bc3-129e6addfbfa service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:24.855047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 733/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:09:34.475888 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=22 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:34.852520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=66 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:44.409407 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5b9b1-72d5-480e-bc88-0d4dbda11455 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:44.410024 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5b9b1-72d5-480e-bc88-0d4dbda11455 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:44.410024 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5b9b1-72d5-480e-bc88-0d4dbda11455 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:44.411516 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 738/1471] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:44.417115 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca2171-3303-40ba-a2b6-61ba938c435e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:44.417565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca2171-3303-40ba-a2b6-61ba938c435e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:44.417666 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca2171-3303-40ba-a2b6-61ba938c435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:44.486626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a6ca2171-3303-40ba-a2b6-61ba938c435e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:44.487932 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a6ca2171-3303-40ba-a2b6-61ba938c435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:44.594404 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 734/1472] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:44.683176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa3d20-44e4-48e3-b5c5-a17f32ec3820 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:44.683464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa3d20-44e4-48e3-b5c5-a17f32ec3820 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:44.683737 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa3d20-44e4-48e3-b5c5-a17f32ec3820 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:44.685169 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 739/1473] 10.222.0.15 () {54 vars in 966 bytes} [Thu Jul 21 12:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:44.690594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f420e-c718-40b3-895b-1e33c382ab7d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:44.690907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f420e-c718-40b3-895b-1e33c382ab7d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:44.691185 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f420e-c718-40b3-895b-1e33c382ab7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:44.769341 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fa7f420e-c718-40b3-895b-1e33c382ab7d None None] MFA Rules not processed for user `10611bf25b9e4604ad769a6902f7f457`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:44.770557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fa7f420e-c718-40b3-895b-1e33c382ab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:44.791681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:44.853245 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 735/1474] 10.222.0.15 () {58 vars in 1063 bytes} [Thu Jul 21 12:09:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:44.861052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa3d20-44e4-48e3-b5c5-a17f32ec3820 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:44.862785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-40fa3d20-44e4-48e3-b5c5-a17f32ec3820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:44.971680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa3d20-44e4-48e3-b5c5-a17f32ec3820 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:45.060344 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7df1d-847b-4f63-b1dd-b568a7f34750 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10611bf25b9e4604ad769a6902f7f457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:45.060894 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7df1d-847b-4f63-b1dd-b568a7f34750 service glance] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:45.061167 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7df1d-847b-4f63-b1dd-b568a7f34750 service glance] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:45.061442 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7df1d-847b-4f63-b1dd-b568a7f34750 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:45.063495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9ae7df1d-847b-4f63-b1dd-b568a7f34750 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:45.121985 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:45.184504 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7df1d-847b-4f63-b1dd-b568a7f34750 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:45.185977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7df1d-847b-4f63-b1dd-b568a7f34750 service glance] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:45.206141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 740/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:09:47.360441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6d91-1863-48c9-8c9d-0a3ee9919d46 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:47.361051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6d91-1863-48c9-8c9d-0a3ee9919d46 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:47.361051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6d91-1863-48c9-8c9d-0a3ee9919d46 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:47.362394 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 736/1476] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:47.367998 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cdec2-5a42-495a-990d-5baf1d43d0fb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:47.368487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cdec2-5a42-495a-990d-5baf1d43d0fb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:47.368584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cdec2-5a42-495a-990d-5baf1d43d0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:47.438693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b54cdec2-5a42-495a-990d-5baf1d43d0fb None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:47.439976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b54cdec2-5a42-495a-990d-5baf1d43d0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:47.542234 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 741/1477] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:47.566133 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6d91-1863-48c9-8c9d-0a3ee9919d46 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:47.567757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-63ff6d91-1863-48c9-8c9d-0a3ee9919d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:47.700684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6d91-1863-48c9-8c9d-0a3ee9919d46 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:47.757561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:47.814038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2033f-a924-4098-9c47-b4a73243de66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:47.814737 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2033f-a924-4098-9c47-b4a73243de66 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:47.815021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2033f-a924-4098-9c47-b4a73243de66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:47.815288 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2033f-a924-4098-9c47-b4a73243de66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:47.816032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2033f-a924-4098-9c47-b4a73243de66 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:47.817886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-a6b2033f-a924-4098-9c47-b4a73243de66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:09:47.817886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 21 12:09:47.817886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: Jul 21 12:09:47.819052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2033f-a924-4098-9c47-b4a73243de66 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:47.839275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 737/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jul 21 12:09:47 2022] GET /identity/v3/projects => generated 2553 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:09:49.921230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406261e-99c2-4df0-9f72-d40a2419f792 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:49.921817 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406261e-99c2-4df0-9f72-d40a2419f792 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:49.921817 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406261e-99c2-4df0-9f72-d40a2419f792 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:49.923396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 742/1479] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:49.928871 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d427f-8e27-45f3-bfde-1f59a12673f6 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:49.929305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d427f-8e27-45f3-bfde-1f59a12673f6 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:49.929397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d427f-8e27-45f3-bfde-1f59a12673f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:49.997346 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-255d427f-8e27-45f3-bfde-1f59a12673f6 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:49.998573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-255d427f-8e27-45f3-bfde-1f59a12673f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:50.107073 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 738/1480] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:50.175840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406261e-99c2-4df0-9f72-d40a2419f792 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:50.177747 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4406261e-99c2-4df0-9f72-d40a2419f792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:50.188585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:50.330545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406261e-99c2-4df0-9f72-d40a2419f792 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:50.417314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:50.459503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49fa69-53c6-41e5-92d1-d93027d2c664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:50.460082 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49fa69-53c6-41e5-92d1-d93027d2c664 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:50.460361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49fa69-53c6-41e5-92d1-d93027d2c664 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:50.460634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49fa69-53c6-41e5-92d1-d93027d2c664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:50.462910 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8e49fa69-53c6-41e5-92d1-d93027d2c664 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:50.557953 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49fa69-53c6-41e5-92d1-d93027d2c664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:50.559624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49fa69-53c6-41e5-92d1-d93027d2c664 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:50.579760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 743/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:09:52.814349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660db0e-d98d-405a-bfec-a1e143178d41 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:52.814999 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660db0e-d98d-405a-bfec-a1e143178d41 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:52.814999 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660db0e-d98d-405a-bfec-a1e143178d41 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:52.816402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 739/1482] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:09:52.822061 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f64984-d555-4e30-87ae-48d45550d6b1 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:52.822549 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f64984-d555-4e30-87ae-48d45550d6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:52.822670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f64984-d555-4e30-87ae-48d45550d6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:52.891153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-00f64984-d555-4e30-87ae-48d45550d6b1 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:52.892388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-00f64984-d555-4e30-87ae-48d45550d6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:52.940423 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:52.994758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 744/1483] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:53.031806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660db0e-d98d-405a-bfec-a1e143178d41 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:53.033402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d660db0e-d98d-405a-bfec-a1e143178d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:53.057709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:53.151158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660db0e-d98d-405a-bfec-a1e143178d41 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:53.237997 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5be0ef-11ce-4299-b7b1-1a09eb800eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:53.238687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5be0ef-11ce-4299-b7b1-1a09eb800eab service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:53.238984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5be0ef-11ce-4299-b7b1-1a09eb800eab service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:53.239255 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5be0ef-11ce-4299-b7b1-1a09eb800eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:53.240930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0a5be0ef-11ce-4299-b7b1-1a09eb800eab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:53.329515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:53.367042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5be0ef-11ce-4299-b7b1-1a09eb800eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:53.368503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5be0ef-11ce-4299-b7b1-1a09eb800eab service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:53.388302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 740/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:09:55.541345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7571a-d6f9-4113-ad52-4e677cddb4a7 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:55.541985 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7571a-d6f9-4113-ad52-4e677cddb4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:55.541985 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7571a-d6f9-4113-ad52-4e677cddb4a7 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:55.543300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 745/1485] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:55.549055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4de5-0993-4082-846a-1dc6cba650bb None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:55.549490 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4de5-0993-4082-846a-1dc6cba650bb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:55.549600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4de5-0993-4082-846a-1dc6cba650bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:55.620840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-371b4de5-0993-4082-846a-1dc6cba650bb None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:55.622086 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-371b4de5-0993-4082-846a-1dc6cba650bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:55.722532 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 741/1486] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:55.761559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7571a-d6f9-4113-ad52-4e677cddb4a7 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:55.763178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-10b7571a-d6f9-4113-ad52-4e677cddb4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:55.881057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7571a-d6f9-4113-ad52-4e677cddb4a7 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:55.961917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:55.963927 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68302a5d-4a70-4c30-b64f-2815d2b61b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:55.964620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68302a5d-4a70-4c30-b64f-2815d2b61b95 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:55.964908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68302a5d-4a70-4c30-b64f-2815d2b61b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:55.965192 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68302a5d-4a70-4c30-b64f-2815d2b61b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:55.967988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-68302a5d-4a70-4c30-b64f-2815d2b61b95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:56.083285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68302a5d-4a70-4c30-b64f-2815d2b61b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:56.084963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68302a5d-4a70-4c30-b64f-2815d2b61b95 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:56.107861 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 746/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:09:58.321589 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5edb-7273-41ca-a9eb-1e5d823a8200 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:58.322179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5edb-7273-41ca-a9eb-1e5d823a8200 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:58.322179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5edb-7273-41ca-a9eb-1e5d823a8200 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:58.323586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 742/1488] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:09:58.329224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c48ef-faa6-4bac-838d-22f195a9984a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:58.329704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c48ef-faa6-4bac-838d-22f195a9984a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:58.329807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c48ef-faa6-4bac-838d-22f195a9984a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:58.397837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-839c48ef-faa6-4bac-838d-22f195a9984a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:09:58.399109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-839c48ef-faa6-4bac-838d-22f195a9984a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:58.457067 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:58.502829 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 747/1489] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:09:58.543714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a5edb-7273-41ca-a9eb-1e5d823a8200 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:09:58.545281 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fe2a5edb-7273-41ca-a9eb-1e5d823a8200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:58.583311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:58.654972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a5edb-7273-41ca-a9eb-1e5d823a8200 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:09:58.732747 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e94305-b91c-407d-9184-034074bb44c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:09:58.733293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e94305-b91c-407d-9184-034074bb44c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:09:58.733564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e94305-b91c-407d-9184-034074bb44c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:09:58.733900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e94305-b91c-407d-9184-034074bb44c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:09:58.735739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c5e94305-b91c-407d-9184-034074bb44c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:09:58.826494 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:09:58.858838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e94305-b91c-407d-9184-034074bb44c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:09:58.860325 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e94305-b91c-407d-9184-034074bb44c9 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:09:58.881719 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 743/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:10:01.181487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd9e00-ace0-46b8-8d0d-93b6d8abc743 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:10:01.182143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd9e00-ace0-46b8-8d0d-93b6d8abc743 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:10:01.182143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd9e00-ace0-46b8-8d0d-93b6d8abc743 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:10:01.183479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 748/1491] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jul 21 12:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:10:01.190076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11caa7-9575-4de8-b7c4-449e87070830 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:10:01.190764 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11caa7-9575-4de8-b7c4-449e87070830 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:10:01.190764 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11caa7-9575-4de8-b7c4-449e87070830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:10:01.264956 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4a11caa7-9575-4de8-b7c4-449e87070830 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:10:01.266197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4a11caa7-9575-4de8-b7c4-449e87070830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:10:01.376862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 744/1492] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jul 21 12:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:10:01.417554 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd9e00-ace0-46b8-8d0d-93b6d8abc743 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:10:01.419193 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-edfd9e00-ace0-46b8-8d0d-93b6d8abc743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:10:01.542501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd9e00-ace0-46b8-8d0d-93b6d8abc743 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:10:01.623221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed472f-cbdc-4445-b6ab-cdf7f8333efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:10:01.623892 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed472f-cbdc-4445-b6ab-cdf7f8333efd service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:10:01.624174 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed472f-cbdc-4445-b6ab-cdf7f8333efd service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:10:01.624508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed472f-cbdc-4445-b6ab-cdf7f8333efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:10:01.626246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-19ed472f-cbdc-4445-b6ab-cdf7f8333efd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:10:01.636934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:10:01.751816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed472f-cbdc-4445-b6ab-cdf7f8333efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:10:01.753352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed472f-cbdc-4445-b6ab-cdf7f8333efd service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:10:01.774332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 749/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:10:11.374773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=82 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:10:11.771511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=50 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:11:41.502541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40669c-902a-43b6-8362-3407b4293992 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:41.503209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40669c-902a-43b6-8362-3407b4293992 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:41.503209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40669c-902a-43b6-8362-3407b4293992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:41.579281 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2a40669c-902a-43b6-8362-3407b4293992 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:11:41.580519 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2a40669c-902a-43b6-8362-3407b4293992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:41.694540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 745/1494] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:11:41.703523 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c7bc6-5c71-4f5f-bbc1-67886f98fcb6 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:41.704078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c7bc6-5c71-4f5f-bbc1-67886f98fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:41.704078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c7bc6-5c71-4f5f-bbc1-67886f98fcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:41.787960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c66c7bc6-5c71-4f5f-bbc1-67886f98fcb6 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:11:41.789238 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c66c7bc6-5c71-4f5f-bbc1-67886f98fcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:41.893520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 750/1495] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:11:41.898619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40669c-902a-43b6-8362-3407b4293992 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:11:41.899891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2a40669c-902a-43b6-8362-3407b4293992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:41.917844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40669c-902a-43b6-8362-3407b4293992 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:11:41.985849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:11:42.020984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d65c0e-32a6-413e-92ff-649793407722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:11:42.021651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d65c0e-32a6-413e-92ff-649793407722 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:42.021927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d65c0e-32a6-413e-92ff-649793407722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:42.022247 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d65c0e-32a6-413e-92ff-649793407722 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:42.023009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d65c0e-32a6-413e-92ff-649793407722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:11:42.023310 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d65c0e-32a6-413e-92ff-649793407722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:11:42.024335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-44d65c0e-32a6-413e-92ff-649793407722 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:11:42.024335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 21 12:11:42.024335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: Jul 21 12:11:42.025222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d65c0e-32a6-413e-92ff-649793407722 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:11:42.037187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 746/1496] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:11:42.046474 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c7bc6-5c71-4f5f-bbc1-67886f98fcb6 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:11:42.057349 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c7bc6-5c71-4f5f-bbc1-67886f98fcb6 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:11:42.126037 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:11:42.167296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebe0f1-d0db-4bf2-9b83-d6e4431f2f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:11:42.167969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebe0f1-d0db-4bf2-9b83-d6e4431f2f7e admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:42.168244 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebe0f1-d0db-4bf2-9b83-d6e4431f2f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:42.168510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebe0f1-d0db-4bf2-9b83-d6e4431f2f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:42.169212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebe0f1-d0db-4bf2-9b83-d6e4431f2f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:11:42.171070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: WARNING py.warnings [None req-41ebe0f1-d0db-4bf2-9b83-d6e4431f2f7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:11:42.171070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: warnings.warn(msg) Jul 21 12:11:42.171070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: Jul 21 12:11:42.172291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebe0f1-d0db-4bf2-9b83-d6e4431f2f7e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:11:42.232830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 751/1497] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:11:42 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:11:42.237854 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d65c0e-32a6-413e-92ff-649793407722 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:11:42.239643 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-44d65c0e-32a6-413e-92ff-649793407722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:42.278026 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d65c0e-32a6-413e-92ff-649793407722 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:11:42.384188 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc74df-c454-4cf9-9e6a-e08f16af3fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:11:42.384779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc74df-c454-4cf9-9e6a-e08f16af3fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:42.385086 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc74df-c454-4cf9-9e6a-e08f16af3fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:42.385329 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc74df-c454-4cf9-9e6a-e08f16af3fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:42.386042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc74df-c454-4cf9-9e6a-e08f16af3fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:11:42.387132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-90cc74df-c454-4cf9-9e6a-e08f16af3fc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:11:42.387132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 21 12:11:42.387132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: Jul 21 12:11:42.388368 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc74df-c454-4cf9-9e6a-e08f16af3fc3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:11:42.439458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 747/1498] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:11:42 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:11:42.444860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebe0f1-d0db-4bf2-9b83-d6e4431f2f7e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:11:42.446350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-41ebe0f1-d0db-4bf2-9b83-d6e4431f2f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:42.513716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebe0f1-d0db-4bf2-9b83-d6e4431f2f7e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:11:42.600726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:11:42.614194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e9468-ac8d-45ee-874c-daa2059b6e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:11:42.614915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e9468-ac8d-45ee-874c-daa2059b6e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:42.615190 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e9468-ac8d-45ee-874c-daa2059b6e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:42.615459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e9468-ac8d-45ee-874c-daa2059b6e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:42.616373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e9468-ac8d-45ee-874c-daa2059b6e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:11:42.617392 dv-cinder-850321-1-smb devstack@keystone.service[80410]: WARNING py.warnings [None req-dc1e9468-ac8d-45ee-874c-daa2059b6e4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:11:42.617392 dv-cinder-850321-1-smb devstack@keystone.service[80410]: warnings.warn(msg) Jul 21 12:11:42.617392 dv-cinder-850321-1-smb devstack@keystone.service[80410]: Jul 21 12:11:42.618300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e9468-ac8d-45ee-874c-daa2059b6e4f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:11:42.633021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 752/1499] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:11:42.637441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc74df-c454-4cf9-9e6a-e08f16af3fc3 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:11:42.638942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-90cc74df-c454-4cf9-9e6a-e08f16af3fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:42.650821 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc74df-c454-4cf9-9e6a-e08f16af3fc3 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:11:42.677734 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:11:42.763159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c68a04-c841-4ef6-a81f-e32b8ec513aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:11:42.763851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c68a04-c841-4ef6-a81f-e32b8ec513aa admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:42.764122 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c68a04-c841-4ef6-a81f-e32b8ec513aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:42.764387 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c68a04-c841-4ef6-a81f-e32b8ec513aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:42.765127 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c68a04-c841-4ef6-a81f-e32b8ec513aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:11:42.766150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-13c68a04-c841-4ef6-a81f-e32b8ec513aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:11:42.766150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 21 12:11:42.766150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: Jul 21 12:11:42.767075 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c68a04-c841-4ef6-a81f-e32b8ec513aa admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:11:42.781475 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 748/1500] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:11:42.787206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e9468-ac8d-45ee-874c-daa2059b6e4f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:11:42.788759 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-dc1e9468-ac8d-45ee-874c-daa2059b6e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:42.836077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e9468-ac8d-45ee-874c-daa2059b6e4f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:11:43.083433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6be55-5df1-441e-a823-2b1f481c11ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:11:43.084396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6be55-5df1-441e-a823-2b1f481c11ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:43.084656 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6be55-5df1-441e-a823-2b1f481c11ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:43.084958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6be55-5df1-441e-a823-2b1f481c11ca admin admin] PATH_INFO: `/v3/projects/7348ff98f5764f5988fa0366f68d2add/users/ba3c4b237a3b4d98808f2f518524810f/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:43.110683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6be55-5df1-441e-a823-2b1f481c11ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7348ff98f5764f5988fa0366f68d2add, user_id=ba3c4b237a3b4d98808f2f518524810f, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:11:43.111765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: WARNING py.warnings [None req-b6c6be55-5df1-441e-a823-2b1f481c11ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:11:43.111765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: warnings.warn(msg) Jul 21 12:11:43.111765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: Jul 21 12:11:43.113686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6be55-5df1-441e-a823-2b1f481c11ca admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:11:43.146758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 753/1501] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:11:42 2022] PUT /identity/v3/projects/7348ff98f5764f5988fa0366f68d2add/users/ba3c4b237a3b4d98808f2f518524810f/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:11:43.160161 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e02dc-ef85-4d35-9a44-155d91236e60 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:43.160458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e02dc-ef85-4d35-9a44-155d91236e60 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:43.160736 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e02dc-ef85-4d35-9a44-155d91236e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:43.223153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f85e02dc-ef85-4d35-9a44-155d91236e60 None None] MFA Rules not processed for user `ba3c4b237a3b4d98808f2f518524810f`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:11:43.224390 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f85e02dc-ef85-4d35-9a44-155d91236e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:43.306327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 749/1502] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:11:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:11:43.321872 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb56ce-0e27-4f9a-bde5-54f9e03cc2ff None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:43.322159 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb56ce-0e27-4f9a-bde5-54f9e03cc2ff None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:43.322427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb56ce-0e27-4f9a-bde5-54f9e03cc2ff None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:43.323851 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 754/1503] 10.222.0.15 () {54 vars in 964 bytes} [Thu Jul 21 12:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:11:43.328872 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31803-91ec-4ec8-a01d-eb4e238e21e0 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:43.329166 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31803-91ec-4ec8-a01d-eb4e238e21e0 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:43.329436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31803-91ec-4ec8-a01d-eb4e238e21e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:43.370813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:11:43.417810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-bab31803-91ec-4ec8-a01d-eb4e238e21e0 None None] MFA Rules not processed for user `2af1aad6bd5c486192345b3747ed3e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:11:43.419091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bab31803-91ec-4ec8-a01d-eb4e238e21e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:43.498562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 750/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Jul 21 12:11:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:11:43.506760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb56ce-0e27-4f9a-bde5-54f9e03cc2ff None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:11:43.508290 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-fefb56ce-0e27-4f9a-bde5-54f9e03cc2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:43.559784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:11:43.617101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb56ce-0e27-4f9a-bde5-54f9e03cc2ff None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:11:43.705504 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95c563-4423-48b1-8828-5c8e37ee8a7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:11:43.705955 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95c563-4423-48b1-8828-5c8e37ee8a7d service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:43.706229 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95c563-4423-48b1-8828-5c8e37ee8a7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:43.706495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95c563-4423-48b1-8828-5c8e37ee8a7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:43.708301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1d95c563-4423-48b1-8828-5c8e37ee8a7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:43.825889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95c563-4423-48b1-8828-5c8e37ee8a7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:11:43.827366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95c563-4423-48b1-8828-5c8e37ee8a7d service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:11:43.830920 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:11:43.846994 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 755/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:11:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:11:43.894541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d94451-3e57-4ad4-a6c7-f10a0a70fe33 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:43.895071 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d94451-3e57-4ad4-a6c7-f10a0a70fe33 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:43.895177 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d94451-3e57-4ad4-a6c7-f10a0a70fe33 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:43.896427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 751/1506] 10.222.0.15 () {52 vars in 829 bytes} [Thu Jul 21 12:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:11:43.900501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95c563-4423-48b1-8828-5c8e37ee8a7d service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:11:43.901725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1d95c563-4423-48b1-8828-5c8e37ee8a7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:44.014093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95c563-4423-48b1-8828-5c8e37ee8a7d service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:11:44.131500 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:11:44.132404 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:44.132683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:44.132958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] PATH_INFO: `/v3/users/ba3c4b237a3b4d98808f2f518524810f` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:44.146687 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3c4b237a3b4d98808f2f518524810f)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:11:44.147842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: WARNING py.warnings [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:11:44.147842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: warnings.warn(msg) Jul 21 12:11:44.147842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: Jul 21 12:11:44.149085 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:11:44.159550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:11:44.223942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3c4b237a3b4d98808f2f518524810f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:11:44.238540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3c4b237a3b4d98808f2f518524810f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:11:44.239138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3c4b237a3b4d98808f2f518524810f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:11:44.258686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3c4b237a3b4d98808f2f518524810f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:11:44.259170 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3c4b237a3b4d98808f2f518524810f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:11:44.275512 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 756/1507] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:11:43 2022] DELETE /identity/v3/users/ba3c4b237a3b4d98808f2f518524810f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:11:44.280320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c3118-c141-4558-ae24-0457d0c4e271 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:44.280734 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c3118-c141-4558-ae24-0457d0c4e271 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:44.281115 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c3118-c141-4558-ae24-0457d0c4e271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:44.342795 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-278c3118-c141-4558-ae24-0457d0c4e271 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:11:44.344313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-278c3118-c141-4558-ae24-0457d0c4e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:44.432275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:11:44.447481 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 752/1508] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:11:44.463258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:11:44.464555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:44.579219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c417ba4-25d0-4174-be5c-5959d670547c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:11:44.638967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:11:44.662087 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950254ee-683b-4f64-8095-1ffd099f4916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:11:44.662914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950254ee-683b-4f64-8095-1ffd099f4916 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:44.663188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950254ee-683b-4f64-8095-1ffd099f4916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:44.663460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950254ee-683b-4f64-8095-1ffd099f4916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:44.665121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-950254ee-683b-4f64-8095-1ffd099f4916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:44.784822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950254ee-683b-4f64-8095-1ffd099f4916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:11:44.786273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950254ee-683b-4f64-8095-1ffd099f4916 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:11:44.807593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 757/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:11:45.215913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c3118-c141-4558-ae24-0457d0c4e271 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:11:45.217185 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-278c3118-c141-4558-ae24-0457d0c4e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:11:45.229332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c3118-c141-4558-ae24-0457d0c4e271 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:11:45.335121 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:11:45.335910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:11:45.336185 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:11:45.336455 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb admin admin] PATH_INFO: `/v3/projects/7348ff98f5764f5988fa0366f68d2add` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:11:45.346948 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7348ff98f5764f5988fa0366f68d2add)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:11:45.348010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:11:45.348010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 21 12:11:45.348010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: Jul 21 12:11:45.349208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:11:45.426271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7348ff98f5764f5988fa0366f68d2add', 'request_id': 'req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:11:45.437267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7348ff98f5764f5988fa0366f68d2add', 'request_id': 'req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:11:45.444470 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7348ff98f5764f5988fa0366f68d2add', 'request_id': 'req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:11:45.483399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb admin admin] The token cache is being invalidate because project 7348ff98f5764f5988fa0366f68d2add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:11:45.483906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:11:45.484863 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d7ea80d1-8d4a-4aa1-b25d-464d8761d6bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:11:45.486555 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 753/1510] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:11:45 2022] DELETE /identity/v3/projects/7348ff98f5764f5988fa0366f68d2add => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:11:54.804355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=62 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:11:55.479200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:13:29.724476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef2500-1f07-4b98-82e1-174977467c87 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:29.725117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef2500-1f07-4b98-82e1-174977467c87 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:29.725117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef2500-1f07-4b98-82e1-174977467c87 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:29.727143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 12:13:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:13:29.733177 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d534a4-84cc-4bc3-97c0-aefbfa6e093f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:29.733894 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d534a4-84cc-4bc3-97c0-aefbfa6e093f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:29.734045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d534a4-84cc-4bc3-97c0-aefbfa6e093f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:29.828441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-99d534a4-84cc-4bc3-97c0-aefbfa6e093f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:13:29.829665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-99d534a4-84cc-4bc3-97c0-aefbfa6e093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:29.952744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 12:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:13:30.111261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef2500-1f07-4b98-82e1-174977467c87 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:13:30.114031 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b0ef2500-1f07-4b98-82e1-174977467c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:30.242285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef2500-1f07-4b98-82e1-174977467c87 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:13:30.248365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b4353-0e90-4257-afc2-2b7a18ee54b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:13:30.249012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4353-0e90-4257-afc2-2b7a18ee54b9 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:30.249291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4353-0e90-4257-afc2-2b7a18ee54b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:30.249573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4353-0e90-4257-afc2-2b7a18ee54b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:30.258048 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b4353-0e90-4257-afc2-2b7a18ee54b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:13:30.259648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b4353-0e90-4257-afc2-2b7a18ee54b9 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:13:30.269027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 759/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:13:31.090281 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131ead1-9da4-4ecc-84ea-b41e87731c66 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:31.091098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131ead1-9da4-4ecc-84ea-b41e87731c66 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:31.091098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131ead1-9da4-4ecc-84ea-b41e87731c66 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:31.092338 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 12:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:13:31.099009 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20648d6b-599a-481a-83f1-9b93363326d3 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:31.099532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20648d6b-599a-481a-83f1-9b93363326d3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:31.099730 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20648d6b-599a-481a-83f1-9b93363326d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:31.121410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-20648d6b-599a-481a-83f1-9b93363326d3 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:13:31.123020 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-20648d6b-599a-481a-83f1-9b93363326d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:31.132035 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 12:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:13:31.284320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131ead1-9da4-4ecc-84ea-b41e87731c66 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:13:31.307736 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131ead1-9da4-4ecc-84ea-b41e87731c66 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:13:31.317838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54428bba-7b65-4b05-9b93-55d5f3c2575d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:13:31.318494 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54428bba-7b65-4b05-9b93-55d5f3c2575d service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:31.318785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54428bba-7b65-4b05-9b93-55d5f3c2575d service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:31.319100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54428bba-7b65-4b05-9b93-55d5f3c2575d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:31.328198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54428bba-7b65-4b05-9b93-55d5f3c2575d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:13:31.329810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54428bba-7b65-4b05-9b93-55d5f3c2575d service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:13:31.339739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 756/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:13:31.438332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f34c3-c75b-4bb9-a3a7-72f2cd0dc258 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:31.438599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f34c3-c75b-4bb9-a3a7-72f2cd0dc258 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:31.438954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f34c3-c75b-4bb9-a3a7-72f2cd0dc258 None None] PATH_INFO: `/v3` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:31.440288 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 761/1517] 10.222.0.27 () {54 vars in 925 bytes} [Thu Jul 21 12:13:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:13:31.448753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfab28-5b56-4c54-94dd-cb70514fb6c9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:31.448970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfab28-5b56-4c54-94dd-cb70514fb6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:31.449233 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfab28-5b56-4c54-94dd-cb70514fb6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:31.514190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-bbdfab28-5b56-4c54-94dd-cb70514fb6c9 None None] MFA Rules not processed for user `06c172bcd99f469f83728c98d061a7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:13:31.515435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bbdfab28-5b56-4c54-94dd-cb70514fb6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:31.533026 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:13:31.593245 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 757/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Jul 21 12:13:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:13:40.376212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b3e71-01a1-48b6-b9fe-104083553654 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:40.376798 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b3e71-01a1-48b6-b9fe-104083553654 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:40.376798 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b3e71-01a1-48b6-b9fe-104083553654 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:40.378054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 762/1519] 10.222.0.15 () {54 vars in 961 bytes} [Thu Jul 21 12:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:13:40.383931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33f32f-8443-490f-a7d7-f6648f73d467 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:40.384458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33f32f-8443-490f-a7d7-f6648f73d467 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:40.384458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33f32f-8443-490f-a7d7-f6648f73d467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:40.403822 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0e33f32f-8443-490f-a7d7-f6648f73d467 None None] MFA Rules not processed for user `06c172bcd99f469f83728c98d061a7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:13:40.405032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0e33f32f-8443-490f-a7d7-f6648f73d467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:40.414534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 758/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Jul 21 12:13:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:13:40.422480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b3e71-01a1-48b6-b9fe-104083553654 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:13:40.438277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b3e71-01a1-48b6-b9fe-104083553654 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:13:40.444897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791d7ac-0899-40aa-85d9-6682ff2ceead service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06c172bcd99f469f83728c98d061a7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:13:40.445656 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d7ac-0899-40aa-85d9-6682ff2ceead service placement] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:40.445938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d7ac-0899-40aa-85d9-6682ff2ceead service placement] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:40.446212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d7ac-0899-40aa-85d9-6682ff2ceead service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:40.455831 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791d7ac-0899-40aa-85d9-6682ff2ceead service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:13:40.457457 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791d7ac-0899-40aa-85d9-6682ff2ceead service placement] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:13:40.468196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 763/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:13:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:13:42.588717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47198-6f45-480b-b6d3-04701b248f44 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:42.589281 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47198-6f45-480b-b6d3-04701b248f44 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:42.589281 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47198-6f45-480b-b6d3-04701b248f44 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:42.590580 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 12:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:13:42.595822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2e6f1-05a1-44a4-9203-797e5c411040 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:42.596268 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2e6f1-05a1-44a4-9203-797e5c411040 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:42.596381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2e6f1-05a1-44a4-9203-797e5c411040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:42.615378 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-08b2e6f1-05a1-44a4-9203-797e5c411040 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:13:42.616680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-08b2e6f1-05a1-44a4-9203-797e5c411040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:42.625593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 12:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:13:42.778930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47198-6f45-480b-b6d3-04701b248f44 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:13:42.796026 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47198-6f45-480b-b6d3-04701b248f44 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:13:42.802152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0131e-bae3-4cfb-8a92-2b7f6dfaadfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:13:42.802823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0131e-bae3-4cfb-8a92-2b7f6dfaadfa service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:42.803104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0131e-bae3-4cfb-8a92-2b7f6dfaadfa service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:42.803383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0131e-bae3-4cfb-8a92-2b7f6dfaadfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:42.812676 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0131e-bae3-4cfb-8a92-2b7f6dfaadfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:13:42.814273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0131e-bae3-4cfb-8a92-2b7f6dfaadfa service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:13:42.825709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 760/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:13:43.641981 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ccff-5ee1-4457-918d-ff6a1ac79bad None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:43.642586 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ccff-5ee1-4457-918d-ff6a1ac79bad None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:43.642586 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ccff-5ee1-4457-918d-ff6a1ac79bad None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:43.643936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 12:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:13:43.648940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95adef-f24f-4bfb-bec4-2410a328d16d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:43.649428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95adef-f24f-4bfb-bec4-2410a328d16d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:43.649526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95adef-f24f-4bfb-bec4-2410a328d16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:43.669599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-cd95adef-f24f-4bfb-bec4-2410a328d16d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:13:43.670838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cd95adef-f24f-4bfb-bec4-2410a328d16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:43.680122 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 12:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:13:43.830167 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0ccff-5ee1-4457-918d-ff6a1ac79bad None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:13:43.846256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0ccff-5ee1-4457-918d-ff6a1ac79bad None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:13:43.852199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7dd6d-8acc-4371-8f76-835545ab4646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:13:43.852844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7dd6d-8acc-4371-8f76-835545ab4646 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:43.853130 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7dd6d-8acc-4371-8f76-835545ab4646 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:43.853404 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7dd6d-8acc-4371-8f76-835545ab4646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:43.861810 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7dd6d-8acc-4371-8f76-835545ab4646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:13:43.863428 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7dd6d-8acc-4371-8f76-835545ab4646 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:13:43.873046 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 766/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:13:47.758624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a052c2c-7219-4540-a30e-918e4cf08ab1 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:47.759249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a052c2c-7219-4540-a30e-918e4cf08ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:47.759249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a052c2c-7219-4540-a30e-918e4cf08ab1 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:47.760658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:13:47.766472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477c1f2-f539-4c74-965a-bb44995d8ca7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:47.766933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477c1f2-f539-4c74-965a-bb44995d8ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:47.767047 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477c1f2-f539-4c74-965a-bb44995d8ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:47.787158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6477c1f2-f539-4c74-965a-bb44995d8ca7 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:13:47.788409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6477c1f2-f539-4c74-965a-bb44995d8ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:47.798927 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:13:47.882246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a052c2c-7219-4540-a30e-918e4cf08ab1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:13:47.884309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3a052c2c-7219-4540-a30e-918e4cf08ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:47.971672 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a052c2c-7219-4540-a30e-918e4cf08ab1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:13:47.976027 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e9972-4bf4-4b74-b2c4-4cd94fd38725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:13:47.976686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e9972-4bf4-4b74-b2c4-4cd94fd38725 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:47.976974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e9972-4bf4-4b74-b2c4-4cd94fd38725 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:47.977254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e9972-4bf4-4b74-b2c4-4cd94fd38725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:47.990508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e9972-4bf4-4b74-b2c4-4cd94fd38725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:13:47.992209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e9972-4bf4-4b74-b2c4-4cd94fd38725 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:13:48.002174 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 763/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:13:50.032451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e17015-bb8b-4783-9da9-eecfb7f14c23 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:50.033055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e17015-bb8b-4783-9da9-eecfb7f14c23 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:50.033055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e17015-bb8b-4783-9da9-eecfb7f14c23 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:50.034385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:13:50.039788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d08675-854c-4337-be7f-0955748009fd None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:50.040250 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d08675-854c-4337-be7f-0955748009fd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:50.040367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d08675-854c-4337-be7f-0955748009fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:50.059308 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-83d08675-854c-4337-be7f-0955748009fd None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:13:50.060523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-83d08675-854c-4337-be7f-0955748009fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:50.068945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:13:50.106193 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e17015-bb8b-4783-9da9-eecfb7f14c23 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:13:50.108278 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d7e17015-bb8b-4783-9da9-eecfb7f14c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:50.123357 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e17015-bb8b-4783-9da9-eecfb7f14c23 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:13:50.127376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f55dc-715c-4ba6-8eec-9b2342c01885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:13:50.128347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f55dc-715c-4ba6-8eec-9b2342c01885 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:50.128629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f55dc-715c-4ba6-8eec-9b2342c01885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:50.128899 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f55dc-715c-4ba6-8eec-9b2342c01885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:50.139318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f55dc-715c-4ba6-8eec-9b2342c01885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:13:50.140761 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f55dc-715c-4ba6-8eec-9b2342c01885 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:13:50.151075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 769/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:13:53.585631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a131890-764f-49f6-9344-1dc02eb33d96 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:53.586338 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a131890-764f-49f6-9344-1dc02eb33d96 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:53.586338 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a131890-764f-49f6-9344-1dc02eb33d96 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:53.587712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:13:53.593762 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e818d9-f8c4-4fe3-971f-8792b8a477a6 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:53.594405 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e818d9-f8c4-4fe3-971f-8792b8a477a6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:53.594405 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e818d9-f8c4-4fe3-971f-8792b8a477a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:53.613843 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b2e818d9-f8c4-4fe3-971f-8792b8a477a6 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:13:53.615124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b2e818d9-f8c4-4fe3-971f-8792b8a477a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:53.624021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:13:53.947008 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a131890-764f-49f6-9344-1dc02eb33d96 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:13:53.950226 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7a131890-764f-49f6-9344-1dc02eb33d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:54.036310 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:13:54.051484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a131890-764f-49f6-9344-1dc02eb33d96 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:13:54.055862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2e080-b71c-4727-bf5b-59c3a53dc208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:13:54.056537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2e080-b71c-4727-bf5b-59c3a53dc208 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:54.056813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2e080-b71c-4727-bf5b-59c3a53dc208 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:54.057086 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2e080-b71c-4727-bf5b-59c3a53dc208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:54.067756 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2e080-b71c-4727-bf5b-59c3a53dc208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:13:54.069188 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2e080-b71c-4727-bf5b-59c3a53dc208 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:13:54.079819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 766/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:13:56.112191 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec0b4c-1df2-48ec-a44f-5604df6d4848 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:56.113070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec0b4c-1df2-48ec-a44f-5604df6d4848 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:56.113263 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec0b4c-1df2-48ec-a44f-5604df6d4848 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:56.115480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 12:13:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:13:56.120963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6e85a-a2ad-46d2-bee4-87922a0c2d0e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:56.121389 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6e85a-a2ad-46d2-bee4-87922a0c2d0e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:56.121507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6e85a-a2ad-46d2-bee4-87922a0c2d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:56.141065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d3c6e85a-a2ad-46d2-bee4-87922a0c2d0e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:13:56.142272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d3c6e85a-a2ad-46d2-bee4-87922a0c2d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:56.151027 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 12:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:13:56.453337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec0b4c-1df2-48ec-a44f-5604df6d4848 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:13:56.456163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9aec0b4c-1df2-48ec-a44f-5604df6d4848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:13:56.464957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=84 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:13:56.474250 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec0b4c-1df2-48ec-a44f-5604df6d4848 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:13:56.479172 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11da6aa-f62e-47de-b846-b7a5db158b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:13:56.479817 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11da6aa-f62e-47de-b846-b7a5db158b80 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:13:56.480099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11da6aa-f62e-47de-b846-b7a5db158b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:13:56.480371 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11da6aa-f62e-47de-b846-b7a5db158b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:13:56.489940 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11da6aa-f62e-47de-b846-b7a5db158b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:13:56.491378 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11da6aa-f62e-47de-b846-b7a5db158b80 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:13:56.501015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 772/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:14:06.135986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=11 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:14:06.496866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:28.928726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a785eb-e88f-4a5e-b90d-f25c7455e027 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:28.937083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a785eb-e88f-4a5e-b90d-f25c7455e027 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:28.937856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a785eb-e88f-4a5e-b90d-f25c7455e027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:28.967867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-84a785eb-e88f-4a5e-b90d-f25c7455e027 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:28.969212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-84a785eb-e88f-4a5e-b90d-f25c7455e027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:28.984930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 768/1540] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:28.994095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443f1c9-5e0f-4da9-a5c4-5bb705fbbe3b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:28.995285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443f1c9-5e0f-4da9-a5c4-5bb705fbbe3b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:28.995784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443f1c9-5e0f-4da9-a5c4-5bb705fbbe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.032494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3443f1c9-5e0f-4da9-a5c4-5bb705fbbe3b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:29.034341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3443f1c9-5e0f-4da9-a5c4-5bb705fbbe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:29.048607 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 773/1541] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:29.053708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a785eb-e88f-4a5e-b90d-f25c7455e027 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:29.068776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a785eb-e88f-4a5e-b90d-f25c7455e027 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:29.079159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c90783-2f17-4f36-a88b-d83aecadf725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:29.079883 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c90783-2f17-4f36-a88b-d83aecadf725 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.080171 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c90783-2f17-4f36-a88b-d83aecadf725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.080453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c90783-2f17-4f36-a88b-d83aecadf725 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.081252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c90783-2f17-4f36-a88b-d83aecadf725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:15:29.081569 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c90783-2f17-4f36-a88b-d83aecadf725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:29.083351 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c90783-2f17-4f36-a88b-d83aecadf725 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:29.103989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 769/1542] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:15:29.112487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443f1c9-5e0f-4da9-a5c4-5bb705fbbe3b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:29.129430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443f1c9-5e0f-4da9-a5c4-5bb705fbbe3b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:29.139476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d614a-aeac-4b0f-b440-df84a5a8b289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:29.140794 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d614a-aeac-4b0f-b440-df84a5a8b289 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.141400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d614a-aeac-4b0f-b440-df84a5a8b289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.141916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d614a-aeac-4b0f-b440-df84a5a8b289 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.143055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d614a-aeac-4b0f-b440-df84a5a8b289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:29.145438 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d614a-aeac-4b0f-b440-df84a5a8b289 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:29.207148 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 774/1543] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:15:29 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:29.211359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c90783-2f17-4f36-a88b-d83aecadf725 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:29.226186 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c90783-2f17-4f36-a88b-d83aecadf725 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:29.326072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171ac9d-23f2-4d8f-9f8f-3923ebfd0afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:29.326570 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9042a2-f243-4e7b-85e9-2c74deb896c2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.326888 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ac9d-23f2-4d8f-9f8f-3923ebfd0afb admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.327180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ac9d-23f2-4d8f-9f8f-3923ebfd0afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.327467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ac9d-23f2-4d8f-9f8f-3923ebfd0afb admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.327853 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9042a2-f243-4e7b-85e9-2c74deb896c2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.328327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171ac9d-23f2-4d8f-9f8f-3923ebfd0afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:29.328715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9042a2-f243-4e7b-85e9-2c74deb896c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.330511 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171ac9d-23f2-4d8f-9f8f-3923ebfd0afb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:29.368294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5b9042a2-f243-4e7b-85e9-2c74deb896c2 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:29.370071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5b9042a2-f243-4e7b-85e9-2c74deb896c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:29.373145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 770/1544] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:15:29 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:29.375107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601832c5-dad7-460a-bf7a-f86026a2dcb2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.375461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601832c5-dad7-460a-bf7a-f86026a2dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.377098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601832c5-dad7-460a-bf7a-f86026a2dcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.394467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 775/1545] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:29.395795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9042a2-f243-4e7b-85e9-2c74deb896c2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:29.415670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-601832c5-dad7-460a-bf7a-f86026a2dcb2 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:29.417018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-601832c5-dad7-460a-bf7a-f86026a2dcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:29.418231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9042a2-f243-4e7b-85e9-2c74deb896c2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:29.428204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08ba1c-1773-40b4-aac5-342a81d8d50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:29.429320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08ba1c-1773-40b4-aac5-342a81d8d50c admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.429834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08ba1c-1773-40b4-aac5-342a81d8d50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.430358 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08ba1c-1773-40b4-aac5-342a81d8d50c admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.431841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08ba1c-1773-40b4-aac5-342a81d8d50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:29.432448 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 771/1546] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:29.434116 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08ba1c-1773-40b4-aac5-342a81d8d50c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:29.434285 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef84c0-da8e-4c7a-84cd-6511f76b7c9c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.434541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef84c0-da8e-4c7a-84cd-6511f76b7c9c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.434869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef84c0-da8e-4c7a-84cd-6511f76b7c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.460820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 776/1547] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:29.465249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196f990-3048-49f0-970b-0374394f80fb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.465571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196f990-3048-49f0-970b-0374394f80fb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.467072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196f990-3048-49f0-970b-0374394f80fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.486485 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-72ef84c0-da8e-4c7a-84cd-6511f76b7c9c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:29.487788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-72ef84c0-da8e-4c7a-84cd-6511f76b7c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:29.505090 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 772/1548] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:29.506012 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef84c0-da8e-4c7a-84cd-6511f76b7c9c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:29.512411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9196f990-3048-49f0-970b-0374394f80fb None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:29.513666 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9196f990-3048-49f0-970b-0374394f80fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:29.525281 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef84c0-da8e-4c7a-84cd-6511f76b7c9c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:29.533743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 777/1549] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:29.534441 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196f990-3048-49f0-970b-0374394f80fb None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:29.537108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a2115-507e-4aed-996d-5104a4209188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:29.537970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a2115-507e-4aed-996d-5104a4209188 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.538266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a2115-507e-4aed-996d-5104a4209188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.538549 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a2115-507e-4aed-996d-5104a4209188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.539407 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a2115-507e-4aed-996d-5104a4209188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:29.541217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a2115-507e-4aed-996d-5104a4209188 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:29.556246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196f990-3048-49f0-970b-0374394f80fb None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:29.564590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 773/1550] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:29.565344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a2115-507e-4aed-996d-5104a4209188 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:29.566531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1135e-c560-44b2-a9f5-6fb4beedb383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:29.567954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1135e-c560-44b2-a9f5-6fb4beedb383 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.568249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1135e-c560-44b2-a9f5-6fb4beedb383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.568526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1135e-c560-44b2-a9f5-6fb4beedb383 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.569361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1135e-c560-44b2-a9f5-6fb4beedb383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:15:29.570036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1135e-c560-44b2-a9f5-6fb4beedb383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:29.571147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: WARNING py.warnings [None req-b5e1135e-c560-44b2-a9f5-6fb4beedb383 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:15:29.571147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: warnings.warn(msg) Jul 21 12:15:29.571147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: Jul 21 12:15:29.572088 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1135e-c560-44b2-a9f5-6fb4beedb383 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:29.593670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a2115-507e-4aed-996d-5104a4209188 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:29.613443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7062cb-1329-453b-9874-0ccc84386126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:29.614556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7062cb-1329-453b-9874-0ccc84386126 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.614822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 778/1551] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:15:29.616007 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1135e-c560-44b2-a9f5-6fb4beedb383 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:29.616619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7062cb-1329-453b-9874-0ccc84386126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.617794 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7062cb-1329-453b-9874-0ccc84386126 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.618887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7062cb-1329-453b-9874-0ccc84386126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:15:29.626006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7062cb-1329-453b-9874-0ccc84386126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:29.627807 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7062cb-1329-453b-9874-0ccc84386126 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:29.648739 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1135e-c560-44b2-a9f5-6fb4beedb383 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:29.649745 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 774/1552] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:15:29.653533 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a63d5-a67c-4424-87ba-05c70d8dedbb None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.653533 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a63d5-a67c-4424-87ba-05c70d8dedbb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.653533 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a63d5-a67c-4424-87ba-05c70d8dedbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.667586 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4956e-38ad-4394-9f18-5f00ae97e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:29.669146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4956e-38ad-4394-9f18-5f00ae97e4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.669664 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4956e-38ad-4394-9f18-5f00ae97e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.670195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4956e-38ad-4394-9f18-5f00ae97e4ba admin admin] PATH_INFO: `/v3/projects/a5be9596ebb94c2dbfb09d5a23698773/users/5a6cf4855b754111826284c3c6f43d98/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.696046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c29a63d5-a67c-4424-87ba-05c70d8dedbb None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:29.698010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c29a63d5-a67c-4424-87ba-05c70d8dedbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:29.710495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4956e-38ad-4394-9f18-5f00ae97e4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5be9596ebb94c2dbfb09d5a23698773, user_id=5a6cf4855b754111826284c3c6f43d98, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:29.713898 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4956e-38ad-4394-9f18-5f00ae97e4ba admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:29.716337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 775/1553] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:29.722707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a63d5-a67c-4424-87ba-05c70d8dedbb None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:29.737670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a63d5-a67c-4424-87ba-05c70d8dedbb None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:29.753478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 779/1554] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:29 2022] PUT /identity/v3/projects/a5be9596ebb94c2dbfb09d5a23698773/users/5a6cf4855b754111826284c3c6f43d98/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:29.755231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4956e-38ad-4394-9f18-5f00ae97e4ba admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:29.834598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4956e-38ad-4394-9f18-5f00ae97e4ba admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:29.840950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f06a25-a879-46fe-ae85-73b25b3c1640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:29.842460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06a25-a879-46fe-ae85-73b25b3c1640 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.843121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06a25-a879-46fe-ae85-73b25b3c1640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.843657 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06a25-a879-46fe-ae85-73b25b3c1640 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.844839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f06a25-a879-46fe-ae85-73b25b3c1640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:29.847550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f06a25-a879-46fe-ae85-73b25b3c1640 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:29.859908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a9e27-ce59-40b5-b2fc-f85abf0c444a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:29.861052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a9e27-ce59-40b5-b2fc-f85abf0c444a admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.861638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a9e27-ce59-40b5-b2fc-f85abf0c444a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.861987 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a9e27-ce59-40b5-b2fc-f85abf0c444a admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.863425 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a9e27-ce59-40b5-b2fc-f85abf0c444a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:29.865593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-482a9e27-ce59-40b5-b2fc-f85abf0c444a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:15:29.865593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 21 12:15:29.865593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: Jul 21 12:15:29.868018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a9e27-ce59-40b5-b2fc-f85abf0c444a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:29.890728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 780/1555] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:15:29 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:29.890728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ac412-8e2b-42af-a9c1-d6649473ccf2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.890728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ac412-8e2b-42af-a9c1-d6649473ccf2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.890728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ac412-8e2b-42af-a9c1-d6649473ccf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.911040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1d5ac412-8e2b-42af-a9c1-d6649473ccf2 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:29.912257 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1d5ac412-8e2b-42af-a9c1-d6649473ccf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:29.920040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 776/1556] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:15:29 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:29.922925 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1254bf1-4b07-4d16-89fe-efa55277502d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.923761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1254bf1-4b07-4d16-89fe-efa55277502d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.924257 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1254bf1-4b07-4d16-89fe-efa55277502d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:29.957197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e1254bf1-4b07-4d16-89fe-efa55277502d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:29.958832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e1254bf1-4b07-4d16-89fe-efa55277502d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:29.967510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:29.983264 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:29.990816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 781/1557] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:29.995913 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697af33-d232-4988-a8ec-cbbd829d7293 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:29.996630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697af33-d232-4988-a8ec-cbbd829d7293 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:29.996630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697af33-d232-4988-a8ec-cbbd829d7293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.017300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4697af33-d232-4988-a8ec-cbbd829d7293 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:30.019149 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4697af33-d232-4988-a8ec-cbbd829d7293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:30.061104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 777/1558] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:30.062702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea92cb-3215-4e1e-80ba-915af914352a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.062983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea92cb-3215-4e1e-80ba-915af914352a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.063258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea92cb-3215-4e1e-80ba-915af914352a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.084500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0eea92cb-3215-4e1e-80ba-915af914352a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:30.085741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0eea92cb-3215-4e1e-80ba-915af914352a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:30.092628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 782/1559] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:30.094239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fe696-6216-48cf-86da-32a8b73c6493 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.094574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fe696-6216-48cf-86da-32a8b73c6493 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.102303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fe696-6216-48cf-86da-32a8b73c6493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.103003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 778/1560] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:30.103003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea92cb-3215-4e1e-80ba-915af914352a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.111869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea92cb-3215-4e1e-80ba-915af914352a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.116831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc4abe-ad97-4779-aaac-53dd94de9f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.117530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc4abe-ad97-4779-aaac-53dd94de9f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.118038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc4abe-ad97-4779-aaac-53dd94de9f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.118318 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc4abe-ad97-4779-aaac-53dd94de9f55 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.119169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc4abe-ad97-4779-aaac-53dd94de9f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.121304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc4abe-ad97-4779-aaac-53dd94de9f55 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.123324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-358fe696-6216-48cf-86da-32a8b73c6493 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:30.124753 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-358fe696-6216-48cf-86da-32a8b73c6493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:30.135332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 783/1561] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:30.136013 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fe696-6216-48cf-86da-32a8b73c6493 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.147122 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fe696-6216-48cf-86da-32a8b73c6493 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.152115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447bb0e-5e51-4a3c-9e15-d94ff266ee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.152839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447bb0e-5e51-4a3c-9e15-d94ff266ee9d admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.153126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447bb0e-5e51-4a3c-9e15-d94ff266ee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.153405 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447bb0e-5e51-4a3c-9e15-d94ff266ee9d admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.154126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447bb0e-5e51-4a3c-9e15-d94ff266ee9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.155198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: WARNING py.warnings [None req-6447bb0e-5e51-4a3c-9e15-d94ff266ee9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:15:30.155198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: warnings.warn(msg) Jul 21 12:15:30.155198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: Jul 21 12:15:30.160879 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 779/1562] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:15:30 2022] POST /identity/v3/users => generated 293 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:30.161198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447bb0e-5e51-4a3c-9e15-d94ff266ee9d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.161345 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dba97b-aef6-4f46-b80b-1e507e006321 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.161345 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dba97b-aef6-4f46-b80b-1e507e006321 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.161345 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dba97b-aef6-4f46-b80b-1e507e006321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.179916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 784/1563] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:15:30 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:30.181184 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447bb0e-5e51-4a3c-9e15-d94ff266ee9d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.183632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a7dba97b-aef6-4f46-b80b-1e507e006321 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:30.185742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a7dba97b-aef6-4f46-b80b-1e507e006321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:30.191974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447bb0e-5e51-4a3c-9e15-d94ff266ee9d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.195058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 780/1564] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:30.196578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79636c-b0fd-438e-b1b0-a353f86c72e4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.196870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79636c-b0fd-438e-b1b0-a353f86c72e4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.197149 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79636c-b0fd-438e-b1b0-a353f86c72e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.204879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258ffd-6510-4c06-995a-e91f265c7883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.205571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258ffd-6510-4c06-995a-e91f265c7883 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.205855 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258ffd-6510-4c06-995a-e91f265c7883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.206145 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258ffd-6510-4c06-995a-e91f265c7883 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.206916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32258ffd-6510-4c06-995a-e91f265c7883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:15:30.207219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32258ffd-6510-4c06-995a-e91f265c7883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.208859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32258ffd-6510-4c06-995a-e91f265c7883 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.218000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9e79636c-b0fd-438e-b1b0-a353f86c72e4 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:30.219220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9e79636c-b0fd-438e-b1b0-a353f86c72e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:30.223211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 785/1565] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:15:30.224569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00144b-8f7a-406e-8f75-e0f49ce05c6c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.224913 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00144b-8f7a-406e-8f75-e0f49ce05c6c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.225188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00144b-8f7a-406e-8f75-e0f49ce05c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.237931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 781/1566] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:30.239732 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79636c-b0fd-438e-b1b0-a353f86c72e4 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.252680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ba00144b-8f7a-406e-8f75-e0f49ce05c6c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:30.253924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ba00144b-8f7a-406e-8f75-e0f49ce05c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:30.262491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 786/1567] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:30.263878 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60128-6659-47e5-bd94-b7c81ab4157c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.264163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60128-6659-47e5-bd94-b7c81ab4157c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.264437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60128-6659-47e5-bd94-b7c81ab4157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.284317 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9aa60128-6659-47e5-bd94-b7c81ab4157c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:30.285552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9aa60128-6659-47e5-bd94-b7c81ab4157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:30.294491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 787/1568] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:30.295619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa60128-6659-47e5-bd94-b7c81ab4157c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.310980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa60128-6659-47e5-bd94-b7c81ab4157c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.314882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79636c-b0fd-438e-b1b0-a353f86c72e4 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.316537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5582e-9c91-456a-aa3f-ab452a1b0441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.317354 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5582e-9c91-456a-aa3f-ab452a1b0441 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.317739 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5582e-9c91-456a-aa3f-ab452a1b0441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.318138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5582e-9c91-456a-aa3f-ab452a1b0441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.318974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb592250-3d0d-43d8-a0c5-e9fd38afc0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.319232 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5582e-9c91-456a-aa3f-ab452a1b0441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.319645 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb592250-3d0d-43d8-a0c5-e9fd38afc0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.319932 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb592250-3d0d-43d8-a0c5-e9fd38afc0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.320217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb592250-3d0d-43d8-a0c5-e9fd38afc0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.321650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5582e-9c91-456a-aa3f-ab452a1b0441 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.331083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb592250-3d0d-43d8-a0c5-e9fd38afc0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.332738 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb592250-3d0d-43d8-a0c5-e9fd38afc0e1 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.334615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 788/1569] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:30.336228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5582e-9c91-456a-aa3f-ab452a1b0441 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.344403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 782/1570] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:30.345798 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd8fad-324c-4cfd-8ba4-c078c9a49cb5 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.346088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd8fad-324c-4cfd-8ba4-c078c9a49cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.346379 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd8fad-324c-4cfd-8ba4-c078c9a49cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.350957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5582e-9c91-456a-aa3f-ab452a1b0441 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.358375 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2ecf2-7aed-4e18-8419-560ed51e1961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.359608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2ecf2-7aed-4e18-8419-560ed51e1961 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.360015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2ecf2-7aed-4e18-8419-560ed51e1961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.360458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2ecf2-7aed-4e18-8419-560ed51e1961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.362290 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2ecf2-7aed-4e18-8419-560ed51e1961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.364568 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2ecf2-7aed-4e18-8419-560ed51e1961 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.368257 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8ddd8fad-324c-4cfd-8ba4-c078c9a49cb5 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:30.369705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8ddd8fad-324c-4cfd-8ba4-c078c9a49cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:30.379550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 789/1571] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:30.380040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 783/1572] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:30.381090 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd8fad-324c-4cfd-8ba4-c078c9a49cb5 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.381857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2ecf2-7aed-4e18-8419-560ed51e1961 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.403859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd8fad-324c-4cfd-8ba4-c078c9a49cb5 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.404291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2ecf2-7aed-4e18-8419-560ed51e1961 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.412273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6ab61-38cc-4a98-ad4d-85d382b6faac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.413350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6ab61-38cc-4a98-ad4d-85d382b6faac admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.413759 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869fba0-996e-4fac-8684-955bbb1d82de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.413891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6ab61-38cc-4a98-ad4d-85d382b6faac admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.414246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6ab61-38cc-4a98-ad4d-85d382b6faac admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.415111 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869fba0-996e-4fac-8684-955bbb1d82de admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.415565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6ab61-38cc-4a98-ad4d-85d382b6faac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:15:30.415689 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869fba0-996e-4fac-8684-955bbb1d82de admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.416099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6ab61-38cc-4a98-ad4d-85d382b6faac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.416255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869fba0-996e-4fac-8684-955bbb1d82de admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.418832 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869fba0-996e-4fac-8684-955bbb1d82de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.419696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6ab61-38cc-4a98-ad4d-85d382b6faac admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.423777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869fba0-996e-4fac-8684-955bbb1d82de admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.447812 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 784/1573] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:15:30.449750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6ab61-38cc-4a98-ad4d-85d382b6faac admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.475378 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6ab61-38cc-4a98-ad4d-85d382b6faac admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.484613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2238a9-6762-40b2-9a11-15626078ac3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.488271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 790/1574] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:15:30 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:30.488637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2238a9-6762-40b2-9a11-15626078ac3c admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.488751 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869fba0-996e-4fac-8684-955bbb1d82de admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.488851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2238a9-6762-40b2-9a11-15626078ac3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.488851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2238a9-6762-40b2-9a11-15626078ac3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.489168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2238a9-6762-40b2-9a11-15626078ac3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:15:30.489714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2238a9-6762-40b2-9a11-15626078ac3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.493101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2238a9-6762-40b2-9a11-15626078ac3c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.525578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 785/1575] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:15:30.525578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2238a9-6762-40b2-9a11-15626078ac3c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.535435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2238a9-6762-40b2-9a11-15626078ac3c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.573723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:30.588746 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869fba0-996e-4fac-8684-955bbb1d82de admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.599065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4e59e-f6c2-4457-a9f2-39e2fe0b0ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.600101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4e59e-f6c2-4457-a9f2-39e2fe0b0ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.600551 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4e59e-f6c2-4457-a9f2-39e2fe0b0ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.600989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4e59e-f6c2-4457-a9f2-39e2fe0b0ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.602085 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4e59e-f6c2-4457-a9f2-39e2fe0b0ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:15:30.602554 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4e59e-f6c2-4457-a9f2-39e2fe0b0ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.605715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4e59e-f6c2-4457-a9f2-39e2fe0b0ac2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.627410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 791/1576] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:15:30.628837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4e59e-f6c2-4457-a9f2-39e2fe0b0ac2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.632857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:30.648451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4e59e-f6c2-4457-a9f2-39e2fe0b0ac2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.655531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6114c0-16fd-4cfc-9d8c-8cbc4f178db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.656852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6114c0-16fd-4cfc-9d8c-8cbc4f178db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.657025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314448c5-b907-4405-a667-f85b3fca51b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.657693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6114c0-16fd-4cfc-9d8c-8cbc4f178db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.658558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314448c5-b907-4405-a667-f85b3fca51b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.658735 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6114c0-16fd-4cfc-9d8c-8cbc4f178db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.658936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314448c5-b907-4405-a667-f85b3fca51b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.659486 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314448c5-b907-4405-a667-f85b3fca51b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.660018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6114c0-16fd-4cfc-9d8c-8cbc4f178db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.660905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314448c5-b907-4405-a667-f85b3fca51b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:15:30.661458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314448c5-b907-4405-a667-f85b3fca51b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.662400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6114c0-16fd-4cfc-9d8c-8cbc4f178db5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.664719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314448c5-b907-4405-a667-f85b3fca51b1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.685553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 786/1577] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:30.685553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6114c0-16fd-4cfc-9d8c-8cbc4f178db5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.703873 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 792/1578] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:15:30.703873 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314448c5-b907-4405-a667-f85b3fca51b1 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.704311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6114c0-16fd-4cfc-9d8c-8cbc4f178db5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.713291 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b50fb-f361-4ba0-a6d0-8513617f1bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.715159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b50fb-f361-4ba0-a6d0-8513617f1bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.716229 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b50fb-f361-4ba0-a6d0-8513617f1bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.717598 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b50fb-f361-4ba0-a6d0-8513617f1bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.719062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b50fb-f361-4ba0-a6d0-8513617f1bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.722647 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b50fb-f361-4ba0-a6d0-8513617f1bcc admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.723860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314448c5-b907-4405-a667-f85b3fca51b1 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.731908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86748b6a-51f7-4c02-8812-2281c0b81a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.732791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86748b6a-51f7-4c02-8812-2281c0b81a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.733266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86748b6a-51f7-4c02-8812-2281c0b81a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.733701 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86748b6a-51f7-4c02-8812-2281c0b81a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.734909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86748b6a-51f7-4c02-8812-2281c0b81a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.737753 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86748b6a-51f7-4c02-8812-2281c0b81a0e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.745584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 787/1579] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:30.745584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b50fb-f361-4ba0-a6d0-8513617f1bcc admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.777827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b50fb-f361-4ba0-a6d0-8513617f1bcc admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.786863 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953100f-37da-4720-a5d4-5723a4286d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.788271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953100f-37da-4720-a5d4-5723a4286d1c admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.788870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953100f-37da-4720-a5d4-5723a4286d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.789384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953100f-37da-4720-a5d4-5723a4286d1c admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.790787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953100f-37da-4720-a5d4-5723a4286d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.794931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953100f-37da-4720-a5d4-5723a4286d1c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.795619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 793/1580] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:15:30 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:30.796879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86748b6a-51f7-4c02-8812-2281c0b81a0e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.847659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 788/1581] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:15:30 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:30.848734 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953100f-37da-4720-a5d4-5723a4286d1c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.883500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953100f-37da-4720-a5d4-5723a4286d1c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.926467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86748b6a-51f7-4c02-8812-2281c0b81a0e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:30.939097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917b1fa-e573-4f35-a71b-b6d80bae1283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.939973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917b1fa-e573-4f35-a71b-b6d80bae1283 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.940377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917b1fa-e573-4f35-a71b-b6d80bae1283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.940787 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917b1fa-e573-4f35-a71b-b6d80bae1283 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.941629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917b1fa-e573-4f35-a71b-b6d80bae1283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.944434 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917b1fa-e573-4f35-a71b-b6d80bae1283 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:30.980641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47f3a4-a652-400e-9b21-4bf1e45279b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:30.981540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47f3a4-a652-400e-9b21-4bf1e45279b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:30.981540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47f3a4-a652-400e-9b21-4bf1e45279b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:30.981854 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47f3a4-a652-400e-9b21-4bf1e45279b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:30.982074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 794/1582] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:15:30 2022] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:30.982627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47f3a4-a652-400e-9b21-4bf1e45279b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:30.982917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917b1fa-e573-4f35-a71b-b6d80bae1283 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:30.984833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47f3a4-a652-400e-9b21-4bf1e45279b9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:31.017825 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 789/1583] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:15:30 2022] POST /identity/v3/projects => generated 405 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:31.018696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47f3a4-a652-400e-9b21-4bf1e45279b9 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:31.068393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917b1fa-e573-4f35-a71b-b6d80bae1283 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:31.099513 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47f3a4-a652-400e-9b21-4bf1e45279b9 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:31.107400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11221333-94a7-4952-a9f5-883dc30e82f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:31.108113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11221333-94a7-4952-a9f5-883dc30e82f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.108393 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11221333-94a7-4952-a9f5-883dc30e82f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.108664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11221333-94a7-4952-a9f5-883dc30e82f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.109422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11221333-94a7-4952-a9f5-883dc30e82f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:31.111438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11221333-94a7-4952-a9f5-883dc30e82f6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:31.125446 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:31.151764 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 790/1584] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:15:31 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:31.157576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11221333-94a7-4952-a9f5-883dc30e82f6 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:31.162449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68439d10-a51b-4b57-856d-b4f401e05a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:31.164063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68439d10-a51b-4b57-856d-b4f401e05a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.164518 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68439d10-a51b-4b57-856d-b4f401e05a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.164989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68439d10-a51b-4b57-856d-b4f401e05a6f admin admin] PATH_INFO: `/v3/projects/a3468bc2f0694b9ba4fcfbf5b68bda94/users/491d61d97e114e5988bab922a0f366bc/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.202697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68439d10-a51b-4b57-856d-b4f401e05a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3468bc2f0694b9ba4fcfbf5b68bda94, user_id=491d61d97e114e5988bab922a0f366bc, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:31.205953 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:31.207522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68439d10-a51b-4b57-856d-b4f401e05a6f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:31.237431 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 795/1585] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:30 2022] PUT /identity/v3/projects/a3468bc2f0694b9ba4fcfbf5b68bda94/users/491d61d97e114e5988bab922a0f366bc/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:31.238038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68439d10-a51b-4b57-856d-b4f401e05a6f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:31.294303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11221333-94a7-4952-a9f5-883dc30e82f6 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:31.340456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68439d10-a51b-4b57-856d-b4f401e05a6f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:31.347465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3c2f5-a523-4070-9053-f334a0d5c345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:31.348462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3c2f5-a523-4070-9053-f334a0d5c345 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.348974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3c2f5-a523-4070-9053-f334a0d5c345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.349430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3c2f5-a523-4070-9053-f334a0d5c345 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.351191 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3c2f5-a523-4070-9053-f334a0d5c345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:31.354446 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3c2f5-a523-4070-9053-f334a0d5c345 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:31.383810 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 796/1586] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:15:31 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:31.385049 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3c2f5-a523-4070-9053-f334a0d5c345 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:31.388930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ab241-d1aa-43f3-90c9-cda9e554d172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:31.390330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ab241-d1aa-43f3-90c9-cda9e554d172 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.390883 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ab241-d1aa-43f3-90c9-cda9e554d172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.391419 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ab241-d1aa-43f3-90c9-cda9e554d172 admin admin] PATH_INFO: `/v3/projects/0cb3da8e6c6e4691a1847419c6c6ff27/users/e2a6ed87df76453490b8ba89d1bb98f8/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.402181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3c2f5-a523-4070-9053-f334a0d5c345 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:31.408222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc710a09-f261-4a3b-aaa3-9a8298976727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:31.408552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc710a09-f261-4a3b-aaa3-9a8298976727 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.408552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc710a09-f261-4a3b-aaa3-9a8298976727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.408844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc710a09-f261-4a3b-aaa3-9a8298976727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.409578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc710a09-f261-4a3b-aaa3-9a8298976727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:31.411965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc710a09-f261-4a3b-aaa3-9a8298976727 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:31.412266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ab241-d1aa-43f3-90c9-cda9e554d172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb3da8e6c6e4691a1847419c6c6ff27, user_id=e2a6ed87df76453490b8ba89d1bb98f8, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:31.413398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-d05ab241-d1aa-43f3-90c9-cda9e554d172 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:15:31.413398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 21 12:15:31.413398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: Jul 21 12:15:31.415689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ab241-d1aa-43f3-90c9-cda9e554d172 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:31.429633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 797/1587] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:31.431693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc710a09-f261-4a3b-aaa3-9a8298976727 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:31.439037 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 791/1588] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:31 2022] PUT /identity/v3/projects/0cb3da8e6c6e4691a1847419c6c6ff27/users/e2a6ed87df76453490b8ba89d1bb98f8/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:31.440343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ab241-d1aa-43f3-90c9-cda9e554d172 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:31.459080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc710a09-f261-4a3b-aaa3-9a8298976727 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:31.568759 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f8212-b462-4b4b-a971-297ad1e2bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:31.570568 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f8212-b462-4b4b-a971-297ad1e2bb45 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.571255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f8212-b462-4b4b-a971-297ad1e2bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.573031 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f8212-b462-4b4b-a971-297ad1e2bb45 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.573974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f8212-b462-4b4b-a971-297ad1e2bb45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:31.578087 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f8212-b462-4b4b-a971-297ad1e2bb45 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:31.602287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ab241-d1aa-43f3-90c9-cda9e554d172 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:31.609408 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14787d-6e98-486c-afaa-60e9d24bd1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:31.610642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14787d-6e98-486c-afaa-60e9d24bd1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.610965 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14787d-6e98-486c-afaa-60e9d24bd1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.611332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14787d-6e98-486c-afaa-60e9d24bd1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.612080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14787d-6e98-486c-afaa-60e9d24bd1d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:31.614993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14787d-6e98-486c-afaa-60e9d24bd1d5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:31.628721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 798/1589] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:15:31 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:31.630633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f8212-b462-4b4b-a971-297ad1e2bb45 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:31.669263 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f8212-b462-4b4b-a971-297ad1e2bb45 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:31.673793 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 792/1590] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:15:31 2022] POST /identity/v3/users => generated 303 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:31.675734 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18754c7-348d-4432-8b17-49643ba9cc73 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.676030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18754c7-348d-4432-8b17-49643ba9cc73 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.676315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18754c7-348d-4432-8b17-49643ba9cc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.689657 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679e8a1-df53-4fca-83f3-840da81d0be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:31.691297 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679e8a1-df53-4fca-83f3-840da81d0be1 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.691775 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679e8a1-df53-4fca-83f3-840da81d0be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.692253 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679e8a1-df53-4fca-83f3-840da81d0be1 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.693599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679e8a1-df53-4fca-83f3-840da81d0be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:31.697082 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679e8a1-df53-4fca-83f3-840da81d0be1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:31.716579 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e18754c7-348d-4432-8b17-49643ba9cc73 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:31.718959 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e18754c7-348d-4432-8b17-49643ba9cc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:31.732198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 793/1591] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:31.733797 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18754c7-348d-4432-8b17-49643ba9cc73 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:31.766514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 799/1592] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:15:31 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:31.767804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679e8a1-df53-4fca-83f3-840da81d0be1 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:31.772925 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18754c7-348d-4432-8b17-49643ba9cc73 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:31.779917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3115c-0146-410c-9b91-31a46690f0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:31.782019 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3115c-0146-410c-9b91-31a46690f0cd admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.782620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3115c-0146-410c-9b91-31a46690f0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.783136 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3115c-0146-410c-9b91-31a46690f0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.784143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3115c-0146-410c-9b91-31a46690f0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:31.786934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3115c-0146-410c-9b91-31a46690f0cd admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:31.790967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679e8a1-df53-4fca-83f3-840da81d0be1 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:31.806561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 794/1593] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:31.809619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59df52-cd51-436e-a8f9-56f53affb6ec None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.810177 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59df52-cd51-436e-a8f9-56f53affb6ec None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.810613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59df52-cd51-436e-a8f9-56f53affb6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.824719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338823b7-16de-45d9-89d6-9e3eefd57134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:31.826115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338823b7-16de-45d9-89d6-9e3eefd57134 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.828320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338823b7-16de-45d9-89d6-9e3eefd57134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.829938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338823b7-16de-45d9-89d6-9e3eefd57134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.833427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338823b7-16de-45d9-89d6-9e3eefd57134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:31.840787 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338823b7-16de-45d9-89d6-9e3eefd57134 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:31.853598 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9a59df52-cd51-436e-a8f9-56f53affb6ec None None] MFA Rules not processed for user `e2a6ed87df76453490b8ba89d1bb98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:31.854920 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9a59df52-cd51-436e-a8f9-56f53affb6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:31.879509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:31.886704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 800/1594] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:31.887748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338823b7-16de-45d9-89d6-9e3eefd57134 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:31.899624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338823b7-16de-45d9-89d6-9e3eefd57134 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:31.906887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6d7c4-a695-4f59-a413-ea6281d50cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:31.907922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6d7c4-a695-4f59-a413-ea6281d50cec admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.908357 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6d7c4-a695-4f59-a413-ea6281d50cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.908759 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6d7c4-a695-4f59-a413-ea6281d50cec admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.909808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6d7c4-a695-4f59-a413-ea6281d50cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:31.912127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6d7c4-a695-4f59-a413-ea6281d50cec admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:31.919053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:31.929931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 801/1595] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:31.931565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6d7c4-a695-4f59-a413-ea6281d50cec admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:31.944772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6d7c4-a695-4f59-a413-ea6281d50cec admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:31.951066 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185812c-d23b-4065-b309-7dabf4fb7dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:31.951936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185812c-d23b-4065-b309-7dabf4fb7dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.952782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185812c-d23b-4065-b309-7dabf4fb7dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.953259 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185812c-d23b-4065-b309-7dabf4fb7dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.954215 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185812c-d23b-4065-b309-7dabf4fb7dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:31.956198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185812c-d23b-4065-b309-7dabf4fb7dbb admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:31.962634 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 795/1596] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:31.974275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59df52-cd51-436e-a8f9-56f53affb6ec None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:31.974581 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 802/1597] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:31.975751 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185812c-d23b-4065-b309-7dabf4fb7dbb admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:31.988458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185812c-d23b-4065-b309-7dabf4fb7dbb admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:31.994478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e743f90-cfa2-4fb0-b702-6a24a7b1ef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:31.995502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e743f90-cfa2-4fb0-b702-6a24a7b1ef02 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:31.995886 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e743f90-cfa2-4fb0-b702-6a24a7b1ef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:31.996310 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e743f90-cfa2-4fb0-b702-6a24a7b1ef02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:31.997354 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e743f90-cfa2-4fb0-b702-6a24a7b1ef02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:31.999469 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e743f90-cfa2-4fb0-b702-6a24a7b1ef02 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:32.019302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 803/1598] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:32.024722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e743f90-cfa2-4fb0-b702-6a24a7b1ef02 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:32.056407 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e743f90-cfa2-4fb0-b702-6a24a7b1ef02 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:32.064399 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d11e10-d81e-48fe-a8df-85fe73f35498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:32.065494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d11e10-d81e-48fe-a8df-85fe73f35498 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:32.065968 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d11e10-d81e-48fe-a8df-85fe73f35498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:32.066447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d11e10-d81e-48fe-a8df-85fe73f35498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:32.067874 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d11e10-d81e-48fe-a8df-85fe73f35498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:32.071112 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59df52-cd51-436e-a8f9-56f53affb6ec None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:32.071669 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d11e10-d81e-48fe-a8df-85fe73f35498 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:32.077892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63bea1-b946-4599-80f0-9f9aa862d696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:32.079215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63bea1-b946-4599-80f0-9f9aa862d696 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:32.079702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63bea1-b946-4599-80f0-9f9aa862d696 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:32.080420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63bea1-b946-4599-80f0-9f9aa862d696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:32.090722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 804/1599] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:32.092148 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d11e10-d81e-48fe-a8df-85fe73f35498 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:32.108758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d11e10-d81e-48fe-a8df-85fe73f35498 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:32.109493 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63bea1-b946-4599-80f0-9f9aa862d696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:32.116312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63bea1-b946-4599-80f0-9f9aa862d696 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:32.116640 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278cf61-9022-4850-92d9-1ac2a13d9c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:32.118124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278cf61-9022-4850-92d9-1ac2a13d9c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:32.118566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278cf61-9022-4850-92d9-1ac2a13d9c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:32.119293 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278cf61-9022-4850-92d9-1ac2a13d9c7f admin admin] PATH_INFO: `/v3/projects/c9e53a28bd134bceb81cf364b7f1b7d6/users/2b092b666ad84405a6ed07827fcd8a87/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:32.136006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 796/1600] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:32.137566 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63bea1-b946-4599-80f0-9f9aa862d696 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:32.147997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278cf61-9022-4850-92d9-1ac2a13d9c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e53a28bd134bceb81cf364b7f1b7d6, user_id=2b092b666ad84405a6ed07827fcd8a87, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:32.153450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278cf61-9022-4850-92d9-1ac2a13d9c7f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:32.155278 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63bea1-b946-4599-80f0-9f9aa862d696 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:32.166834 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5976e0-ba91-4604-981e-48cf3dfd103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:32.167950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5976e0-ba91-4604-981e-48cf3dfd103e admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:32.168402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5976e0-ba91-4604-981e-48cf3dfd103e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:32.168839 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5976e0-ba91-4604-981e-48cf3dfd103e admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:32.170356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5976e0-ba91-4604-981e-48cf3dfd103e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:32.175214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5976e0-ba91-4604-981e-48cf3dfd103e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:32.181298 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 805/1601] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:32 2022] PUT /identity/v3/projects/c9e53a28bd134bceb81cf364b7f1b7d6/users/2b092b666ad84405a6ed07827fcd8a87/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:32.183004 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278cf61-9022-4850-92d9-1ac2a13d9c7f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:32.202612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 797/1602] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:32.202612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd6ffd-ba73-4567-bc0a-6a417670ffca None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:32.202944 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd6ffd-ba73-4567-bc0a-6a417670ffca None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:32.203354 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd6ffd-ba73-4567-bc0a-6a417670ffca None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:32.206220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 798/1603] 10.222.0.15 () {54 vars in 962 bytes} [Thu Jul 21 12:15:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:15:32.207725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd6ffd-ba73-4567-bc0a-6a417670ffca None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:32.295286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd6ffd-ba73-4567-bc0a-6a417670ffca None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:32.300422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b2ece-6b98-4147-b7c9-f6a4a86b8cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:32.301249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b2ece-6b98-4147-b7c9-f6a4a86b8cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:32.301532 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b2ece-6b98-4147-b7c9-f6a4a86b8cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:32.301877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b2ece-6b98-4147-b7c9-f6a4a86b8cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:32.302861 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b2ece-6b98-4147-b7c9-f6a4a86b8cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:32.304641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b2ece-6b98-4147-b7c9-f6a4a86b8cd5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:32.317614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 799/1604] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:32.318676 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b2ece-6b98-4147-b7c9-f6a4a86b8cd5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:32.330692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b2ece-6b98-4147-b7c9-f6a4a86b8cd5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:32.336142 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcfe50-1894-4a5d-96b8-e5ae22a87054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:32.337089 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcfe50-1894-4a5d-96b8-e5ae22a87054 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:32.337495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcfe50-1894-4a5d-96b8-e5ae22a87054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:32.337780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcfe50-1894-4a5d-96b8-e5ae22a87054 admin admin] PATH_INFO: `/v3/projects/a9394be48a1641aea48adb937993faaa/users/e255fb99a08c41289688042238d152ac/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:32.356638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcfe50-1894-4a5d-96b8-e5ae22a87054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9394be48a1641aea48adb937993faaa, user_id=e255fb99a08c41289688042238d152ac, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:32.360057 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcfe50-1894-4a5d-96b8-e5ae22a87054 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:32.380515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 800/1605] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:32 2022] PUT /identity/v3/projects/a9394be48a1641aea48adb937993faaa/users/e255fb99a08c41289688042238d152ac/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:32.386845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6d59-dcec-4176-996b-111fd8401cfe None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:32.387190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6d59-dcec-4176-996b-111fd8401cfe None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:32.387424 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6d59-dcec-4176-996b-111fd8401cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:32.407348 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278cf61-9022-4850-92d9-1ac2a13d9c7f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:32.412030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7c5a6d59-dcec-4176-996b-111fd8401cfe None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:32.413436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7c5a6d59-dcec-4176-996b-111fd8401cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:32.432856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:32.605996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa8fa8-2e17-468f-ba24-c4455574118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:32.607635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa8fa8-2e17-468f-ba24-c4455574118e admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:32.609336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa8fa8-2e17-468f-ba24-c4455574118e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:32.609597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa8fa8-2e17-468f-ba24-c4455574118e admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:32.611120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa8fa8-2e17-468f-ba24-c4455574118e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:32.614466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa8fa8-2e17-468f-ba24-c4455574118e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:32.633055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 801/1606] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:32.637551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a6d59-dcec-4176-996b-111fd8401cfe None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:32.649819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 806/1607] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:32.655384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ef51c-181c-4793-a8b3-e45ad70bc013 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:32.655682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ef51c-181c-4793-a8b3-e45ad70bc013 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:32.655967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ef51c-181c-4793-a8b3-e45ad70bc013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:32.682857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a6d59-dcec-4176-996b-111fd8401cfe None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:32.701886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79373f5e-fe80-493d-938d-0c62b6e7ad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:32.708463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79373f5e-fe80-493d-938d-0c62b6e7ad0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:32.709146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79373f5e-fe80-493d-938d-0c62b6e7ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:32.709831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79373f5e-fe80-493d-938d-0c62b6e7ad0b admin admin] PATH_INFO: `/v3/projects/6f13cf466a4b40acaf0c98516c5fa5b1/users/d9a96b51c98344a09cc59af05dd455ef/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:32.741875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a93ef51c-181c-4793-a8b3-e45ad70bc013 None None] MFA Rules not processed for user `f3fb1d091b27472081549f4166ca172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:32.745042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a93ef51c-181c-4793-a8b3-e45ad70bc013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:32.779191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79373f5e-fe80-493d-938d-0c62b6e7ad0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f13cf466a4b40acaf0c98516c5fa5b1, user_id=d9a96b51c98344a09cc59af05dd455ef, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:32.806413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:32.806832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79373f5e-fe80-493d-938d-0c62b6e7ad0b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:32.847187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 802/1608] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:32 2022] PUT /identity/v3/projects/6f13cf466a4b40acaf0c98516c5fa5b1/users/d9a96b51c98344a09cc59af05dd455ef/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:32.848177 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79373f5e-fe80-493d-938d-0c62b6e7ad0b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:32.920173 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 807/1609] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Jul 21 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:32.922687 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2df08-0b1c-4774-b1ba-09846fe2631c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:32.923172 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2df08-0b1c-4774-b1ba-09846fe2631c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:32.923604 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2df08-0b1c-4774-b1ba-09846fe2631c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:32.948283 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6dd2df08-0b1c-4774-b1ba-09846fe2631c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:32.950110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6dd2df08-0b1c-4774-b1ba-09846fe2631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:33.007418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79373f5e-fe80-493d-938d-0c62b6e7ad0b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:33.019393 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d071f-dec0-43ad-99ad-f5870a0ddd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:33.020774 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d071f-dec0-43ad-99ad-f5870a0ddd24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:33.021238 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d071f-dec0-43ad-99ad-f5870a0ddd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:33.026108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d071f-dec0-43ad-99ad-f5870a0ddd24 admin admin] PATH_INFO: `/v3/projects/d8ddc4e883544526b73dcf187e9a0788/users/242aa611d91b436085781ae4e401390d/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:33.064541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d071f-dec0-43ad-99ad-f5870a0ddd24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ddc4e883544526b73dcf187e9a0788, user_id=242aa611d91b436085781ae4e401390d, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:33.067801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 808/1610] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:33.068009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d071f-dec0-43ad-99ad-f5870a0ddd24 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:33.068580 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2df08-0b1c-4774-b1ba-09846fe2631c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:33.090216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2df08-0b1c-4774-b1ba-09846fe2631c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:33.094851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 803/1611] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:32 2022] PUT /identity/v3/projects/d8ddc4e883544526b73dcf187e9a0788/users/242aa611d91b436085781ae4e401390d/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:33.096605 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d071f-dec0-43ad-99ad-f5870a0ddd24 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:33.253733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d071f-dec0-43ad-99ad-f5870a0ddd24 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:33.272661 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05585e-678e-45d7-ab42-27ef5edec787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:33.273526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05585e-678e-45d7-ab42-27ef5edec787 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:33.274025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05585e-678e-45d7-ab42-27ef5edec787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:33.274313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05585e-678e-45d7-ab42-27ef5edec787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:33.275043 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97317246-8dbd-42d0-b6bc-9656ce710ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:33.276156 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97317246-8dbd-42d0-b6bc-9656ce710ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:33.276444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97317246-8dbd-42d0-b6bc-9656ce710ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:33.276722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97317246-8dbd-42d0-b6bc-9656ce710ffe admin admin] PATH_INFO: `/v3/projects/9ca38efa61ac4620b9304af9cbf01fae/users/cd462d85db744ca798f56abd9dcbe7be/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:33.291037 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05585e-678e-45d7-ab42-27ef5edec787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:33.292855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05585e-678e-45d7-ab42-27ef5edec787 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:33.298030 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97317246-8dbd-42d0-b6bc-9656ce710ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca38efa61ac4620b9304af9cbf01fae, user_id=cd462d85db744ca798f56abd9dcbe7be, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:33.301369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97317246-8dbd-42d0-b6bc-9656ce710ffe admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:33.340165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 809/1612] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:33 2022] PUT /identity/v3/projects/9ca38efa61ac4620b9304af9cbf01fae/users/cd462d85db744ca798f56abd9dcbe7be/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:33.340165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e4e31-b3e7-48f8-8c07-aa6c3b8bde35 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:33.340165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e4e31-b3e7-48f8-8c07-aa6c3b8bde35 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:33.340165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e4e31-b3e7-48f8-8c07-aa6c3b8bde35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:33.340649 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 804/1613] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:33.343450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05585e-678e-45d7-ab42-27ef5edec787 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:33.382725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c45e4e31-b3e7-48f8-8c07-aa6c3b8bde35 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:33.385671 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:33.387292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c45e4e31-b3e7-48f8-8c07-aa6c3b8bde35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:33.460073 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05585e-678e-45d7-ab42-27ef5edec787 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:33.525600 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:33.562849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b208a80-d002-47e9-9d2d-31ab91c52c69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:33.566600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b208a80-d002-47e9-9d2d-31ab91c52c69 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:33.567214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b208a80-d002-47e9-9d2d-31ab91c52c69 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:33.567647 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b208a80-d002-47e9-9d2d-31ab91c52c69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:33.585273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 810/1614] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:33.586725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e4e31-b3e7-48f8-8c07-aa6c3b8bde35 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:33.678035 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e4e31-b3e7-48f8-8c07-aa6c3b8bde35 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:33.683711 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e697659-81ef-4ded-82cb-1d5e39d11ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:33.684545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e697659-81ef-4ded-82cb-1d5e39d11ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:33.684686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e697659-81ef-4ded-82cb-1d5e39d11ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:33.685015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e697659-81ef-4ded-82cb-1d5e39d11ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:33.686317 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b208a80-d002-47e9-9d2d-31ab91c52c69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:33.691152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b208a80-d002-47e9-9d2d-31ab91c52c69 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:33.700676 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e697659-81ef-4ded-82cb-1d5e39d11ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:33.703725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e697659-81ef-4ded-82cb-1d5e39d11ac3 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:33.706344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 805/1615] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:33.708032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee6dc3-5944-4885-93f9-7de12c2ddb11 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:33.708448 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee6dc3-5944-4885-93f9-7de12c2ddb11 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:33.708835 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee6dc3-5944-4885-93f9-7de12c2ddb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:33.717415 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 811/1616] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:33.719343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ec4b-13ea-40cf-a6ad-bcc7c29956e0 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:33.719687 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ec4b-13ea-40cf-a6ad-bcc7c29956e0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:33.719971 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ec4b-13ea-40cf-a6ad-bcc7c29956e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:33.754941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4637ec4b-13ea-40cf-a6ad-bcc7c29956e0 None None] MFA Rules not processed for user `cd462d85db744ca798f56abd9dcbe7be`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:33.755605 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8aee6dc3-5944-4885-93f9-7de12c2ddb11 None None] MFA Rules not processed for user `242aa611d91b436085781ae4e401390d`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:33.756947 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8aee6dc3-5944-4885-93f9-7de12c2ddb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:33.757099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4637ec4b-13ea-40cf-a6ad-bcc7c29956e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:33.862073 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:33.910341 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 806/1617] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:33.912158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee6dc3-5944-4885-93f9-7de12c2ddb11 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:33.928747 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee6dc3-5944-4885-93f9-7de12c2ddb11 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:33.935761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef39259-1ae7-4118-9e52-7dcdeb7330f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:33.936840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef39259-1ae7-4118-9e52-7dcdeb7330f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:33.937313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef39259-1ae7-4118-9e52-7dcdeb7330f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:33.937811 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef39259-1ae7-4118-9e52-7dcdeb7330f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:33.951255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 812/1618] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:33.951255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637ec4b-13ea-40cf-a6ad-bcc7c29956e0 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:33.958180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef39259-1ae7-4118-9e52-7dcdeb7330f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:33.961066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef39259-1ae7-4118-9e52-7dcdeb7330f6 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:33.974958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637ec4b-13ea-40cf-a6ad-bcc7c29956e0 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:34.001638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b307a-2df8-49d3-95f8-ceb0144cc8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:34.002979 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b307a-2df8-49d3-95f8-ceb0144cc8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:34.003507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b307a-2df8-49d3-95f8-ceb0144cc8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:34.004097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b307a-2df8-49d3-95f8-ceb0144cc8e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:34.004211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 807/1619] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:34.005090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b307a-2df8-49d3-95f8-ceb0144cc8e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:34.006543 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef39259-1ae7-4118-9e52-7dcdeb7330f6 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:34.015817 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b307a-2df8-49d3-95f8-ceb0144cc8e7 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:34.032278 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef39259-1ae7-4118-9e52-7dcdeb7330f6 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:34.046914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46dfd3-3ae7-4347-b83e-a701953ae8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:34.048227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46dfd3-3ae7-4347-b83e-a701953ae8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:34.048719 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46dfd3-3ae7-4347-b83e-a701953ae8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:34.049500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46dfd3-3ae7-4347-b83e-a701953ae8c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:34.055208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46dfd3-3ae7-4347-b83e-a701953ae8c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:34.070061 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46dfd3-3ae7-4347-b83e-a701953ae8c1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:34.089724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 813/1620] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:15:33 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:34.099928 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b307a-2df8-49d3-95f8-ceb0144cc8e7 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:34.137279 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 808/1621] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:15:34 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:34.139493 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46dfd3-3ae7-4347-b83e-a701953ae8c1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:34.408758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:34.433773 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b307a-2df8-49d3-95f8-ceb0144cc8e7 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:34.455881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46dfd3-3ae7-4347-b83e-a701953ae8c1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:34.456474 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b21fa-e2a3-4cf5-9792-bb535caa4ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:34.457955 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b21fa-e2a3-4cf5-9792-bb535caa4ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:34.458440 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b21fa-e2a3-4cf5-9792-bb535caa4ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:34.459280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b21fa-e2a3-4cf5-9792-bb535caa4ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:34.460607 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b21fa-e2a3-4cf5-9792-bb535caa4ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:34.475105 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b21fa-e2a3-4cf5-9792-bb535caa4ce1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:34.483404 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb79fba-d995-4f2e-be73-7d6a90bdb9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:34.487439 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb79fba-d995-4f2e-be73-7d6a90bdb9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:34.490030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb79fba-d995-4f2e-be73-7d6a90bdb9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:34.490602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb79fba-d995-4f2e-be73-7d6a90bdb9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:34.494856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb79fba-d995-4f2e-be73-7d6a90bdb9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:34.504287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb79fba-d995-4f2e-be73-7d6a90bdb9f3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:34.553302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 814/1622] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:15:34 2022] POST /identity/v3/users => generated 297 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:34.560234 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b21fa-e2a3-4cf5-9792-bb535caa4ce1 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:34.589944 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 809/1623] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:15:34 2022] POST /identity/v3/users => generated 308 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:15:34.591950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb79fba-d995-4f2e-be73-7d6a90bdb9f3 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:34.595860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b21fa-e2a3-4cf5-9792-bb535caa4ce1 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:34.610071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823bf1d-c8ee-4753-8ec2-571a18fa7cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:34.611154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823bf1d-c8ee-4753-8ec2-571a18fa7cde admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:34.611595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823bf1d-c8ee-4753-8ec2-571a18fa7cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:34.612239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823bf1d-c8ee-4753-8ec2-571a18fa7cde admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:34.613463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823bf1d-c8ee-4753-8ec2-571a18fa7cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:34.616112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823bf1d-c8ee-4753-8ec2-571a18fa7cde admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:34.632773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb79fba-d995-4f2e-be73-7d6a90bdb9f3 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:34.638948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 815/1624] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:34.642638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f68aa3-09fb-4279-971c-7b6234b875ab None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:34.643469 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f68aa3-09fb-4279-971c-7b6234b875ab None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:34.644074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f68aa3-09fb-4279-971c-7b6234b875ab None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:34.646499 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 816/1625] 10.222.0.15 () {54 vars in 912 bytes} [Thu Jul 21 12:15:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:15:34.648636 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f68aa3-09fb-4279-971c-7b6234b875ab None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:34.655500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d6d32-6cf1-4aff-8329-48509c2fbcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:34.657560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d6d32-6cf1-4aff-8329-48509c2fbcbe admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:34.661584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d6d32-6cf1-4aff-8329-48509c2fbcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:34.662408 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d6d32-6cf1-4aff-8329-48509c2fbcbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:34.667228 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d6d32-6cf1-4aff-8329-48509c2fbcbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:34.676479 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d6d32-6cf1-4aff-8329-48509c2fbcbe admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:34.688408 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f68aa3-09fb-4279-971c-7b6234b875ab None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:34.698240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd01bf-556d-4bb4-9275-effed79a7d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:34.700300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd01bf-556d-4bb4-9275-effed79a7d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:34.701051 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd01bf-556d-4bb4-9275-effed79a7d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:34.701623 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd01bf-556d-4bb4-9275-effed79a7d07 admin admin] PATH_INFO: `/v3/projects/33c7df8e66c843008b51aa1d4df5ed16/users/3fa09f0c84ff4c75938129a42872dbeb/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:34.703833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 810/1626] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:34.706742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549abcac-6a2b-44b0-9a12-bb56d1b77266 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:34.707397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549abcac-6a2b-44b0-9a12-bb56d1b77266 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:34.707885 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549abcac-6a2b-44b0-9a12-bb56d1b77266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:34.743364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd01bf-556d-4bb4-9275-effed79a7d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c7df8e66c843008b51aa1d4df5ed16, user_id=3fa09f0c84ff4c75938129a42872dbeb, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:34.749802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd01bf-556d-4bb4-9275-effed79a7d07 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:34.759199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-549abcac-6a2b-44b0-9a12-bb56d1b77266 None None] MFA Rules not processed for user `f3fb1d091b27472081549f4166ca172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:34.760537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-549abcac-6a2b-44b0-9a12-bb56d1b77266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:34.777751 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 817/1627] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:34 2022] PUT /identity/v3/projects/33c7df8e66c843008b51aa1d4df5ed16/users/3fa09f0c84ff4c75938129a42872dbeb/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:34.782255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd01bf-556d-4bb4-9275-effed79a7d07 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:34.885958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 811/1628] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:15:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:34.886886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549abcac-6a2b-44b0-9a12-bb56d1b77266 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:34.913592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549abcac-6a2b-44b0-9a12-bb56d1b77266 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:34.956280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd01bf-556d-4bb4-9275-effed79a7d07 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:34.965616 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:34.973146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad708fe6-516e-4616-b907-7267634fcc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:34.974147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad708fe6-516e-4616-b907-7267634fcc0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:34.974239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad708fe6-516e-4616-b907-7267634fcc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:34.974514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad708fe6-516e-4616-b907-7267634fcc0a admin admin] PATH_INFO: `/v3/projects/753318732ac344a98faf066d1dd66321/users/ff342f49705f4e8c9c8504d5a56b478b/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:35.005497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad708fe6-516e-4616-b907-7267634fcc0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=753318732ac344a98faf066d1dd66321, user_id=ff342f49705f4e8c9c8504d5a56b478b, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:35.008511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad708fe6-516e-4616-b907-7267634fcc0a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:35.050828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 818/1629] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:34 2022] PUT /identity/v3/projects/753318732ac344a98faf066d1dd66321/users/ff342f49705f4e8c9c8504d5a56b478b/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:35.052939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad708fe6-516e-4616-b907-7267634fcc0a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:35.101827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990723ba-6ba7-4671-937d-0f57836f7e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:35.102824 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990723ba-6ba7-4671-937d-0f57836f7e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:35.104874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990723ba-6ba7-4671-937d-0f57836f7e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:35.105226 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990723ba-6ba7-4671-937d-0f57836f7e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:35.109838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990723ba-6ba7-4671-937d-0f57836f7e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:35.111945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990723ba-6ba7-4671-937d-0f57836f7e88 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:35.143537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 812/1630] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:35.143537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990723ba-6ba7-4671-937d-0f57836f7e88 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:35.160992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990723ba-6ba7-4671-937d-0f57836f7e88 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:35.199803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad708fe6-516e-4616-b907-7267634fcc0a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:35.220621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edd16a-ea29-4008-8b60-876fe488e20a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:35.221651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd16a-ea29-4008-8b60-876fe488e20a service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:35.222130 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd16a-ea29-4008-8b60-876fe488e20a service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:35.222448 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd16a-ea29-4008-8b60-876fe488e20a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:35.280368 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7cc5-cedb-4c2d-a3c8-bc4b3b17cf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:35.281108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7cc5-cedb-4c2d-a3c8-bc4b3b17cf59 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:35.281396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7cc5-cedb-4c2d-a3c8-bc4b3b17cf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:35.281755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7cc5-cedb-4c2d-a3c8-bc4b3b17cf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:35.282425 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e7cc5-cedb-4c2d-a3c8-bc4b3b17cf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:35.284197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e7cc5-cedb-4c2d-a3c8-bc4b3b17cf59 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:35.318184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 813/1631] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:35.318491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7cc5-cedb-4c2d-a3c8-bc4b3b17cf59 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:35.328067 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:35.342693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7cc5-cedb-4c2d-a3c8-bc4b3b17cf59 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:35.354305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43cade-c2bd-4c93-b018-1623ebcc10df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:35.355327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43cade-c2bd-4c93-b018-1623ebcc10df admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:35.355613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43cade-c2bd-4c93-b018-1623ebcc10df admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:35.355930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43cade-c2bd-4c93-b018-1623ebcc10df admin admin] PATH_INFO: `/v3/projects/33c7df8e66c843008b51aa1d4df5ed16/users/3fa09f0c84ff4c75938129a42872dbeb/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:35.364066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43cade-c2bd-4c93-b018-1623ebcc10df admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c7df8e66c843008b51aa1d4df5ed16, user_id=3fa09f0c84ff4c75938129a42872dbeb, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:35.365128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edd16a-ea29-4008-8b60-876fe488e20a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:35.366936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edd16a-ea29-4008-8b60-876fe488e20a service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:35.367283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43cade-c2bd-4c93-b018-1623ebcc10df admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:35.384667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 819/1632] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:35.385861 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edd16a-ea29-4008-8b60-876fe488e20a service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:35.400292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edd16a-ea29-4008-8b60-876fe488e20a service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:35.410379 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 814/1633] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:35 2022] PUT /identity/v3/projects/33c7df8e66c843008b51aa1d4df5ed16/users/3fa09f0c84ff4c75938129a42872dbeb/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:35.412083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da59df4-f618-4b33-9092-6e300ebef554 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:35.412376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da59df4-f618-4b33-9092-6e300ebef554 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:35.412655 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da59df4-f618-4b33-9092-6e300ebef554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:35.499178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9da59df4-f618-4b33-9092-6e300ebef554 None None] MFA Rules not processed for user `3fa09f0c84ff4c75938129a42872dbeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:35.502559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9da59df4-f618-4b33-9092-6e300ebef554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:35.540258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac299a-4281-4228-928b-47a87788726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:35.541257 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac299a-4281-4228-928b-47a87788726d admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:35.542214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac299a-4281-4228-928b-47a87788726d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:35.542214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac299a-4281-4228-928b-47a87788726d admin admin] PATH_INFO: `/v3/projects/753318732ac344a98faf066d1dd66321/users/ff342f49705f4e8c9c8504d5a56b478b/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:35.544412 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac299a-4281-4228-928b-47a87788726d admin admin] RBAC: Authorizing `identity:create_grant(project_id=753318732ac344a98faf066d1dd66321, user_id=ff342f49705f4e8c9c8504d5a56b478b, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:35.547619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac299a-4281-4228-928b-47a87788726d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:35.573907 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 820/1634] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:35 2022] PUT /identity/v3/projects/753318732ac344a98faf066d1dd66321/users/ff342f49705f4e8c9c8504d5a56b478b/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:35.594704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c33408-89fa-4c62-9057-097c5a24f08f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:35.595090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c33408-89fa-4c62-9057-097c5a24f08f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:35.595279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c33408-89fa-4c62-9057-097c5a24f08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:35.669990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-06c33408-89fa-4c62-9057-097c5a24f08f None None] MFA Rules not processed for user `ff342f49705f4e8c9c8504d5a56b478b`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:35.671400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-06c33408-89fa-4c62-9057-097c5a24f08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:35.758392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 815/1635] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:35.785701 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da59df4-f618-4b33-9092-6e300ebef554 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:35.850903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:35.925379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 821/1636] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:15:35.929141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da59df4-f618-4b33-9092-6e300ebef554 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:36.055815 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43518a09-a0ac-4236-82b4-13c491bb9954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:36.056697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43518a09-a0ac-4236-82b4-13c491bb9954 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:36.056988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43518a09-a0ac-4236-82b4-13c491bb9954 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:36.057315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43518a09-a0ac-4236-82b4-13c491bb9954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:36.224106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43518a09-a0ac-4236-82b4-13c491bb9954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:36.225168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43518a09-a0ac-4236-82b4-13c491bb9954 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:36.253790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 816/1637] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:15:36.465135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c33408-89fa-4c62-9057-097c5a24f08f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:36.546583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c33408-89fa-4c62-9057-097c5a24f08f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:36.565214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974f91b-03b7-4144-bcdb-6e2a07e21a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:36.567923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974f91b-03b7-4144-bcdb-6e2a07e21a12 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:36.570160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974f91b-03b7-4144-bcdb-6e2a07e21a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:36.571857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974f91b-03b7-4144-bcdb-6e2a07e21a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:36.606463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974f91b-03b7-4144-bcdb-6e2a07e21a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:36.612061 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974f91b-03b7-4144-bcdb-6e2a07e21a12 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:36.641918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 822/1638] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:36 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:36.688931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43518a09-a0ac-4236-82b4-13c491bb9954 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:36.735562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43518a09-a0ac-4236-82b4-13c491bb9954 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:36.768620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c4190-71bb-41f1-b13b-7c273f942688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:36.769858 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4190-71bb-41f1-b13b-7c273f942688 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:36.770408 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4190-71bb-41f1-b13b-7c273f942688 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:36.771307 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4190-71bb-41f1-b13b-7c273f942688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:37.025371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c4190-71bb-41f1-b13b-7c273f942688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:37.028450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c4190-71bb-41f1-b13b-7c273f942688 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:37.072204 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 817/1639] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:37.268275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bdf73-04b8-47ed-9229-d3a9b531f137 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:37.268674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bdf73-04b8-47ed-9229-d3a9b531f137 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:37.269073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bdf73-04b8-47ed-9229-d3a9b531f137 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:37.271312 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 823/1640] 10.222.0.15 () {54 vars in 962 bytes} [Thu Jul 21 12:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:15:37.283140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705460a-cfc6-47bb-a5f3-a91d766f4b07 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:37.284283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705460a-cfc6-47bb-a5f3-a91d766f4b07 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:37.284609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705460a-cfc6-47bb-a5f3-a91d766f4b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:37.288948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bdf73-04b8-47ed-9229-d3a9b531f137 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:37.310113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5705460a-cfc6-47bb-a5f3-a91d766f4b07 None None] MFA Rules not processed for user `f3fb1d091b27472081549f4166ca172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:37.311856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5705460a-cfc6-47bb-a5f3-a91d766f4b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:37.359609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:37.383732 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:37.429586 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bdf73-04b8-47ed-9229-d3a9b531f137 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:37.442535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7c197-17e0-4fac-a82d-1ad3de847cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:37.443497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7c197-17e0-4fac-a82d-1ad3de847cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:37.443780 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7c197-17e0-4fac-a82d-1ad3de847cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:37.444065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7c197-17e0-4fac-a82d-1ad3de847cd7 admin admin] PATH_INFO: `/v3/users/cd462d85db744ca798f56abd9dcbe7be` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:37.445852 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7c197-17e0-4fac-a82d-1ad3de847cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd462d85db744ca798f56abd9dcbe7be)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:37.448208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7c197-17e0-4fac-a82d-1ad3de847cd7 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:37.448529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 818/1641] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Jul 21 12:15:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:37.450581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acf177-2b00-4330-acdb-398db8e85ec3 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:37.451229 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acf177-2b00-4330-acdb-398db8e85ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:37.452051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acf177-2b00-4330-acdb-398db8e85ec3 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:37.460337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 819/1642] 10.222.0.15 () {54 vars in 912 bytes} [Thu Jul 21 12:15:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:15:37.463056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb459de-8520-4214-8722-29f5c42ffd08 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:37.474955 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb459de-8520-4214-8722-29f5c42ffd08 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:37.476038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb459de-8520-4214-8722-29f5c42ffd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:37.518707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-afb459de-8520-4214-8722-29f5c42ffd08 None None] MFA Rules not processed for user `f3fb1d091b27472081549f4166ca172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:37.520347 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-afb459de-8520-4214-8722-29f5c42ffd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:37.565339 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 820/1643] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:15:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:37.571277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e0a7c197-17e0-4fac-a82d-1ad3de847cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd462d85db744ca798f56abd9dcbe7be'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:37.584596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb459de-8520-4214-8722-29f5c42ffd08 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:37.587027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e0a7c197-17e0-4fac-a82d-1ad3de847cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd462d85db744ca798f56abd9dcbe7be'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:37.590514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e0a7c197-17e0-4fac-a82d-1ad3de847cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd462d85db744ca798f56abd9dcbe7be'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:37.598199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb459de-8520-4214-8722-29f5c42ffd08 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:37.604081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc2ae6-7b84-420d-badd-972973de3d11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:37.605318 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc2ae6-7b84-420d-badd-972973de3d11 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:37.605907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc2ae6-7b84-420d-badd-972973de3d11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:37.606399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc2ae6-7b84-420d-badd-972973de3d11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:37.626555 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc2ae6-7b84-420d-badd-972973de3d11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:37.628749 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc2ae6-7b84-420d-badd-972973de3d11 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:37.636333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e0a7c197-17e0-4fac-a82d-1ad3de847cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd462d85db744ca798f56abd9dcbe7be'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:37.643220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e0a7c197-17e0-4fac-a82d-1ad3de847cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd462d85db744ca798f56abd9dcbe7be'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:37.658102 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 821/1644] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:37.678719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 824/1645] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:15:37 2022] DELETE /identity/v3/users/cd462d85db744ca798f56abd9dcbe7be => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:15:37.686982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd9e6b-d08a-46ef-b002-6b80a489e10b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:37.687442 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd9e6b-d08a-46ef-b002-6b80a489e10b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:37.687919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd9e6b-d08a-46ef-b002-6b80a489e10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:37.724434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ffbd9e6b-d08a-46ef-b002-6b80a489e10b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:37.726292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ffbd9e6b-d08a-46ef-b002-6b80a489e10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:37.833298 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 822/1646] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:37.858576 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7c197-17e0-4fac-a82d-1ad3de847cd7 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:37.860578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e0a7c197-17e0-4fac-a82d-1ad3de847cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:37.966106 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7c197-17e0-4fac-a82d-1ad3de847cd7 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:37.974728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c7a19-25f9-407b-af2d-a851b561e4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:37.975578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c7a19-25f9-407b-af2d-a851b561e4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:37.975935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c7a19-25f9-407b-af2d-a851b561e4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:37.976634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c7a19-25f9-407b-af2d-a851b561e4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:38.014361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c7a19-25f9-407b-af2d-a851b561e4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:38.016541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c7a19-25f9-407b-af2d-a851b561e4f0 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:38.037769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 825/1647] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:15:39.143124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd9e6b-d08a-46ef-b002-6b80a489e10b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:39.145891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ffbd9e6b-d08a-46ef-b002-6b80a489e10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:39.172447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd9e6b-d08a-46ef-b002-6b80a489e10b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:39.186211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:39.187647 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:39.188043 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:39.188422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] PATH_INFO: `/v3/projects/9ca38efa61ac4620b9304af9cbf01fae` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:39.189967 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca38efa61ac4620b9304af9cbf01fae)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:39.192713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:39.356279 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca38efa61ac4620b9304af9cbf01fae', 'request_id': 'req-c8244534-7e46-4985-804d-5b0274e93002'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:39.372917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca38efa61ac4620b9304af9cbf01fae', 'request_id': 'req-c8244534-7e46-4985-804d-5b0274e93002'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:39.388946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca38efa61ac4620b9304af9cbf01fae', 'request_id': 'req-c8244534-7e46-4985-804d-5b0274e93002'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:39.411891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] The token cache is being invalidate because project 9ca38efa61ac4620b9304af9cbf01fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:15:39.412837 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:39.412945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:39.414738 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 823/1648] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:15:39 2022] DELETE /identity/v3/projects/9ca38efa61ac4620b9304af9cbf01fae => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:39.419103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c7a19-25f9-407b-af2d-a851b561e4f0 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:39.439040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c7a19-25f9-407b-af2d-a851b561e4f0 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:39.640486 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cb4bf-d169-4b4c-ab03-9b7cb9939bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:39.641755 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cb4bf-d169-4b4c-ab03-9b7cb9939bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:39.642254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cb4bf-d169-4b4c-ab03-9b7cb9939bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:39.648323 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cb4bf-d169-4b4c-ab03-9b7cb9939bd3 admin admin] PATH_INFO: `/v3/users/ff342f49705f4e8c9c8504d5a56b478b` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:39.654465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cb4bf-d169-4b4c-ab03-9b7cb9939bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff342f49705f4e8c9c8504d5a56b478b)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:39.667568 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cb4bf-d169-4b4c-ab03-9b7cb9939bd3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:39.680147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:39.803077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-383cb4bf-d169-4b4c-ab03-9b7cb9939bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff342f49705f4e8c9c8504d5a56b478b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:39.900420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-383cb4bf-d169-4b4c-ab03-9b7cb9939bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff342f49705f4e8c9c8504d5a56b478b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:39.905094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-383cb4bf-d169-4b4c-ab03-9b7cb9939bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff342f49705f4e8c9c8504d5a56b478b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:39.948634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-383cb4bf-d169-4b4c-ab03-9b7cb9939bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff342f49705f4e8c9c8504d5a56b478b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:39.949699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-383cb4bf-d169-4b4c-ab03-9b7cb9939bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff342f49705f4e8c9c8504d5a56b478b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:40.052515 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 826/1649] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:15:39 2022] DELETE /identity/v3/users/ff342f49705f4e8c9c8504d5a56b478b => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:42.934157 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:42.934621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:42.954769 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8244534-7e46-4985-804d-5b0274e93002 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:42.987142 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:43.019889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cb4bf-d169-4b4c-ab03-9b7cb9939bd3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:43.024765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-383cb4bf-d169-4b4c-ab03-9b7cb9939bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:43.114990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7460cf8-81b2-47aa-91a2-4f27295c1271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:43.116349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7460cf8-81b2-47aa-91a2-4f27295c1271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:43.116349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7460cf8-81b2-47aa-91a2-4f27295c1271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:43.116724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7460cf8-81b2-47aa-91a2-4f27295c1271 admin admin] PATH_INFO: `/v3/users/e2a6ed87df76453490b8ba89d1bb98f8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:43.120241 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7460cf8-81b2-47aa-91a2-4f27295c1271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a6ed87df76453490b8ba89d1bb98f8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:43.121189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-d7460cf8-81b2-47aa-91a2-4f27295c1271 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:15:43.121189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 21 12:15:43.121189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: Jul 21 12:15:43.122754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7460cf8-81b2-47aa-91a2-4f27295c1271 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:43.318410 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d7460cf8-81b2-47aa-91a2-4f27295c1271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a6ed87df76453490b8ba89d1bb98f8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:43.319555 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d7460cf8-81b2-47aa-91a2-4f27295c1271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a6ed87df76453490b8ba89d1bb98f8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:43.398696 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cb4bf-d169-4b4c-ab03-9b7cb9939bd3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:43.422227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12cfef-49f6-41cf-b676-9bffd7433472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:43.428753 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12cfef-49f6-41cf-b676-9bffd7433472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:43.429398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12cfef-49f6-41cf-b676-9bffd7433472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:43.429906 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12cfef-49f6-41cf-b676-9bffd7433472 admin admin] PATH_INFO: `/v3/projects/753318732ac344a98faf066d1dd66321` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:43.438085 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12cfef-49f6-41cf-b676-9bffd7433472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=753318732ac344a98faf066d1dd66321)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:43.441253 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d7460cf8-81b2-47aa-91a2-4f27295c1271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a6ed87df76453490b8ba89d1bb98f8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:43.445924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: WARNING py.warnings [None req-5c12cfef-49f6-41cf-b676-9bffd7433472 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 12:15:43.445924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: warnings.warn(msg) Jul 21 12:15:43.445924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: Jul 21 12:15:43.448327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12cfef-49f6-41cf-b676-9bffd7433472 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:43.489911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d7460cf8-81b2-47aa-91a2-4f27295c1271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a6ed87df76453490b8ba89d1bb98f8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:43.491023 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d7460cf8-81b2-47aa-91a2-4f27295c1271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a6ed87df76453490b8ba89d1bb98f8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:43.545365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 824/1650] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:15:42 2022] DELETE /identity/v3/users/e2a6ed87df76453490b8ba89d1bb98f8 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:43.548886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48d45-67bc-4492-a43a-dc2baed475d5 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:43.549211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48d45-67bc-4492-a43a-dc2baed475d5 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:43.552088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48d45-67bc-4492-a43a-dc2baed475d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:43.620703 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8ce48d45-67bc-4492-a43a-dc2baed475d5 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:43.623385 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8ce48d45-67bc-4492-a43a-dc2baed475d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:43.669569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5c12cfef-49f6-41cf-b676-9bffd7433472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '753318732ac344a98faf066d1dd66321', 'request_id': 'req-5c12cfef-49f6-41cf-b676-9bffd7433472'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:43.689978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5c12cfef-49f6-41cf-b676-9bffd7433472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '753318732ac344a98faf066d1dd66321', 'request_id': 'req-5c12cfef-49f6-41cf-b676-9bffd7433472'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:43.722036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5c12cfef-49f6-41cf-b676-9bffd7433472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '753318732ac344a98faf066d1dd66321', 'request_id': 'req-5c12cfef-49f6-41cf-b676-9bffd7433472'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:43.746776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5c12cfef-49f6-41cf-b676-9bffd7433472 admin admin] The token cache is being invalidate because project 753318732ac344a98faf066d1dd66321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:15:43.747299 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5c12cfef-49f6-41cf-b676-9bffd7433472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:43.748193 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5c12cfef-49f6-41cf-b676-9bffd7433472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:43.755483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 827/1651] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:15:43 2022] DELETE /identity/v3/projects/753318732ac344a98faf066d1dd66321 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:43.761936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deb757-e03f-4ecc-9791-93cabf60ff96 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:43.763408 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deb757-e03f-4ecc-9791-93cabf60ff96 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:43.764691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deb757-e03f-4ecc-9791-93cabf60ff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:43.847869 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f1deb757-e03f-4ecc-9791-93cabf60ff96 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:43.855771 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f1deb757-e03f-4ecc-9791-93cabf60ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:43.873699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:43.980147 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 825/1652] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:44.146294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 828/1653] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:44.154879 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba68cf-c8cd-4ce8-8953-a1a02b14fe3e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:44.156266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba68cf-c8cd-4ce8-8953-a1a02b14fe3e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:44.156768 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba68cf-c8cd-4ce8-8953-a1a02b14fe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:44.186093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deb757-e03f-4ecc-9791-93cabf60ff96 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:44.197898 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f1deb757-e03f-4ecc-9791-93cabf60ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:44.293455 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-36ba68cf-c8cd-4ce8-8953-a1a02b14fe3e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:44.306551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-36ba68cf-c8cd-4ce8-8953-a1a02b14fe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:44.374502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 826/1654] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:44.382822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deb757-e03f-4ecc-9791-93cabf60ff96 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:44.386693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba68cf-c8cd-4ce8-8953-a1a02b14fe3e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:44.387903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975746a-e082-4665-94c5-93da95f2f892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:44.388595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975746a-e082-4665-94c5-93da95f2f892 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:44.388880 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975746a-e082-4665-94c5-93da95f2f892 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:44.389159 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975746a-e082-4665-94c5-93da95f2f892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:44.401419 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975746a-e082-4665-94c5-93da95f2f892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:44.402960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975746a-e082-4665-94c5-93da95f2f892 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:44.420396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 829/1655] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:44.423334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba68cf-c8cd-4ce8-8953-a1a02b14fe3e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:44.459179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9cc81-bbe0-4514-b6f8-c92fa69d1438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:44.460989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9cc81-bbe0-4514-b6f8-c92fa69d1438 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:44.461813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9cc81-bbe0-4514-b6f8-c92fa69d1438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:44.462638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9cc81-bbe0-4514-b6f8-c92fa69d1438 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:44.464644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9cc81-bbe0-4514-b6f8-c92fa69d1438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:15:44.465517 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9cc81-bbe0-4514-b6f8-c92fa69d1438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:44.470555 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9cc81-bbe0-4514-b6f8-c92fa69d1438 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:44.523911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 827/1656] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:15:44.528255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975746a-e082-4665-94c5-93da95f2f892 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:44.539427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975746a-e082-4665-94c5-93da95f2f892 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:44.554698 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93104d7-0001-40a9-bbbc-67eea9daa790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:44.555692 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93104d7-0001-40a9-bbbc-67eea9daa790 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:44.555983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93104d7-0001-40a9-bbbc-67eea9daa790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:44.556260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93104d7-0001-40a9-bbbc-67eea9daa790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:44.556997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93104d7-0001-40a9-bbbc-67eea9daa790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:44.565799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93104d7-0001-40a9-bbbc-67eea9daa790 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:44.623412 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 830/1657] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:15:44 2022] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:15:44.627958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9cc81-bbe0-4514-b6f8-c92fa69d1438 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:44.646447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9cc81-bbe0-4514-b6f8-c92fa69d1438 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:44.697309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:44.827999 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0136b54-6d4a-4fcb-b01a-f440ca8b15b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:44.829216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136b54-6d4a-4fcb-b01a-f440ca8b15b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:44.829610 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136b54-6d4a-4fcb-b01a-f440ca8b15b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:44.830058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136b54-6d4a-4fcb-b01a-f440ca8b15b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:44.832263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0136b54-6d4a-4fcb-b01a-f440ca8b15b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:44.835561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0136b54-6d4a-4fcb-b01a-f440ca8b15b3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:44.870923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 828/1658] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:15:44 2022] POST /identity/v3/users => generated 282 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:44.876320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93104d7-0001-40a9-bbbc-67eea9daa790 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:44.898863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93104d7-0001-40a9-bbbc-67eea9daa790 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:44.908662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9c2c0-a257-4189-85b6-a01d0518111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:44.909496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9c2c0-a257-4189-85b6-a01d0518111f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:44.909922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9c2c0-a257-4189-85b6-a01d0518111f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:44.910275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9c2c0-a257-4189-85b6-a01d0518111f admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:44.911353 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9c2c0-a257-4189-85b6-a01d0518111f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:44.914368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9c2c0-a257-4189-85b6-a01d0518111f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:44.952670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 831/1659] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:44.957212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0136b54-6d4a-4fcb-b01a-f440ca8b15b3 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:44.975695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0136b54-6d4a-4fcb-b01a-f440ca8b15b3 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:44.997739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987fc5-c9b1-40a6-84fe-01088237bcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:44.998754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987fc5-c9b1-40a6-84fe-01088237bcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:44.999067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987fc5-c9b1-40a6-84fe-01088237bcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:45.000904 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987fc5-c9b1-40a6-84fe-01088237bcb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:45.003695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987fc5-c9b1-40a6-84fe-01088237bcb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:45.005429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987fc5-c9b1-40a6-84fe-01088237bcb4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:45.037924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9c2c0-a257-4189-85b6-a01d0518111f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:45.044754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 829/1660] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:45.053089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9c2c0-a257-4189-85b6-a01d0518111f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:45.066205 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809a080-8723-4443-b425-fdc3f284f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:45.074574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a080-8723-4443-b425-fdc3f284f04f admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:45.075184 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a080-8723-4443-b425-fdc3f284f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:45.075485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a080-8723-4443-b425-fdc3f284f04f admin admin] PATH_INFO: `/v3/projects/32a3aa347fdd452bbdc12d9e1f588ade/users/850c07a12421469e9948b42d0617b65e/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:45.116766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809a080-8723-4443-b425-fdc3f284f04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a3aa347fdd452bbdc12d9e1f588ade, user_id=850c07a12421469e9948b42d0617b65e, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:45.122365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809a080-8723-4443-b425-fdc3f284f04f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:45.164764 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 832/1661] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:45 2022] PUT /identity/v3/projects/32a3aa347fdd452bbdc12d9e1f588ade/users/850c07a12421469e9948b42d0617b65e/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:45.166973 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07abb-ec5f-4a4f-a245-063864338a4a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:45.167277 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07abb-ec5f-4a4f-a245-063864338a4a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:45.167766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07abb-ec5f-4a4f-a245-063864338a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:45.249220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-24f07abb-ec5f-4a4f-a245-063864338a4a None None] MFA Rules not processed for user `850c07a12421469e9948b42d0617b65e`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:45.251081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-24f07abb-ec5f-4a4f-a245-063864338a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:45.479566 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 830/1662] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:45.480838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809a080-8723-4443-b425-fdc3f284f04f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:45.600931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:45.608371 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809a080-8723-4443-b425-fdc3f284f04f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:45.620048 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce96d8-1d29-4df3-94b2-a4fd89ac6577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:45.620934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce96d8-1d29-4df3-94b2-a4fd89ac6577 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:45.621177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce96d8-1d29-4df3-94b2-a4fd89ac6577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:45.621540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce96d8-1d29-4df3-94b2-a4fd89ac6577 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:45.626273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce96d8-1d29-4df3-94b2-a4fd89ac6577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:45.631149 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce96d8-1d29-4df3-94b2-a4fd89ac6577 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:45.742632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f07abb-ec5f-4a4f-a245-063864338a4a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:45.762624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 833/1663] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:15:45 2022] POST /identity/v3/projects => generated 365 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:45.768244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f07abb-ec5f-4a4f-a245-063864338a4a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:45.986643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbe1b0-f674-468d-ba1b-e1bea996eb44 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:45.986643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbe1b0-f674-468d-ba1b-e1bea996eb44 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:45.987209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbe1b0-f674-468d-ba1b-e1bea996eb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:46.063595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-57fbe1b0-f674-468d-ba1b-e1bea996eb44 None None] MFA Rules not processed for user `491d61d97e114e5988bab922a0f366bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:46.064985 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-57fbe1b0-f674-468d-ba1b-e1bea996eb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:46.088316 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0109053-3ef1-437b-8d32-59424b0168ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:46.090065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0109053-3ef1-437b-8d32-59424b0168ff admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:46.091987 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0109053-3ef1-437b-8d32-59424b0168ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:46.092805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0109053-3ef1-437b-8d32-59424b0168ff admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:46.093833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0109053-3ef1-437b-8d32-59424b0168ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:46.096480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0109053-3ef1-437b-8d32-59424b0168ff admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:46.160713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 831/1664] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:15:45 2022] POST /identity/v3/users => generated 289 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:46.165864 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0109053-3ef1-437b-8d32-59424b0168ff admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:46.190181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0109053-3ef1-437b-8d32-59424b0168ff admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:46.213710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ede6f-a01c-47f4-a7c1-9de04fc2b23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:46.214491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ede6f-a01c-47f4-a7c1-9de04fc2b23c admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:46.217308 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ede6f-a01c-47f4-a7c1-9de04fc2b23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:46.217597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ede6f-a01c-47f4-a7c1-9de04fc2b23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:46.218522 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ede6f-a01c-47f4-a7c1-9de04fc2b23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:46.231472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ede6f-a01c-47f4-a7c1-9de04fc2b23c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:46.282218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 834/1665] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:15:46.287416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 832/1666] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:46.287695 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbe1b0-f674-468d-ba1b-e1bea996eb44 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:46.288452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ede6f-a01c-47f4-a7c1-9de04fc2b23c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:46.295785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e95ede6f-a01c-47f4-a7c1-9de04fc2b23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:46.316016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbe1b0-f674-468d-ba1b-e1bea996eb44 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:46.327497 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:46.331807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fcfef-5f20-457d-92b7-ba4f544a6cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:46.333074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fcfef-5f20-457d-92b7-ba4f544a6cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:46.333361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fcfef-5f20-457d-92b7-ba4f544a6cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:46.333637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fcfef-5f20-457d-92b7-ba4f544a6cc9 admin admin] PATH_INFO: `/v3/projects/ecdeb93fcf474f8f9229fe3694c5bb63/users/b9c22dac77da49eda0ea51a7b0246004/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:46.373321 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fcfef-5f20-457d-92b7-ba4f544a6cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecdeb93fcf474f8f9229fe3694c5bb63, user_id=b9c22dac77da49eda0ea51a7b0246004, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:46.376628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fcfef-5f20-457d-92b7-ba4f544a6cc9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:46.408763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 835/1667] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:46 2022] PUT /identity/v3/projects/ecdeb93fcf474f8f9229fe3694c5bb63/users/b9c22dac77da49eda0ea51a7b0246004/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:46.412699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fcfef-5f20-457d-92b7-ba4f544a6cc9 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:46.544870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ede6f-a01c-47f4-a7c1-9de04fc2b23c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:46.598966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fcfef-5f20-457d-92b7-ba4f544a6cc9 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:46.617294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38aadb-a332-47b2-8514-e8a34b1c7b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:46.618234 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38aadb-a332-47b2-8514-e8a34b1c7b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:46.618529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38aadb-a332-47b2-8514-e8a34b1c7b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:46.619217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38aadb-a332-47b2-8514-e8a34b1c7b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:46.620023 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38aadb-a332-47b2-8514-e8a34b1c7b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:46.621776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38aadb-a332-47b2-8514-e8a34b1c7b65 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:46.647239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 836/1668] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:15:46.648420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38aadb-a332-47b2-8514-e8a34b1c7b65 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:46.672227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38aadb-a332-47b2-8514-e8a34b1c7b65 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:46.690244 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badf095-f83c-4fb0-85ad-ec6c1bec571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:46.691243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badf095-f83c-4fb0-85ad-ec6c1bec571e admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:46.691530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badf095-f83c-4fb0-85ad-ec6c1bec571e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:46.691813 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badf095-f83c-4fb0-85ad-ec6c1bec571e admin admin] PATH_INFO: `/v3/projects/ecdeb93fcf474f8f9229fe3694c5bb63/users/b9c22dac77da49eda0ea51a7b0246004/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:46.694207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badf095-f83c-4fb0-85ad-ec6c1bec571e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecdeb93fcf474f8f9229fe3694c5bb63, user_id=b9c22dac77da49eda0ea51a7b0246004, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:46.697102 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badf095-f83c-4fb0-85ad-ec6c1bec571e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:46.726055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 837/1669] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:46 2022] PUT /identity/v3/projects/ecdeb93fcf474f8f9229fe3694c5bb63/users/b9c22dac77da49eda0ea51a7b0246004/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:46.740199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f00c7-f32d-4161-9948-ed5b74003fe8 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:46.740495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f00c7-f32d-4161-9948-ed5b74003fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:46.741735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f00c7-f32d-4161-9948-ed5b74003fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:46.751161 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229895db-e86f-4557-92ed-424a946ee621 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:46.752001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229895db-e86f-4557-92ed-424a946ee621 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:46.752283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229895db-e86f-4557-92ed-424a946ee621 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:46.752992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229895db-e86f-4557-92ed-424a946ee621 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:46.852109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-e68f00c7-f32d-4161-9948-ed5b74003fe8 None None] MFA Rules not processed for user `b9c22dac77da49eda0ea51a7b0246004`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:46.853577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e68f00c7-f32d-4161-9948-ed5b74003fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:46.923753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229895db-e86f-4557-92ed-424a946ee621 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:46.927692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229895db-e86f-4557-92ed-424a946ee621 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:46.945672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:46.968753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 833/1670] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:47.123438 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 838/1671] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:47.131527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229895db-e86f-4557-92ed-424a946ee621 service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:47.133096 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-229895db-e86f-4557-92ed-424a946ee621 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:47.261860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f00c7-f32d-4161-9948-ed5b74003fe8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:47.263708 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e68f00c7-f32d-4161-9948-ed5b74003fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:47.275248 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:47.282576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229895db-e86f-4557-92ed-424a946ee621 service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:47.401282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49531c13-5aef-4735-a625-6f0b1379eaa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:47.402179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49531c13-5aef-4735-a625-6f0b1379eaa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:47.402868 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49531c13-5aef-4735-a625-6f0b1379eaa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:47.404108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49531c13-5aef-4735-a625-6f0b1379eaa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:47.431168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49531c13-5aef-4735-a625-6f0b1379eaa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:47.435516 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49531c13-5aef-4735-a625-6f0b1379eaa9 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:47.455336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f00c7-f32d-4161-9948-ed5b74003fe8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:47.492128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb93d1-c98f-4492-9de9-bdf2a6632384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:47.492423 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 834/1672] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:15:47.494355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb93d1-c98f-4492-9de9-bdf2a6632384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:47.495460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb93d1-c98f-4492-9de9-bdf2a6632384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:47.495460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb93d1-c98f-4492-9de9-bdf2a6632384 admin admin] PATH_INFO: `/v3/users/242aa611d91b436085781ae4e401390d` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:47.500555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb93d1-c98f-4492-9de9-bdf2a6632384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=242aa611d91b436085781ae4e401390d)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:47.504859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb93d1-c98f-4492-9de9-bdf2a6632384 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:47.698099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49531c13-5aef-4735-a625-6f0b1379eaa9 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:47.719898 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b1eb93d1-c98f-4492-9de9-bdf2a6632384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242aa611d91b436085781ae4e401390d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:47.732006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49531c13-5aef-4735-a625-6f0b1379eaa9 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:47.760376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f9497-2e7e-4c2d-95a6-13b66548e275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:47.765414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9497-2e7e-4c2d-95a6-13b66548e275 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:47.767167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9497-2e7e-4c2d-95a6-13b66548e275 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:47.767794 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9497-2e7e-4c2d-95a6-13b66548e275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:47.772773 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b1eb93d1-c98f-4492-9de9-bdf2a6632384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242aa611d91b436085781ae4e401390d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:47.776227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b1eb93d1-c98f-4492-9de9-bdf2a6632384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242aa611d91b436085781ae4e401390d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:47.851253 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b1eb93d1-c98f-4492-9de9-bdf2a6632384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242aa611d91b436085781ae4e401390d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:47.857885 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b1eb93d1-c98f-4492-9de9-bdf2a6632384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242aa611d91b436085781ae4e401390d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:47.921142 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 839/1673] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:15:47 2022] DELETE /identity/v3/users/242aa611d91b436085781ae4e401390d => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:15:47.928098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bfb93-c84b-401f-b9d1-0019c758fc8c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:47.929442 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bfb93-c84b-401f-b9d1-0019c758fc8c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:47.934376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bfb93-c84b-401f-b9d1-0019c758fc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:47.979531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f9497-2e7e-4c2d-95a6-13b66548e275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:47.981553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f9497-2e7e-4c2d-95a6-13b66548e275 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:47.998062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-503bfb93-c84b-401f-b9d1-0019c758fc8c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:48.003179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 835/1674] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:47 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:15:48.005151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-503bfb93-c84b-401f-b9d1-0019c758fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:48.151839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:48.302808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 840/1675] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:48.321235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f9497-2e7e-4c2d-95a6-13b66548e275 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:48.606929 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f9497-2e7e-4c2d-95a6-13b66548e275 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:48.806108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6983220-d8fa-434d-9b08-b89833532b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:48.807293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6983220-d8fa-434d-9b08-b89833532b91 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:48.807782 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6983220-d8fa-434d-9b08-b89833532b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:48.808262 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6983220-d8fa-434d-9b08-b89833532b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:48.823506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bfb93-c84b-401f-b9d1-0019c758fc8c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:48.825233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-503bfb93-c84b-401f-b9d1-0019c758fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:48.849346 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6983220-d8fa-434d-9b08-b89833532b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:48.852230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6983220-d8fa-434d-9b08-b89833532b91 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:48.852616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bfb93-c84b-401f-b9d1-0019c758fc8c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:48.867664 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162ec8a-ac81-43bb-9438-04ce39a445cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:48.872804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162ec8a-ac81-43bb-9438-04ce39a445cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:48.873258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162ec8a-ac81-43bb-9438-04ce39a445cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:48.873504 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162ec8a-ac81-43bb-9438-04ce39a445cc admin admin] PATH_INFO: `/v3/projects/0cb3da8e6c6e4691a1847419c6c6ff27` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:48.880104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162ec8a-ac81-43bb-9438-04ce39a445cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb3da8e6c6e4691a1847419c6c6ff27)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:48.885250 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162ec8a-ac81-43bb-9438-04ce39a445cc admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:48.898720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 836/1676] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:48.992306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c162ec8a-ac81-43bb-9438-04ce39a445cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb3da8e6c6e4691a1847419c6c6ff27', 'request_id': 'req-c162ec8a-ac81-43bb-9438-04ce39a445cc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:49.006552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c162ec8a-ac81-43bb-9438-04ce39a445cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb3da8e6c6e4691a1847419c6c6ff27', 'request_id': 'req-c162ec8a-ac81-43bb-9438-04ce39a445cc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:49.025586 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c162ec8a-ac81-43bb-9438-04ce39a445cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb3da8e6c6e4691a1847419c6c6ff27', 'request_id': 'req-c162ec8a-ac81-43bb-9438-04ce39a445cc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:49.054271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c162ec8a-ac81-43bb-9438-04ce39a445cc admin admin] The token cache is being invalidate because project 0cb3da8e6c6e4691a1847419c6c6ff27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:15:49.054585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c162ec8a-ac81-43bb-9438-04ce39a445cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:49.059683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c162ec8a-ac81-43bb-9438-04ce39a445cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:49.062486 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 841/1677] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:15:48 2022] DELETE /identity/v3/projects/0cb3da8e6c6e4691a1847419c6c6ff27 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:15:49.069244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8b131-3b6c-46ee-a3e0-aa9d98d39e36 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:49.069701 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8b131-3b6c-46ee-a3e0-aa9d98d39e36 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:49.070199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8b131-3b6c-46ee-a3e0-aa9d98d39e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:49.094498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:49.122468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-13c8b131-3b6c-46ee-a3e0-aa9d98d39e36 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:49.124800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-13c8b131-3b6c-46ee-a3e0-aa9d98d39e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:49.292680 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 837/1678] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:49.302287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c677eb-8712-47ad-b0b5-5f38af93d79a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:49.303047 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c677eb-8712-47ad-b0b5-5f38af93d79a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:49.303047 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c677eb-8712-47ad-b0b5-5f38af93d79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:49.344587 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-18c677eb-8712-47ad-b0b5-5f38af93d79a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:49.345911 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-18c677eb-8712-47ad-b0b5-5f38af93d79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:49.378644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 842/1679] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:49.380093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8b131-3b6c-46ee-a3e0-aa9d98d39e36 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:49.417497 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8b131-3b6c-46ee-a3e0-aa9d98d39e36 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:49.432202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb83ce-8938-41e7-af4c-e87d034383d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:49.433102 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb83ce-8938-41e7-af4c-e87d034383d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:49.433752 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb83ce-8938-41e7-af4c-e87d034383d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:49.434516 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb83ce-8938-41e7-af4c-e87d034383d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:49.435986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb83ce-8938-41e7-af4c-e87d034383d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:15:49.436513 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb83ce-8938-41e7-af4c-e87d034383d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:49.439754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb83ce-8938-41e7-af4c-e87d034383d1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:49.490922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 838/1680] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:15:49.495766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c677eb-8712-47ad-b0b5-5f38af93d79a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:49.510923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c677eb-8712-47ad-b0b5-5f38af93d79a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:49.531162 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114df71-a6db-420b-ba25-559ab2868c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:49.531944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114df71-a6db-420b-ba25-559ab2868c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:49.532225 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114df71-a6db-420b-ba25-559ab2868c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:49.532689 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114df71-a6db-420b-ba25-559ab2868c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:49.533575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114df71-a6db-420b-ba25-559ab2868c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:49.539032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114df71-a6db-420b-ba25-559ab2868c0c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:49.610717 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 843/1681] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:15:49 2022] POST /identity/v3/projects => generated 401 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:49.616141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb83ce-8938-41e7-af4c-e87d034383d1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:49.642123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb83ce-8938-41e7-af4c-e87d034383d1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:49.822303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3b247-f8f6-4212-a5a1-6375532ef254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:49.822303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3b247-f8f6-4212-a5a1-6375532ef254 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:49.822303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3b247-f8f6-4212-a5a1-6375532ef254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:49.822303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3b247-f8f6-4212-a5a1-6375532ef254 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:49.822998 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3b247-f8f6-4212-a5a1-6375532ef254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:49.823527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3b247-f8f6-4212-a5a1-6375532ef254 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:49.877690 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 839/1682] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:15:49 2022] POST /identity/v3/users => generated 301 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:15:49.885560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114df71-a6db-420b-ba25-559ab2868c0c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:49.924457 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114df71-a6db-420b-ba25-559ab2868c0c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:49.947472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0eb700-849e-4d0a-9c49-2cfea7fdaedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:49.948786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eb700-849e-4d0a-9c49-2cfea7fdaedc admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:49.949239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eb700-849e-4d0a-9c49-2cfea7fdaedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:49.950146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eb700-849e-4d0a-9c49-2cfea7fdaedc admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:49.951292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0eb700-849e-4d0a-9c49-2cfea7fdaedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:49.967603 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0eb700-849e-4d0a-9c49-2cfea7fdaedc admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:50.019198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 844/1683] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:50.025946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3b247-f8f6-4212-a5a1-6375532ef254 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:50.070244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3b247-f8f6-4212-a5a1-6375532ef254 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:50.088559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfe355-7ca0-4f4f-b72b-6fb1f3ad76e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:50.091177 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfe355-7ca0-4f4f-b72b-6fb1f3ad76e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:50.094018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfe355-7ca0-4f4f-b72b-6fb1f3ad76e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:50.095201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfe355-7ca0-4f4f-b72b-6fb1f3ad76e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:50.101424 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfe355-7ca0-4f4f-b72b-6fb1f3ad76e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:50.105567 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfe355-7ca0-4f4f-b72b-6fb1f3ad76e9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:50.157867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 840/1684] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:15:50.158896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0eb700-849e-4d0a-9c49-2cfea7fdaedc admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:50.178821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0eb700-849e-4d0a-9c49-2cfea7fdaedc admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:50.199446 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cfc39-2fa7-460d-a9a9-81183326ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:50.201848 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cfc39-2fa7-460d-a9a9-81183326ca25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:50.211511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cfc39-2fa7-460d-a9a9-81183326ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:50.212427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cfc39-2fa7-460d-a9a9-81183326ca25 admin admin] PATH_INFO: `/v3/projects/0b70570330394b079eadbd4d676c1f77/users/a04163554a9241b48798b69d9174e672/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:50.304101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cfc39-2fa7-460d-a9a9-81183326ca25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b70570330394b079eadbd4d676c1f77, user_id=a04163554a9241b48798b69d9174e672, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:50.314848 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cfc39-2fa7-460d-a9a9-81183326ca25 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:50.364452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409361a-b0af-4c11-82d0-66e23f344d41 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:50.365406 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409361a-b0af-4c11-82d0-66e23f344d41 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:50.366113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409361a-b0af-4c11-82d0-66e23f344d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:50.374106 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 845/1685] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:15:50 2022] PUT /identity/v3/projects/0b70570330394b079eadbd4d676c1f77/users/a04163554a9241b48798b69d9174e672/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:50.413916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e409361a-b0af-4c11-82d0-66e23f344d41 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:50.418413 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e409361a-b0af-4c11-82d0-66e23f344d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:50.703208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 841/1686] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:50.841209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cfc39-2fa7-460d-a9a9-81183326ca25 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:50.845874 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c58cfc39-2fa7-460d-a9a9-81183326ca25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:51.160844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cfc39-2fa7-460d-a9a9-81183326ca25 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:51.189041 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03febdda-b760-4a57-acc9-7287fe2cf017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:51.190465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03febdda-b760-4a57-acc9-7287fe2cf017 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:51.203041 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03febdda-b760-4a57-acc9-7287fe2cf017 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:51.203727 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03febdda-b760-4a57-acc9-7287fe2cf017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:51.268303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03febdda-b760-4a57-acc9-7287fe2cf017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:51.273012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03febdda-b760-4a57-acc9-7287fe2cf017 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:51.299829 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:51.341348 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 846/1687] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:53.203670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409361a-b0af-4c11-82d0-66e23f344d41 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:53.206417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e409361a-b0af-4c11-82d0-66e23f344d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:53.275589 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409361a-b0af-4c11-82d0-66e23f344d41 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:53.295704 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd4771-fc71-4239-8a19-3789cca004d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:53.307314 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd4771-fc71-4239-8a19-3789cca004d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:53.308842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd4771-fc71-4239-8a19-3789cca004d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:53.309297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd4771-fc71-4239-8a19-3789cca004d2 admin admin] PATH_INFO: `/v3/projects/d8ddc4e883544526b73dcf187e9a0788` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:53.315588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd4771-fc71-4239-8a19-3789cca004d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ddc4e883544526b73dcf187e9a0788)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:53.335337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd4771-fc71-4239-8a19-3789cca004d2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:53.342599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:53.541719 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b8bd4771-fc71-4239-8a19-3789cca004d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ddc4e883544526b73dcf187e9a0788', 'request_id': 'req-b8bd4771-fc71-4239-8a19-3789cca004d2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:53.573544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b8bd4771-fc71-4239-8a19-3789cca004d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ddc4e883544526b73dcf187e9a0788', 'request_id': 'req-b8bd4771-fc71-4239-8a19-3789cca004d2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:53.592093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b8bd4771-fc71-4239-8a19-3789cca004d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ddc4e883544526b73dcf187e9a0788', 'request_id': 'req-b8bd4771-fc71-4239-8a19-3789cca004d2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:53.657629 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b8bd4771-fc71-4239-8a19-3789cca004d2 admin admin] The token cache is being invalidate because project d8ddc4e883544526b73dcf187e9a0788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:15:53.658566 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b8bd4771-fc71-4239-8a19-3789cca004d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:53.660374 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b8bd4771-fc71-4239-8a19-3789cca004d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:53.670514 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 842/1688] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:15:53 2022] DELETE /identity/v3/projects/d8ddc4e883544526b73dcf187e9a0788 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:53.671995 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03febdda-b760-4a57-acc9-7287fe2cf017 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:53.706321 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03febdda-b760-4a57-acc9-7287fe2cf017 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:54.149820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681b3f4-3457-4886-b195-523bc849cb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:54.157793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b3f4-3457-4886-b195-523bc849cb89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:54.167112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b3f4-3457-4886-b195-523bc849cb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:54.167965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b3f4-3457-4886-b195-523bc849cb89 admin admin] PATH_INFO: `/v3/users/3fa09f0c84ff4c75938129a42872dbeb` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:54.178616 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fc92e-22e6-4b0a-829e-678201f5b304 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:54.179445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fc92e-22e6-4b0a-829e-678201f5b304 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:54.180506 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fc92e-22e6-4b0a-829e-678201f5b304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:54.184163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681b3f4-3457-4886-b195-523bc849cb89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa09f0c84ff4c75938129a42872dbeb)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:54.202988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681b3f4-3457-4886-b195-523bc849cb89 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:54.324411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f54fc92e-22e6-4b0a-829e-678201f5b304 None None] MFA Rules not processed for user `5a6cf4855b754111826284c3c6f43d98`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:54.328346 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f54fc92e-22e6-4b0a-829e-678201f5b304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:54.502773 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4681b3f4-3457-4886-b195-523bc849cb89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa09f0c84ff4c75938129a42872dbeb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:54.552283 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4681b3f4-3457-4886-b195-523bc849cb89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa09f0c84ff4c75938129a42872dbeb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:54.554534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4681b3f4-3457-4886-b195-523bc849cb89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa09f0c84ff4c75938129a42872dbeb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:54.649560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4681b3f4-3457-4886-b195-523bc849cb89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa09f0c84ff4c75938129a42872dbeb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:54.652960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4681b3f4-3457-4886-b195-523bc849cb89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa09f0c84ff4c75938129a42872dbeb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:54.729973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 847/1689] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:15:53 2022] DELETE /identity/v3/users/3fa09f0c84ff4c75938129a42872dbeb => generated 0 bytes in 1055 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:15:54.774052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 843/1690] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 597 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:15:54.794104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010754e-0f79-4c49-b4ae-93af8c2d516a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:54.794620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010754e-0f79-4c49-b4ae-93af8c2d516a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:54.795151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010754e-0f79-4c49-b4ae-93af8c2d516a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:54.923233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4010754e-0f79-4c49-b4ae-93af8c2d516a None None] MFA Rules not processed for user `5a6cf4855b754111826284c3c6f43d98`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:54.934862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4010754e-0f79-4c49-b4ae-93af8c2d516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:55.155952 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 848/1691] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:15:55.178484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fc92e-22e6-4b0a-829e-678201f5b304 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:55.181270 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f54fc92e-22e6-4b0a-829e-678201f5b304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:55.457826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fc92e-22e6-4b0a-829e-678201f5b304 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:55.513788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:55.651945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0259d-7035-417e-a239-35236b436cd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:55.654209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0259d-7035-417e-a239-35236b436cd9 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:55.654884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0259d-7035-417e-a239-35236b436cd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:55.669172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0259d-7035-417e-a239-35236b436cd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:55.714687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0259d-7035-417e-a239-35236b436cd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:55.719264 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0259d-7035-417e-a239-35236b436cd9 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:55.762497 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 844/1692] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:15:58.149927 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a8383-6e9d-430e-a8cb-9695e612e8d5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:58.151325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a8383-6e9d-430e-a8cb-9695e612e8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:58.151963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a8383-6e9d-430e-a8cb-9695e612e8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:58.246097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-034a8383-6e9d-430e-a8cb-9695e612e8d5 None None] MFA Rules not processed for user `491d61d97e114e5988bab922a0f366bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:58.249714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-034a8383-6e9d-430e-a8cb-9695e612e8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:58.349668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:58.537103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 849/1693] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:58.650020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c775e4-b633-4fa7-bead-e02164008ac1 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:58.651413 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c775e4-b633-4fa7-bead-e02164008ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:58.651940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c775e4-b633-4fa7-bead-e02164008ac1 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:58.656759 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 845/1694] 10.222.0.15 () {54 vars in 912 bytes} [Thu Jul 21 12:15:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:15:58.681333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40992a71-eff8-4a72-8841-883d4149aae2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:58.682154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40992a71-eff8-4a72-8841-883d4149aae2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:58.682684 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40992a71-eff8-4a72-8841-883d4149aae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:58.767960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-40992a71-eff8-4a72-8841-883d4149aae2 None None] MFA Rules not processed for user `88cfd88c19fd4c979e921e3d8cd9cc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:58.775864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-40992a71-eff8-4a72-8841-883d4149aae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:58.793501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c775e4-b633-4fa7-bead-e02164008ac1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:58.800862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-67c775e4-b633-4fa7-bead-e02164008ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:59.007748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 850/1695] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:59.038014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c775e4-b633-4fa7-bead-e02164008ac1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:59.068327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:59.069800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:59.070471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:59.077951 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e admin admin] PATH_INFO: `/v3/projects/33c7df8e66c843008b51aa1d4df5ed16` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:59.080745 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e admin admin] RBAC: Authorizing `identity:delete_project(project_id=33c7df8e66c843008b51aa1d4df5ed16)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:59.090450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:59.322284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c7df8e66c843008b51aa1d4df5ed16', 'request_id': 'req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:59.361984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c7df8e66c843008b51aa1d4df5ed16', 'request_id': 'req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:59.381878 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c7df8e66c843008b51aa1d4df5ed16', 'request_id': 'req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:59.421699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40992a71-eff8-4a72-8841-883d4149aae2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:59.424703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-40992a71-eff8-4a72-8841-883d4149aae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:59.447768 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e admin admin] The token cache is being invalidate because project 33c7df8e66c843008b51aa1d4df5ed16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:15:59.448348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:59.449969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2f6b5d48-d4ea-4627-8bd0-098e6829e36e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:15:59.463470 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 846/1696] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:15:58 2022] DELETE /identity/v3/projects/33c7df8e66c843008b51aa1d4df5ed16 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:15:59.468891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40992a71-eff8-4a72-8841-883d4149aae2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:15:59.469935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddf821-eae9-49dc-ad6a-c28bbea219cd None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:59.470715 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddf821-eae9-49dc-ad6a-c28bbea219cd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:59.471192 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddf821-eae9-49dc-ad6a-c28bbea219cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:59.620372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a2ddf821-eae9-49dc-ad6a-c28bbea219cd None None] MFA Rules not processed for user `d9a96b51c98344a09cc59af05dd455ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:59.623021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a2ddf821-eae9-49dc-ad6a-c28bbea219cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:59.651537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7b627-3600-4957-968e-c1df0462e08a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:15:59.659406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7b627-3600-4957-968e-c1df0462e08a service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:59.661226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7b627-3600-4957-968e-c1df0462e08a service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:59.661772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7b627-3600-4957-968e-c1df0462e08a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:59.673117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-25f7b627-3600-4957-968e-c1df0462e08a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:59.698017 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:15:59.738338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7b627-3600-4957-968e-c1df0462e08a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:15:59.741874 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7b627-3600-4957-968e-c1df0462e08a service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:15:59.797075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 851/1697] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:15:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:15:59.823132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7c084-29e3-4227-9ddd-9d8a34b4bf9a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:15:59.824239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7c084-29e3-4227-9ddd-9d8a34b4bf9a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:15:59.825243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7c084-29e3-4227-9ddd-9d8a34b4bf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:15:59.836724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 847/1698] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:15:59.847578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddf821-eae9-49dc-ad6a-c28bbea219cd None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:15:59.852344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a2ddf821-eae9-49dc-ad6a-c28bbea219cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:15:59.991889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-51b7c084-29e3-4227-9ddd-9d8a34b4bf9a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:15:59.994893 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-51b7c084-29e3-4227-9ddd-9d8a34b4bf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:00.113988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddf821-eae9-49dc-ad6a-c28bbea219cd None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:00.136657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b215222-b974-4e46-acc8-55a85092c663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:00.137912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b215222-b974-4e46-acc8-55a85092c663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:00.138209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b215222-b974-4e46-acc8-55a85092c663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:00.138510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b215222-b974-4e46-acc8-55a85092c663 admin admin] PATH_INFO: `/v3/users/850c07a12421469e9948b42d0617b65e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:00.141334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b215222-b974-4e46-acc8-55a85092c663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=850c07a12421469e9948b42d0617b65e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:00.142611 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b215222-b974-4e46-acc8-55a85092c663 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:00.316815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 852/1699] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:00.321651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96fe5a-2c50-4eb6-b005-c92810beb43c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:00.322146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96fe5a-2c50-4eb6-b005-c92810beb43c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:00.322646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96fe5a-2c50-4eb6-b005-c92810beb43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:00.329007 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9b215222-b974-4e46-acc8-55a85092c663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '850c07a12421469e9948b42d0617b65e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:00.331319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9b215222-b974-4e46-acc8-55a85092c663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '850c07a12421469e9948b42d0617b65e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:00.352950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:00.359567 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9b215222-b974-4e46-acc8-55a85092c663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '850c07a12421469e9948b42d0617b65e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:00.385637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ed96fe5a-2c50-4eb6-b005-c92810beb43c None None] MFA Rules not processed for user `2b092b666ad84405a6ed07827fcd8a87`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:00.385907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9b215222-b974-4e46-acc8-55a85092c663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '850c07a12421469e9948b42d0617b65e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:00.386679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9b215222-b974-4e46-acc8-55a85092c663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '850c07a12421469e9948b42d0617b65e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:00.389072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ed96fe5a-2c50-4eb6-b005-c92810beb43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:00.407637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 848/1700] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:15:59 2022] DELETE /identity/v3/users/850c07a12421469e9948b42d0617b65e => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:00.411847 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750dab8-3f02-43c4-8f43-05c9f1bfcfa7 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:00.411847 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750dab8-3f02-43c4-8f43-05c9f1bfcfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:00.412200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750dab8-3f02-43c4-8f43-05c9f1bfcfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:00.437220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-6750dab8-3f02-43c4-8f43-05c9f1bfcfa7 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:00.438571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6750dab8-3f02-43c4-8f43-05c9f1bfcfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:00.499617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:00.534743 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 849/1701] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:00.536373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed1f4-773b-4926-bd73-3233a038f861 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:00.536741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed1f4-773b-4926-bd73-3233a038f861 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:00.537272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed1f4-773b-4926-bd73-3233a038f861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:00.560842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-6b3ed1f4-773b-4926-bd73-3233a038f861 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:00.563790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6b3ed1f4-773b-4926-bd73-3233a038f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:00.602058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 850/1702] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:00.604551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ed1f4-773b-4926-bd73-3233a038f861 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:00.633098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 853/1703] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:00.634182 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96fe5a-2c50-4eb6-b005-c92810beb43c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:00.638180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ed96fe5a-2c50-4eb6-b005-c92810beb43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:00.639032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ed1f4-773b-4926-bd73-3233a038f861 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:00.666995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da829a40-96d6-4627-bb8b-556e4bf0e08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:00.668372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da829a40-96d6-4627-bb8b-556e4bf0e08c admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:00.668815 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da829a40-96d6-4627-bb8b-556e4bf0e08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:00.669320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da829a40-96d6-4627-bb8b-556e4bf0e08c admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:00.671026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96fe5a-2c50-4eb6-b005-c92810beb43c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:00.672849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da829a40-96d6-4627-bb8b-556e4bf0e08c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:16:00.680215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da829a40-96d6-4627-bb8b-556e4bf0e08c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:00.683823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da829a40-96d6-4627-bb8b-556e4bf0e08c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:00.748379 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 851/1704] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:16:00.755405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da829a40-96d6-4627-bb8b-556e4bf0e08c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:00.794050 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8ede7-2153-4dc3-935b-38437f7b162f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:00.794323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da829a40-96d6-4627-bb8b-556e4bf0e08c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:00.795092 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8ede7-2153-4dc3-935b-38437f7b162f service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:00.796346 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8ede7-2153-4dc3-935b-38437f7b162f service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:00.796915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8ede7-2153-4dc3-935b-38437f7b162f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:00.814709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0da32-a4ab-411b-b0b9-b8add4ac487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:00.816299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0da32-a4ab-411b-b0b9-b8add4ac487a admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:00.816436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0da32-a4ab-411b-b0b9-b8add4ac487a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:00.816977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0da32-a4ab-411b-b0b9-b8add4ac487a admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:00.819898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0da32-a4ab-411b-b0b9-b8add4ac487a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:00.822681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0da32-a4ab-411b-b0b9-b8add4ac487a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:00.853763 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8ede7-2153-4dc3-935b-38437f7b162f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:00.857076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8ede7-2153-4dc3-935b-38437f7b162f service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:00.885375 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 854/1705] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:00.959845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 852/1706] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:00 2022] POST /identity/v3/projects => generated 367 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:16:00.962303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8ede7-2153-4dc3-935b-38437f7b162f service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:00.991414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95eb25-da5d-48db-be68-159e69555708 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:00.991414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95eb25-da5d-48db-be68-159e69555708 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:00.991414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95eb25-da5d-48db-be68-159e69555708 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:00.994351 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 853/1707] 10.222.0.15 () {54 vars in 912 bytes} [Thu Jul 21 12:16:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:16:01.012404 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8ede7-2153-4dc3-935b-38437f7b162f service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:01.014432 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644f3f3-1672-4a27-82d0-0c12aa15f584 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:01.015164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644f3f3-1672-4a27-82d0-0c12aa15f584 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:01.015976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644f3f3-1672-4a27-82d0-0c12aa15f584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:01.045154 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b644f3f3-1672-4a27-82d0-0c12aa15f584 None None] MFA Rules not processed for user `88cfd88c19fd4c979e921e3d8cd9cc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:01.049331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b644f3f3-1672-4a27-82d0-0c12aa15f584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:01.145975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 854/1708] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:01.276418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644f3f3-1672-4a27-82d0-0c12aa15f584 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:01.278805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b644f3f3-1672-4a27-82d0-0c12aa15f584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:01.300741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644f3f3-1672-4a27-82d0-0c12aa15f584 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:01.309326 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c2e48-53f7-4065-8c16-b79ceeeb82d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:01.310385 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2e48-53f7-4065-8c16-b79ceeeb82d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:01.311030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2e48-53f7-4065-8c16-b79ceeeb82d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:01.311411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2e48-53f7-4065-8c16-b79ceeeb82d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:01.328962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c2e48-53f7-4065-8c16-b79ceeeb82d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:01.330467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d6315-a37b-4a0b-a5af-1c850f8e9e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:01.331486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c2e48-53f7-4065-8c16-b79ceeeb82d0 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:01.333955 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6315-a37b-4a0b-a5af-1c850f8e9e98 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:01.335547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6315-a37b-4a0b-a5af-1c850f8e9e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:01.339493 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6315-a37b-4a0b-a5af-1c850f8e9e98 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:01.345241 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 855/1709] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:16:01.349519 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d6315-a37b-4a0b-a5af-1c850f8e9e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:01.353584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d6315-a37b-4a0b-a5af-1c850f8e9e98 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:01.397882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57be703-c641-49a2-b1e0-dbae7e667706 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:01.398403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57be703-c641-49a2-b1e0-dbae7e667706 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:01.398957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57be703-c641-49a2-b1e0-dbae7e667706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:01.497480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 855/1710] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:00 2022] POST /identity/v3/users => generated 284 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:01.499338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d6315-a37b-4a0b-a5af-1c850f8e9e98 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:01.529641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d57be703-c641-49a2-b1e0-dbae7e667706 None None] MFA Rules not processed for user `a04163554a9241b48798b69d9174e672`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:01.532896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d6315-a37b-4a0b-a5af-1c850f8e9e98 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:01.534344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d57be703-c641-49a2-b1e0-dbae7e667706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:01.543123 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607080c6-ad28-40c4-987d-b473ab2c9847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:01.544729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607080c6-ad28-40c4-987d-b473ab2c9847 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:01.545464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607080c6-ad28-40c4-987d-b473ab2c9847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:01.546808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607080c6-ad28-40c4-987d-b473ab2c9847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:01.548580 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607080c6-ad28-40c4-987d-b473ab2c9847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:01.556703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607080c6-ad28-40c4-987d-b473ab2c9847 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:01.612565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 856/1711] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:01.615019 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607080c6-ad28-40c4-987d-b473ab2c9847 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:01.666477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607080c6-ad28-40c4-987d-b473ab2c9847 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:01.697121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bb4d5-57e4-4895-9bf9-dc1fe337fb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:01.701572 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb4d5-57e4-4895-9bf9-dc1fe337fb93 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:01.704205 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb4d5-57e4-4895-9bf9-dc1fe337fb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:01.710107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb4d5-57e4-4895-9bf9-dc1fe337fb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:01.711830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bb4d5-57e4-4895-9bf9-dc1fe337fb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:01.730940 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bb4d5-57e4-4895-9bf9-dc1fe337fb93 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:01.796515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 856/1713] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:16:01.798540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57be703-c641-49a2-b1e0-dbae7e667706 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:01.806584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 857/1713] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:01.808548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bb4d5-57e4-4895-9bf9-dc1fe337fb93 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:01.816096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b45bb4d5-57e4-4895-9bf9-dc1fe337fb93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:01.872619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57be703-c641-49a2-b1e0-dbae7e667706 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:01.893463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bb4d5-57e4-4895-9bf9-dc1fe337fb93 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:01.899841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995ddfd-32c3-46b2-bbfe-450ae5e50cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:01.907109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995ddfd-32c3-46b2-bbfe-450ae5e50cde admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:01.907839 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995ddfd-32c3-46b2-bbfe-450ae5e50cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:01.910172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995ddfd-32c3-46b2-bbfe-450ae5e50cde admin admin] PATH_INFO: `/v3/projects/3dba2b57501349079f9ec77b4e0edfbd/users/4f395b7111284275a4c29fcb090e61c6/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:01.917450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd7503-b678-4b31-8c09-22a56714f57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:01.921315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd7503-b678-4b31-8c09-22a56714f57d admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:01.924193 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd7503-b678-4b31-8c09-22a56714f57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:01.927062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd7503-b678-4b31-8c09-22a56714f57d admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:01.928483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd7503-b678-4b31-8c09-22a56714f57d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:01.942305 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd7503-b678-4b31-8c09-22a56714f57d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:01.962976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:02.012411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995ddfd-32c3-46b2-bbfe-450ae5e50cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dba2b57501349079f9ec77b4e0edfbd, user_id=4f395b7111284275a4c29fcb090e61c6, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:02.017827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995ddfd-32c3-46b2-bbfe-450ae5e50cde admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:02.071140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 858/1714] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:01 2022] POST /identity/v3/projects => generated 405 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:02.072168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd7503-b678-4b31-8c09-22a56714f57d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:02.074807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-24fd7503-b678-4b31-8c09-22a56714f57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:02.083913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 857/1715] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:01 2022] PUT /identity/v3/projects/3dba2b57501349079f9ec77b4e0edfbd/users/4f395b7111284275a4c29fcb090e61c6/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:02.085581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995ddfd-32c3-46b2-bbfe-450ae5e50cde admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:02.117787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:02.277987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd7503-b678-4b31-8c09-22a56714f57d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:02.286688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89466bef-8a9c-415e-adbc-dc9e26fac01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:02.288276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89466bef-8a9c-415e-adbc-dc9e26fac01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:02.288965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89466bef-8a9c-415e-adbc-dc9e26fac01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:02.290638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89466bef-8a9c-415e-adbc-dc9e26fac01c admin admin] PATH_INFO: `/v3/projects/32a3aa347fdd452bbdc12d9e1f588ade` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:02.294794 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89466bef-8a9c-415e-adbc-dc9e26fac01c admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a3aa347fdd452bbdc12d9e1f588ade)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:02.303615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89466bef-8a9c-415e-adbc-dc9e26fac01c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:02.320073 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995ddfd-32c3-46b2-bbfe-450ae5e50cde admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:02.329816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138191b3-98ad-4fdf-bfe6-74f8e08d71a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:02.331183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138191b3-98ad-4fdf-bfe6-74f8e08d71a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:02.331489 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138191b3-98ad-4fdf-bfe6-74f8e08d71a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:02.332260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138191b3-98ad-4fdf-bfe6-74f8e08d71a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:02.339943 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138191b3-98ad-4fdf-bfe6-74f8e08d71a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:02.342256 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138191b3-98ad-4fdf-bfe6-74f8e08d71a7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:02.413540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 858/1716] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:02 2022] POST /identity/v3/users => generated 309 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:02.416448 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a9ae9-b903-4421-9589-6bf2d9b9c5ac None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:02.416738 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a9ae9-b903-4421-9589-6bf2d9b9c5ac None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:02.417139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a9ae9-b903-4421-9589-6bf2d9b9c5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:02.508518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ba6a9ae9-b903-4421-9589-6bf2d9b9c5ac None None] MFA Rules not processed for user `4f395b7111284275a4c29fcb090e61c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:02.513263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ba6a9ae9-b903-4421-9589-6bf2d9b9c5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:02.530090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-89466bef-8a9c-415e-adbc-dc9e26fac01c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a3aa347fdd452bbdc12d9e1f588ade', 'request_id': 'req-89466bef-8a9c-415e-adbc-dc9e26fac01c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:02.560246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-89466bef-8a9c-415e-adbc-dc9e26fac01c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a3aa347fdd452bbdc12d9e1f588ade', 'request_id': 'req-89466bef-8a9c-415e-adbc-dc9e26fac01c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:02.584963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-89466bef-8a9c-415e-adbc-dc9e26fac01c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a3aa347fdd452bbdc12d9e1f588ade', 'request_id': 'req-89466bef-8a9c-415e-adbc-dc9e26fac01c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:02.652632 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-89466bef-8a9c-415e-adbc-dc9e26fac01c admin admin] The token cache is being invalidate because project 32a3aa347fdd452bbdc12d9e1f588ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:02.655206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-89466bef-8a9c-415e-adbc-dc9e26fac01c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:02.659453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-89466bef-8a9c-415e-adbc-dc9e26fac01c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:02.666451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 859/1717] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:02 2022] DELETE /identity/v3/projects/32a3aa347fdd452bbdc12d9e1f588ade => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:02.668361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d24f4-ec64-4d02-bba1-c684a6b3ccf9 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:02.668983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d24f4-ec64-4d02-bba1-c684a6b3ccf9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:02.669063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d24f4-ec64-4d02-bba1-c684a6b3ccf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:02.779206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c86d24f4-ec64-4d02-bba1-c684a6b3ccf9 None None] MFA Rules not processed for user `e255fb99a08c41289688042238d152ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:02.784941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c86d24f4-ec64-4d02-bba1-c684a6b3ccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:02.952574 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 859/1718] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 538 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:02.955361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a9ae9-b903-4421-9589-6bf2d9b9c5ac None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:02.971353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ba6a9ae9-b903-4421-9589-6bf2d9b9c5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:03.145213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 860/1719] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:03.145213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d24f4-ec64-4d02-bba1-c684a6b3ccf9 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:03.145213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c86d24f4-ec64-4d02-bba1-c684a6b3ccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:03.156984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:03.380348 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d24f4-ec64-4d02-bba1-c684a6b3ccf9 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:03.384311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a9ae9-b903-4421-9589-6bf2d9b9c5ac None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:03.389367 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc6504-b753-4600-a9c9-74b8be89ce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:03.394536 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc6504-b753-4600-a9c9-74b8be89ce88 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:03.394949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc6504-b753-4600-a9c9-74b8be89ce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:03.395298 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc6504-b753-4600-a9c9-74b8be89ce88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:03.396796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c1689-9efa-4fa8-a992-67cd645924d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:03.397712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c1689-9efa-4fa8-a992-67cd645924d1 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:03.397852 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc6504-b753-4600-a9c9-74b8be89ce88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:03.398408 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c1689-9efa-4fa8-a992-67cd645924d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:03.398877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c1689-9efa-4fa8-a992-67cd645924d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:03.401680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc6504-b753-4600-a9c9-74b8be89ce88 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:03.402517 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-469c1689-9efa-4fa8-a992-67cd645924d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:03.441409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 861/1720] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:03.443115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e98ddb-35ac-4570-a242-059ffb759f87 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:03.443411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e98ddb-35ac-4570-a242-059ffb759f87 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:03.445061 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e98ddb-35ac-4570-a242-059ffb759f87 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:03.445544 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 862/1721] 10.222.0.15 () {54 vars in 961 bytes} [Thu Jul 21 12:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:16:03.447306 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:03.448199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e98ddb-35ac-4570-a242-059ffb759f87 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:03.459003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-52e98ddb-35ac-4570-a242-059ffb759f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:03.490943 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e98ddb-35ac-4570-a242-059ffb759f87 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:03.499934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e5650-4239-473f-be18-72d8516573ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:03.501976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e5650-4239-473f-be18-72d8516573ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:03.502705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e5650-4239-473f-be18-72d8516573ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:03.503330 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e5650-4239-473f-be18-72d8516573ff admin admin] PATH_INFO: `/v3/users/b9c22dac77da49eda0ea51a7b0246004` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:03.506118 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e5650-4239-473f-be18-72d8516573ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c22dac77da49eda0ea51a7b0246004)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:03.510714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e5650-4239-473f-be18-72d8516573ff admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:03.539823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c1689-9efa-4fa8-a992-67cd645924d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:03.542310 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c1689-9efa-4fa8-a992-67cd645924d1 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:03.578969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 860/1722] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:03.580574 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c1689-9efa-4fa8-a992-67cd645924d1 service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:03.582115 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-469c1689-9efa-4fa8-a992-67cd645924d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:03.670954 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c1689-9efa-4fa8-a992-67cd645924d1 service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:03.686283 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2b9e5650-4239-473f-be18-72d8516573ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c22dac77da49eda0ea51a7b0246004'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:03.693146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666e121-d0fb-442f-8274-5bab908708db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:03.696662 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e121-d0fb-442f-8274-5bab908708db admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:03.697696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e121-d0fb-442f-8274-5bab908708db admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:03.698338 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e121-d0fb-442f-8274-5bab908708db admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:03.702884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666e121-d0fb-442f-8274-5bab908708db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:03.714043 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666e121-d0fb-442f-8274-5bab908708db admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:03.721292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2b9e5650-4239-473f-be18-72d8516573ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c22dac77da49eda0ea51a7b0246004'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:03.726979 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2b9e5650-4239-473f-be18-72d8516573ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c22dac77da49eda0ea51a7b0246004'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:03.805137 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2b9e5650-4239-473f-be18-72d8516573ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c22dac77da49eda0ea51a7b0246004'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:03.806813 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2b9e5650-4239-473f-be18-72d8516573ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c22dac77da49eda0ea51a7b0246004'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:03.860470 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 861/1723] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:03 2022] POST /identity/v3/projects => generated 367 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:03.865482 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc67d0-e733-4cf9-a330-82055dafe6c1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:03.866891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc67d0-e733-4cf9-a330-82055dafe6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:03.868863 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc67d0-e733-4cf9-a330-82055dafe6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:03.875968 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 863/1724] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:03 2022] DELETE /identity/v3/users/b9c22dac77da49eda0ea51a7b0246004 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:03.877527 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e5650-4239-473f-be18-72d8516573ff admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:03.888497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2b9e5650-4239-473f-be18-72d8516573ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:03.973932 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-11bc67d0-e733-4cf9-a330-82055dafe6c1 None None] MFA Rules not processed for user `e255fb99a08c41289688042238d152ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:03.977000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-11bc67d0-e733-4cf9-a330-82055dafe6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:04.184909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e5650-4239-473f-be18-72d8516573ff admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:04.207162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 862/1725] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:04.209065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc67d0-e733-4cf9-a330-82055dafe6c1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:04.211451 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-11bc67d0-e733-4cf9-a330-82055dafe6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:04.222622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6350ff3-81cd-4ba3-829d-9ee22216cbb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:04.223807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6350ff3-81cd-4ba3-829d-9ee22216cbb1 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:04.224287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6350ff3-81cd-4ba3-829d-9ee22216cbb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:04.224801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6350ff3-81cd-4ba3-829d-9ee22216cbb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:04.233274 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c6350ff3-81cd-4ba3-829d-9ee22216cbb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:04.267751 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:04.454046 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6350ff3-81cd-4ba3-829d-9ee22216cbb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:04.459628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6350ff3-81cd-4ba3-829d-9ee22216cbb1 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:04.491760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 864/1726] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:04.494450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6350ff3-81cd-4ba3-829d-9ee22216cbb1 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:04.496760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c6350ff3-81cd-4ba3-829d-9ee22216cbb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:04.513072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc67d0-e733-4cf9-a330-82055dafe6c1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:04.528862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c9169-9de3-4bf4-89dd-b312734d3a82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06c172bcd99f469f83728c98d061a7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:04.529564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c9169-9de3-4bf4-89dd-b312734d3a82 service placement] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:04.529858 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c9169-9de3-4bf4-89dd-b312734d3a82 service placement] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:04.530140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c9169-9de3-4bf4-89dd-b312734d3a82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:04.536504 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e97c9169-9de3-4bf4-89dd-b312734d3a82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:04.574708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c9169-9de3-4bf4-89dd-b312734d3a82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:04.576506 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c9169-9de3-4bf4-89dd-b312734d3a82 service placement] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:04.629508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 863/1727] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:04.632231 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a4400-b89e-4e41-9865-5c75e8d84188 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:04.632793 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a4400-b89e-4e41-9865-5c75e8d84188 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:04.633382 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a4400-b89e-4e41-9865-5c75e8d84188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:04.681893 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6350ff3-81cd-4ba3-829d-9ee22216cbb1 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:04.699632 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845030e-6859-4996-b712-87a62dd910e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:04.703004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8a9a4400-b89e-4e41-9865-5c75e8d84188 None None] MFA Rules not processed for user `06c172bcd99f469f83728c98d061a7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:04.705552 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8a9a4400-b89e-4e41-9865-5c75e8d84188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:04.706430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845030e-6859-4996-b712-87a62dd910e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:04.707016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845030e-6859-4996-b712-87a62dd910e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:04.708535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845030e-6859-4996-b712-87a62dd910e7 admin admin] PATH_INFO: `/v3/projects/441b2e2ca74348538a905b4cf368aeb3/users/a2eb46710fb84be58bb7052cfa4b5915/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:04.747016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845030e-6859-4996-b712-87a62dd910e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=441b2e2ca74348538a905b4cf368aeb3, user_id=a2eb46710fb84be58bb7052cfa4b5915, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:04.751112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845030e-6859-4996-b712-87a62dd910e7 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:04.756420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 864/1728] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Jul 21 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:04.758055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a4400-b89e-4e41-9865-5c75e8d84188 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:04.774452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8a9a4400-b89e-4e41-9865-5c75e8d84188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:04.781163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 865/1729] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:04 2022] PUT /identity/v3/projects/441b2e2ca74348538a905b4cf368aeb3/users/a2eb46710fb84be58bb7052cfa4b5915/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:04.781163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845030e-6859-4996-b712-87a62dd910e7 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:04.781425 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2845030e-6859-4996-b712-87a62dd910e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:04.857236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a4400-b89e-4e41-9865-5c75e8d84188 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:04.905484 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845030e-6859-4996-b712-87a62dd910e7 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:04.913964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cd840-eecc-4a29-956a-dc7c26a1c2d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:04.915425 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cd840-eecc-4a29-956a-dc7c26a1c2d6 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:04.915713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cd840-eecc-4a29-956a-dc7c26a1c2d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:04.915993 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cd840-eecc-4a29-956a-dc7c26a1c2d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:04.918327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f77cd840-eecc-4a29-956a-dc7c26a1c2d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:04.966879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:05.017640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:05.100640 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cd840-eecc-4a29-956a-dc7c26a1c2d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:05.102553 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cd840-eecc-4a29-956a-dc7c26a1c2d6 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:05.133564 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 866/1730] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:05.138781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cd840-eecc-4a29-956a-dc7c26a1c2d6 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:05.245903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff75c2-c30b-4795-ad42-f53d5a71223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:05.247207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff75c2-c30b-4795-ad42-f53d5a71223e admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:05.247750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff75c2-c30b-4795-ad42-f53d5a71223e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:05.248302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff75c2-c30b-4795-ad42-f53d5a71223e admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:05.251011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff75c2-c30b-4795-ad42-f53d5a71223e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:05.280465 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff75c2-c30b-4795-ad42-f53d5a71223e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:05.391302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 865/1731] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:04 2022] POST /identity/v3/users => generated 290 bytes in 634 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:05.393125 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff75c2-c30b-4795-ad42-f53d5a71223e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:05.412221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cd840-eecc-4a29-956a-dc7c26a1c2d6 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:05.441893 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b160a-d6ef-448a-afe6-40b8de7365a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06c172bcd99f469f83728c98d061a7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:05.446256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b160a-d6ef-448a-afe6-40b8de7365a0 service placement] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:05.447410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b160a-d6ef-448a-afe6-40b8de7365a0 service placement] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:05.448635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b160a-d6ef-448a-afe6-40b8de7365a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:05.477548 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff75c2-c30b-4795-ad42-f53d5a71223e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:05.507378 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989ffb9-4ff4-4427-a763-f4f0f1a67344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:05.508723 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989ffb9-4ff4-4427-a763-f4f0f1a67344 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:05.509288 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989ffb9-4ff4-4427-a763-f4f0f1a67344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:05.509826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989ffb9-4ff4-4427-a763-f4f0f1a67344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:05.515312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989ffb9-4ff4-4427-a763-f4f0f1a67344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:05.519130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989ffb9-4ff4-4427-a763-f4f0f1a67344 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:05.524138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b160a-d6ef-448a-afe6-40b8de7365a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:05.531548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b160a-d6ef-448a-afe6-40b8de7365a0 service placement] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:05.589275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 867/1732] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:05.592854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b160a-d6ef-448a-afe6-40b8de7365a0 service placement] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:05.595972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 866/1733] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:05.602350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989ffb9-4ff4-4427-a763-f4f0f1a67344 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:05.641476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b160a-d6ef-448a-afe6-40b8de7365a0 service placement] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:05.664511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf18ea-03fe-470a-ab28-e88b9c83492c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:05.666880 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf18ea-03fe-470a-ab28-e88b9c83492c admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:05.669039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf18ea-03fe-470a-ab28-e88b9c83492c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:05.675480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf18ea-03fe-470a-ab28-e88b9c83492c admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:05.677510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf18ea-03fe-470a-ab28-e88b9c83492c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:05.684843 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf18ea-03fe-470a-ab28-e88b9c83492c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:05.685570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989ffb9-4ff4-4427-a763-f4f0f1a67344 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:05.714047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1bdc2-fb0a-41fb-b377-23e399bced08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:05.717072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1bdc2-fb0a-41fb-b377-23e399bced08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:05.717524 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1bdc2-fb0a-41fb-b377-23e399bced08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:05.718208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1bdc2-fb0a-41fb-b377-23e399bced08 admin admin] PATH_INFO: `/v3/projects/441b2e2ca74348538a905b4cf368aeb3/users/a2eb46710fb84be58bb7052cfa4b5915/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:05.739795 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1bdc2-fb0a-41fb-b377-23e399bced08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=441b2e2ca74348538a905b4cf368aeb3, user_id=a2eb46710fb84be58bb7052cfa4b5915, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:05.750417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 868/1734] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:05.757522 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1bdc2-fb0a-41fb-b377-23e399bced08 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:05.757784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf18ea-03fe-470a-ab28-e88b9c83492c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:05.813196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 867/1735] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:05 2022] PUT /identity/v3/projects/441b2e2ca74348538a905b4cf368aeb3/users/a2eb46710fb84be58bb7052cfa4b5915/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:05.821856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf18ea-03fe-470a-ab28-e88b9c83492c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:06.084002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20590bdc-ebe1-4950-b063-b12fbff987a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:06.087056 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20590bdc-ebe1-4950-b063-b12fbff987a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:06.087761 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20590bdc-ebe1-4950-b063-b12fbff987a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:06.089150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20590bdc-ebe1-4950-b063-b12fbff987a0 admin admin] PATH_INFO: `/v3/projects/d4d362db905c4c36ad0da6bf5fccd4a0/users/fe356332ec20495694a4890d0bebde50/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:06.174522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20590bdc-ebe1-4950-b063-b12fbff987a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d362db905c4c36ad0da6bf5fccd4a0, user_id=fe356332ec20495694a4890d0bebde50, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:06.184676 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20590bdc-ebe1-4950-b063-b12fbff987a0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:06.247063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 869/1736] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:05 2022] PUT /identity/v3/projects/d4d362db905c4c36ad0da6bf5fccd4a0/users/fe356332ec20495694a4890d0bebde50/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:06.251882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1bdc2-fb0a-41fb-b377-23e399bced08 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:06.274331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20590bdc-ebe1-4950-b063-b12fbff987a0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:06.279619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-20590bdc-ebe1-4950-b063-b12fbff987a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:06.313326 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1bdc2-fb0a-41fb-b377-23e399bced08 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:06.574520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:06.680576 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20590bdc-ebe1-4950-b063-b12fbff987a0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:06.698173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747fbc1-5da9-4168-aac2-1b46910944a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:06.706475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade64030-2d18-438e-a829-2d33d5674e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:06.707812 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade64030-2d18-438e-a829-2d33d5674e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:06.708704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade64030-2d18-438e-a829-2d33d5674e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:06.709150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade64030-2d18-438e-a829-2d33d5674e63 admin admin] PATH_INFO: `/v3/projects/ecdeb93fcf474f8f9229fe3694c5bb63` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:06.713737 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747fbc1-5da9-4168-aac2-1b46910944a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:06.714397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade64030-2d18-438e-a829-2d33d5674e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecdeb93fcf474f8f9229fe3694c5bb63)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:06.714513 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747fbc1-5da9-4168-aac2-1b46910944a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:06.716098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747fbc1-5da9-4168-aac2-1b46910944a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:06.719181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747fbc1-5da9-4168-aac2-1b46910944a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:06.720720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade64030-2d18-438e-a829-2d33d5674e63 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:06.744977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747fbc1-5da9-4168-aac2-1b46910944a3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:06.868647 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 868/1737] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 618 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:16:06.874079 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ade64030-2d18-438e-a829-2d33d5674e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecdeb93fcf474f8f9229fe3694c5bb63', 'request_id': 'req-ade64030-2d18-438e-a829-2d33d5674e63'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:06.874688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747fbc1-5da9-4168-aac2-1b46910944a3 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:06.897057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ade64030-2d18-438e-a829-2d33d5674e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecdeb93fcf474f8f9229fe3694c5bb63', 'request_id': 'req-ade64030-2d18-438e-a829-2d33d5674e63'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:06.944514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ade64030-2d18-438e-a829-2d33d5674e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecdeb93fcf474f8f9229fe3694c5bb63', 'request_id': 'req-ade64030-2d18-438e-a829-2d33d5674e63'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:06.946218 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747fbc1-5da9-4168-aac2-1b46910944a3 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:06.992483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ade64030-2d18-438e-a829-2d33d5674e63 admin admin] The token cache is being invalidate because project ecdeb93fcf474f8f9229fe3694c5bb63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:06.992785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ade64030-2d18-438e-a829-2d33d5674e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:06.993702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ade64030-2d18-438e-a829-2d33d5674e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:07.002158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 870/1738] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:06 2022] DELETE /identity/v3/projects/ecdeb93fcf474f8f9229fe3694c5bb63 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:16:07.004950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71506e9-5154-486e-bd6c-48988b2e42ac None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:07.005348 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71506e9-5154-486e-bd6c-48988b2e42ac None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:07.005647 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71506e9-5154-486e-bd6c-48988b2e42ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:07.069495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-e71506e9-5154-486e-bd6c-48988b2e42ac None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:07.070978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e71506e9-5154-486e-bd6c-48988b2e42ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:07.302799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 871/1739] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:07.307637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a7fb0-f29a-4884-bd68-fd2527fed08b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:07.309025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a7fb0-f29a-4884-bd68-fd2527fed08b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:07.309891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a7fb0-f29a-4884-bd68-fd2527fed08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:07.395773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b166f0-da7f-4ee8-b064-0d6104b610bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:07.413441 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-484a7fb0-f29a-4884-bd68-fd2527fed08b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:07.416083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-484a7fb0-f29a-4884-bd68-fd2527fed08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:07.417356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b166f0-da7f-4ee8-b064-0d6104b610bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:07.420871 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b166f0-da7f-4ee8-b064-0d6104b610bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:07.422804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b166f0-da7f-4ee8-b064-0d6104b610bd admin admin] PATH_INFO: `/v3/projects/d4d362db905c4c36ad0da6bf5fccd4a0/users/fe356332ec20495694a4890d0bebde50/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:07.443096 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b166f0-da7f-4ee8-b064-0d6104b610bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d362db905c4c36ad0da6bf5fccd4a0, user_id=fe356332ec20495694a4890d0bebde50, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:07.455931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 872/1740] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:07.458464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a7fb0-f29a-4884-bd68-fd2527fed08b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:07.460456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b166f0-da7f-4ee8-b064-0d6104b610bd admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:07.500480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a7fb0-f29a-4884-bd68-fd2527fed08b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:07.548960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 869/1741] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:06 2022] PUT /identity/v3/projects/d4d362db905c4c36ad0da6bf5fccd4a0/users/fe356332ec20495694a4890d0bebde50/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:16:07.564503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab07c7-6f92-4d12-85c4-7fcd987a0157 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:07.565449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab07c7-6f92-4d12-85c4-7fcd987a0157 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:07.566191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab07c7-6f92-4d12-85c4-7fcd987a0157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:07.690237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:07.733038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c01a5-b901-4218-9129-f4ab8fb01c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:07.733870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c01a5-b901-4218-9129-f4ab8fb01c6f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:07.744409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c01a5-b901-4218-9129-f4ab8fb01c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:07.744409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c01a5-b901-4218-9129-f4ab8fb01c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:07.746723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c01a5-b901-4218-9129-f4ab8fb01c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:16:07.746723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c01a5-b901-4218-9129-f4ab8fb01c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:07.759402 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c01a5-b901-4218-9129-f4ab8fb01c6f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:07.776484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d2ab07c7-6f92-4d12-85c4-7fcd987a0157 None None] MFA Rules not processed for user `fe356332ec20495694a4890d0bebde50`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:07.779544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d2ab07c7-6f92-4d12-85c4-7fcd987a0157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:07.822758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 873/1742] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:16:07.825323 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c01a5-b901-4218-9129-f4ab8fb01c6f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:07.857951 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:07.879482 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c01a5-b901-4218-9129-f4ab8fb01c6f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:07.893979 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfc6a9-e76e-4fb3-bb1f-b9333b7f2669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:07.894760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfc6a9-e76e-4fb3-bb1f-b9333b7f2669 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:07.895057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfc6a9-e76e-4fb3-bb1f-b9333b7f2669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:07.895342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfc6a9-e76e-4fb3-bb1f-b9333b7f2669 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:07.896083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfc6a9-e76e-4fb3-bb1f-b9333b7f2669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:07.898127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfc6a9-e76e-4fb3-bb1f-b9333b7f2669 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:07.976597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 874/1743] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:07 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:07.989306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4f23d-6956-4d7b-b891-a8d5d1475434 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:07.989596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4f23d-6956-4d7b-b891-a8d5d1475434 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:07.989928 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4f23d-6956-4d7b-b891-a8d5d1475434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:08.067241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-bba4f23d-6956-4d7b-b891-a8d5d1475434 None None] MFA Rules not processed for user `e255fb99a08c41289688042238d152ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:08.074064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bba4f23d-6956-4d7b-b891-a8d5d1475434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:08.261470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 875/1744] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:08.262757 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4f23d-6956-4d7b-b891-a8d5d1475434 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:08.302254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 870/1745] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 739 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:08.316591 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab07c7-6f92-4d12-85c4-7fcd987a0157 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:08.319912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d2ab07c7-6f92-4d12-85c4-7fcd987a0157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:08.427962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4f23d-6956-4d7b-b891-a8d5d1475434 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:08.442440 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee854c5e-0d1a-4420-9528-0667700d0fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:08.443468 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee854c5e-0d1a-4420-9528-0667700d0fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:08.443900 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee854c5e-0d1a-4420-9528-0667700d0fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:08.444184 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee854c5e-0d1a-4420-9528-0667700d0fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:08.444924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee854c5e-0d1a-4420-9528-0667700d0fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:08.449543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee854c5e-0d1a-4420-9528-0667700d0fc1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:08.528433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 876/1746] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:08 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:08.530016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee854c5e-0d1a-4420-9528-0667700d0fc1 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:08.598649 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee854c5e-0d1a-4420-9528-0667700d0fc1 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:08.606219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677fa2e-4e5c-45f5-96c7-e103698146f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:08.607282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677fa2e-4e5c-45f5-96c7-e103698146f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:08.607904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677fa2e-4e5c-45f5-96c7-e103698146f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:08.608377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677fa2e-4e5c-45f5-96c7-e103698146f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:08.609608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677fa2e-4e5c-45f5-96c7-e103698146f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:08.612101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677fa2e-4e5c-45f5-96c7-e103698146f7 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:08.635405 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 877/1747] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:08.647708 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677fa2e-4e5c-45f5-96c7-e103698146f7 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:08.691605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677fa2e-4e5c-45f5-96c7-e103698146f7 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:08.707246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8873d8-5855-434d-b0ad-fb69d1f3a8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:08.708104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8873d8-5855-434d-b0ad-fb69d1f3a8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:08.708497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8873d8-5855-434d-b0ad-fb69d1f3a8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:08.708775 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8873d8-5855-434d-b0ad-fb69d1f3a8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:08.711339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8873d8-5855-434d-b0ad-fb69d1f3a8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:08.712816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab07c7-6f92-4d12-85c4-7fcd987a0157 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:08.715183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8873d8-5855-434d-b0ad-fb69d1f3a8a6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:08.750568 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 878/1748] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:08.758566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8873d8-5855-434d-b0ad-fb69d1f3a8a6 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:08.788741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8873d8-5855-434d-b0ad-fb69d1f3a8a6 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:08.806105 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96febb51-18f1-47d4-82f5-2ab4cf2edfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:08.807719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96febb51-18f1-47d4-82f5-2ab4cf2edfe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:08.809675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96febb51-18f1-47d4-82f5-2ab4cf2edfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:08.810298 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96febb51-18f1-47d4-82f5-2ab4cf2edfe8 admin admin] PATH_INFO: `/v3/projects/0f654ba365bb46d5bd169943af20b2f0/users/0893b1508c92465587f2c0e97449dad2/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:08.857920 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96febb51-18f1-47d4-82f5-2ab4cf2edfe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f654ba365bb46d5bd169943af20b2f0, user_id=0893b1508c92465587f2c0e97449dad2, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:08.865215 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96febb51-18f1-47d4-82f5-2ab4cf2edfe8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:08.886065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee7475-c298-4384-91fb-8caad6282c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:08.889095 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee7475-c298-4384-91fb-8caad6282c8e service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:08.890467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee7475-c298-4384-91fb-8caad6282c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:08.891256 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee7475-c298-4384-91fb-8caad6282c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:08.913326 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 879/1749] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:08 2022] PUT /identity/v3/projects/0f654ba365bb46d5bd169943af20b2f0/users/0893b1508c92465587f2c0e97449dad2/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:08.938155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ee431-bcc2-49b3-bb12-793ae28c0408 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:08.938417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ee431-bcc2-49b3-bb12-793ae28c0408 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:08.941415 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ee431-bcc2-49b3-bb12-793ae28c0408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:09.015428 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-e61ee431-bcc2-49b3-bb12-793ae28c0408 None None] MFA Rules not processed for user `0893b1508c92465587f2c0e97449dad2`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:09.017130 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e61ee431-bcc2-49b3-bb12-793ae28c0408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:09.026328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:09.131653 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee7475-c298-4384-91fb-8caad6282c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:09.134899 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee7475-c298-4384-91fb-8caad6282c8e service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:09.178282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 871/1750] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 862 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:09.366396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 880/1751] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:09.367874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee7475-c298-4384-91fb-8caad6282c8e service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:09.401065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee7475-c298-4384-91fb-8caad6282c8e service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:09.443227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:09.511690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ee431-bcc2-49b3-bb12-793ae28c0408 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:09.750464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11831ed9-fad3-4dd4-acd8-fd4d45478837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:09.751429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11831ed9-fad3-4dd4-acd8-fd4d45478837 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:09.751795 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11831ed9-fad3-4dd4-acd8-fd4d45478837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:09.752178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11831ed9-fad3-4dd4-acd8-fd4d45478837 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:09.753012 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11831ed9-fad3-4dd4-acd8-fd4d45478837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:09.755200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11831ed9-fad3-4dd4-acd8-fd4d45478837 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:09.791251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ee431-bcc2-49b3-bb12-793ae28c0408 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:09.809420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb82f5-e8d0-4335-8508-ffba514acd83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:09.810242 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb82f5-e8d0-4335-8508-ffba514acd83 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:09.810591 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb82f5-e8d0-4335-8508-ffba514acd83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:09.810974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb82f5-e8d0-4335-8508-ffba514acd83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:09.824835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-45cb82f5-e8d0-4335-8508-ffba514acd83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:09.879037 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 872/1752] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:09 2022] POST /identity/v3/projects => generated 387 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:09.880404 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11831ed9-fad3-4dd4-acd8-fd4d45478837 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:10.102306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb82f5-e8d0-4335-8508-ffba514acd83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:10.105108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb82f5-e8d0-4335-8508-ffba514acd83 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:10.133131 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 881/1753] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:16:10.175527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11831ed9-fad3-4dd4-acd8-fd4d45478837 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:10.187532 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707d9d4-8ea2-420d-8590-be525550ff94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:10.188758 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707d9d4-8ea2-420d-8590-be525550ff94 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:10.189072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707d9d4-8ea2-420d-8590-be525550ff94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:10.189373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707d9d4-8ea2-420d-8590-be525550ff94 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:10.190190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707d9d4-8ea2-420d-8590-be525550ff94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:10.192396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707d9d4-8ea2-420d-8590-be525550ff94 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:10.278065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 873/1754] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:09 2022] POST /identity/v3/users => generated 294 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:10.282581 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb82f5-e8d0-4335-8508-ffba514acd83 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:10.301157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb82f5-e8d0-4335-8508-ffba514acd83 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:10.309406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb67800-d87c-4a36-9398-ad73df7fac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:10.310248 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb67800-d87c-4a36-9398-ad73df7fac32 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:10.310674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb67800-d87c-4a36-9398-ad73df7fac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:10.311070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb67800-d87c-4a36-9398-ad73df7fac32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:10.312071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb67800-d87c-4a36-9398-ad73df7fac32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:10.315918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb67800-d87c-4a36-9398-ad73df7fac32 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:10.350605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 882/1755] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:16:10.360627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707d9d4-8ea2-420d-8590-be525550ff94 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:10.388543 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707d9d4-8ea2-420d-8590-be525550ff94 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:10.419712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ad7d1-c222-4c1d-b271-78d59aeb1692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:10.427131 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ad7d1-c222-4c1d-b271-78d59aeb1692 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:10.427467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ad7d1-c222-4c1d-b271-78d59aeb1692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:10.427764 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ad7d1-c222-4c1d-b271-78d59aeb1692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:10.435520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ad7d1-c222-4c1d-b271-78d59aeb1692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:10.442558 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ad7d1-c222-4c1d-b271-78d59aeb1692 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:10.495991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb67800-d87c-4a36-9398-ad73df7fac32 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:10.499025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 874/1756] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:10.522808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb67800-d87c-4a36-9398-ad73df7fac32 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:10.545532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e53dc-dc00-48d2-8492-218fb1764f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:10.546521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e53dc-dc00-48d2-8492-218fb1764f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:10.551118 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e53dc-dc00-48d2-8492-218fb1764f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:10.551492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e53dc-dc00-48d2-8492-218fb1764f0b admin admin] PATH_INFO: `/v3/projects/717005a55a3a4580b906fb59053ec386/users/fa6f796dde1f4b53ba9a027610beaa85/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:10.613883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e53dc-dc00-48d2-8492-218fb1764f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=717005a55a3a4580b906fb59053ec386, user_id=fa6f796dde1f4b53ba9a027610beaa85, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:10.620969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e53dc-dc00-48d2-8492-218fb1764f0b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:10.675381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 883/1757] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:10 2022] PUT /identity/v3/projects/717005a55a3a4580b906fb59053ec386/users/fa6f796dde1f4b53ba9a027610beaa85/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:10.694383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39f39-52d4-44e4-9f3f-bf656a042df1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:10.694700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39f39-52d4-44e4-9f3f-bf656a042df1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:10.695011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39f39-52d4-44e4-9f3f-bf656a042df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:10.768622 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-99c39f39-52d4-44e4-9f3f-bf656a042df1 None None] MFA Rules not processed for user `fa6f796dde1f4b53ba9a027610beaa85`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:10.769330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-99c39f39-52d4-44e4-9f3f-bf656a042df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:11.178669 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 875/1758] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:11.178977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e53dc-dc00-48d2-8492-218fb1764f0b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:11.287569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:11.397371 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e53dc-dc00-48d2-8492-218fb1764f0b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:11.423962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4803c7-f582-417a-97f4-d41611b49c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:11.425128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4803c7-f582-417a-97f4-d41611b49c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:11.425623 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4803c7-f582-417a-97f4-d41611b49c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:11.430916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4803c7-f582-417a-97f4-d41611b49c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:11.440794 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4803c7-f582-417a-97f4-d41611b49c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:11.480018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4803c7-f582-417a-97f4-d41611b49c02 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:11.676721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 884/1759] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:11 2022] POST /identity/v3/projects => generated 385 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:11.681540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c39f39-52d4-44e4-9f3f-bf656a042df1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:11.727003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c39f39-52d4-44e4-9f3f-bf656a042df1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:11.751710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:11.760780 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37668bf7-3a01-41d0-9ce1-7e8b9fb7f088 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:11.761726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37668bf7-3a01-41d0-9ce1-7e8b9fb7f088 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:11.762087 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37668bf7-3a01-41d0-9ce1-7e8b9fb7f088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:11.991615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-37668bf7-3a01-41d0-9ce1-7e8b9fb7f088 None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:11.992997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-37668bf7-3a01-41d0-9ce1-7e8b9fb7f088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:12.036968 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e118aac-3a96-4b9c-8d5b-1fb549098b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:12.043960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e118aac-3a96-4b9c-8d5b-1fb549098b6f admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:12.044249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e118aac-3a96-4b9c-8d5b-1fb549098b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:12.044531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e118aac-3a96-4b9c-8d5b-1fb549098b6f admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:12.045311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e118aac-3a96-4b9c-8d5b-1fb549098b6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:12.049265 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e118aac-3a96-4b9c-8d5b-1fb549098b6f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:12.128561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 876/1760] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:11 2022] POST /identity/v3/users => generated 299 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:12.134707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e118aac-3a96-4b9c-8d5b-1fb549098b6f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:12.175489 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e118aac-3a96-4b9c-8d5b-1fb549098b6f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:12.196422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5057c-bc6b-4d7e-8edf-9464ff8e7fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:12.197238 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5057c-bc6b-4d7e-8edf-9464ff8e7fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:12.197617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5057c-bc6b-4d7e-8edf-9464ff8e7fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:12.197893 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5057c-bc6b-4d7e-8edf-9464ff8e7fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:12.204532 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5057c-bc6b-4d7e-8edf-9464ff8e7fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:12.210255 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5057c-bc6b-4d7e-8edf-9464ff8e7fe5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:12.259869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 877/1761] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:12.262855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5057c-bc6b-4d7e-8edf-9464ff8e7fe5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:12.290508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 885/1762] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:16:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 531 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:12.301358 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5057c-bc6b-4d7e-8edf-9464ff8e7fe5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:12.328867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87102d0-f4ba-423c-8ad8-b3743da6af03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:12.328867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87102d0-f4ba-423c-8ad8-b3743da6af03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:12.328867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87102d0-f4ba-423c-8ad8-b3743da6af03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:12.328867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87102d0-f4ba-423c-8ad8-b3743da6af03 admin admin] PATH_INFO: `/v3/projects/662691dfcc2f4951bc7e7dfb67ac76ca/users/c60f614e870f406dab77d40cefaee03b/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:12.367421 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87102d0-f4ba-423c-8ad8-b3743da6af03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662691dfcc2f4951bc7e7dfb67ac76ca, user_id=c60f614e870f406dab77d40cefaee03b, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:12.370568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87102d0-f4ba-423c-8ad8-b3743da6af03 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:12.405755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 878/1763] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:12 2022] PUT /identity/v3/projects/662691dfcc2f4951bc7e7dfb67ac76ca/users/c60f614e870f406dab77d40cefaee03b/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:12.410863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37668bf7-3a01-41d0-9ce1-7e8b9fb7f088 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:12.438545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37668bf7-3a01-41d0-9ce1-7e8b9fb7f088 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:12.598101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87102d0-f4ba-423c-8ad8-b3743da6af03 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:12.601028 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c87102d0-f4ba-423c-8ad8-b3743da6af03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:12.771897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e1f25-f46a-45de-89c9-b160aa69a2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:12.773334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e1f25-f46a-45de-89c9-b160aa69a2bb admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:12.774723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e1f25-f46a-45de-89c9-b160aa69a2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:12.774723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e1f25-f46a-45de-89c9-b160aa69a2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:12.780303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e1f25-f46a-45de-89c9-b160aa69a2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:12.786823 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e1f25-f46a-45de-89c9-b160aa69a2bb admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:12.847895 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 886/1764] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:16:12.855856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e1f25-f46a-45de-89c9-b160aa69a2bb admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:12.866340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87102d0-f4ba-423c-8ad8-b3743da6af03 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:12.888610 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da39b4-dd84-4da8-bd21-cb91c2a1bfd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:12.888846 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e1f25-f46a-45de-89c9-b160aa69a2bb admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:12.889461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da39b4-dd84-4da8-bd21-cb91c2a1bfd9 service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:12.889809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da39b4-dd84-4da8-bd21-cb91c2a1bfd9 service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:12.890190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da39b4-dd84-4da8-bd21-cb91c2a1bfd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:12.905480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1c285-c067-48dc-b715-18e57081d37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:12.907096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1c285-c067-48dc-b715-18e57081d37d admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:12.907539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1c285-c067-48dc-b715-18e57081d37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:12.907998 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1c285-c067-48dc-b715-18e57081d37d admin admin] PATH_INFO: `/v3/projects/662691dfcc2f4951bc7e7dfb67ac76ca/users/c60f614e870f406dab77d40cefaee03b/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:12.911846 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1c285-c067-48dc-b715-18e57081d37d admin admin] RBAC: Authorizing `identity:create_grant(project_id=662691dfcc2f4951bc7e7dfb67ac76ca, user_id=c60f614e870f406dab77d40cefaee03b, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:12.917456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1c285-c067-48dc-b715-18e57081d37d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:12.948447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 887/1765] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:12 2022] PUT /identity/v3/projects/662691dfcc2f4951bc7e7dfb67ac76ca/users/c60f614e870f406dab77d40cefaee03b/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:12.951573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb564a-eb33-47a5-82a2-1512acce1770 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:12.952316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb564a-eb33-47a5-82a2-1512acce1770 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:12.952781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb564a-eb33-47a5-82a2-1512acce1770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:12.988381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:13.085773 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c6eb564a-eb33-47a5-82a2-1512acce1770 None None] MFA Rules not processed for user `c60f614e870f406dab77d40cefaee03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:13.088146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c6eb564a-eb33-47a5-82a2-1512acce1770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:13.111263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:13.163857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da39b4-dd84-4da8-bd21-cb91c2a1bfd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:13.165270 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da39b4-dd84-4da8-bd21-cb91c2a1bfd9 service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:13.197498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 879/1766] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:16:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:16:13.244120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 888/1767] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:13.261932 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da39b4-dd84-4da8-bd21-cb91c2a1bfd9 service swift] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:13.461263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da39b4-dd84-4da8-bd21-cb91c2a1bfd9 service swift] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:13.697249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd0a4a-311c-4cc0-a49f-f1fb9740e4f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:13.698148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd0a4a-311c-4cc0-a49f-f1fb9740e4f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:13.698647 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd0a4a-311c-4cc0-a49f-f1fb9740e4f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:13.699123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd0a4a-311c-4cc0-a49f-f1fb9740e4f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:13.752045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd0a4a-311c-4cc0-a49f-f1fb9740e4f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:13.756470 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd0a4a-311c-4cc0-a49f-f1fb9740e4f2 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:13.820702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 880/1768] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:16.520829 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb564a-eb33-47a5-82a2-1512acce1770 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:16.545854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb564a-eb33-47a5-82a2-1512acce1770 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:16.567532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bf442-ce11-4208-990a-251f2918823d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:16.570483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bf442-ce11-4208-990a-251f2918823d service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:16.572034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bf442-ce11-4208-990a-251f2918823d service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:16.573224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bf442-ce11-4208-990a-251f2918823d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:16.991186 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bf442-ce11-4208-990a-251f2918823d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:17.000539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bf442-ce11-4208-990a-251f2918823d service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:17.068842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 889/1769] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:18.002896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb211b-0c08-4184-9610-38f1a4d7afcf None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:18.004651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb211b-0c08-4184-9610-38f1a4d7afcf None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:18.005613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb211b-0c08-4184-9610-38f1a4d7afcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:18.103029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-04fb211b-0c08-4184-9610-38f1a4d7afcf None None] MFA Rules not processed for user `88cfd88c19fd4c979e921e3d8cd9cc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:18.111529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-04fb211b-0c08-4184-9610-38f1a4d7afcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:18.437017 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 881/1770] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Jul 21 12:16:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:18.509330 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bf442-ce11-4208-990a-251f2918823d service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:18.514362 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9c2bf442-ce11-4208-990a-251f2918823d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:18.596492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bf442-ce11-4208-990a-251f2918823d service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:18.617010 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d35900-514c-43c7-8715-c82d59a58289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:18.624344 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d35900-514c-43c7-8715-c82d59a58289 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:18.627939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d35900-514c-43c7-8715-c82d59a58289 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:18.630479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d35900-514c-43c7-8715-c82d59a58289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:18.685956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d35900-514c-43c7-8715-c82d59a58289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:18.690640 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d35900-514c-43c7-8715-c82d59a58289 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:18.752087 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 890/1771] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:19.648113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faa475-805a-4d96-b483-cd0675da2e33 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:19.649665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faa475-805a-4d96-b483-cd0675da2e33 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:19.650210 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faa475-805a-4d96-b483-cd0675da2e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:19.752651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-99faa475-805a-4d96-b483-cd0675da2e33 None None] MFA Rules not processed for user `a2eb46710fb84be58bb7052cfa4b5915`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:19.757649 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-99faa475-805a-4d96-b483-cd0675da2e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:19.820059 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce97c6-c356-4b95-a1f3-5c20e3b38dc1 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:19.821171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce97c6-c356-4b95-a1f3-5c20e3b38dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:19.821689 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce97c6-c356-4b95-a1f3-5c20e3b38dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:19.908566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-52ce97c6-c356-4b95-a1f3-5c20e3b38dc1 None None] MFA Rules not processed for user `d9a96b51c98344a09cc59af05dd455ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:19.909888 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-52ce97c6-c356-4b95-a1f3-5c20e3b38dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:19.943042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:20.061427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 882/1772] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:19 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:16:20.066303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faa475-805a-4d96-b483-cd0675da2e33 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:20.076685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-99faa475-805a-4d96-b483-cd0675da2e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:20.212057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 891/1773] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:20.420822 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faa475-805a-4d96-b483-cd0675da2e33 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:20.481162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d92b17-0af0-46c8-813c-c6293dc07ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:20.483159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d92b17-0af0-46c8-813c-c6293dc07ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:20.483670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d92b17-0af0-46c8-813c-c6293dc07ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:20.484168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d92b17-0af0-46c8-813c-c6293dc07ed3 admin admin] PATH_INFO: `/v3/users/4f395b7111284275a4c29fcb090e61c6` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:20.494561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d92b17-0af0-46c8-813c-c6293dc07ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f395b7111284275a4c29fcb090e61c6)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:20.508223 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d92b17-0af0-46c8-813c-c6293dc07ed3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:20.690047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-12d92b17-0af0-46c8-813c-c6293dc07ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f395b7111284275a4c29fcb090e61c6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:20.691700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-12d92b17-0af0-46c8-813c-c6293dc07ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f395b7111284275a4c29fcb090e61c6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:20.758942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-12d92b17-0af0-46c8-813c-c6293dc07ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f395b7111284275a4c29fcb090e61c6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:20.797877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-12d92b17-0af0-46c8-813c-c6293dc07ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f395b7111284275a4c29fcb090e61c6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:20.803616 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-12d92b17-0af0-46c8-813c-c6293dc07ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f395b7111284275a4c29fcb090e61c6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:20.860242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 883/1774] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:20 2022] DELETE /identity/v3/users/4f395b7111284275a4c29fcb090e61c6 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:20.874155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff71c9-fe5f-40b9-995c-a045b4914bcb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:20.874155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff71c9-fe5f-40b9-995c-a045b4914bcb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:20.874155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff71c9-fe5f-40b9-995c-a045b4914bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:20.936532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-21ff71c9-fe5f-40b9-995c-a045b4914bcb None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:20.938355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-21ff71c9-fe5f-40b9-995c-a045b4914bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:20.969306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:21.148487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 892/1775] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:21.237830 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d92b17-0af0-46c8-813c-c6293dc07ed3 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:21.240359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-12d92b17-0af0-46c8-813c-c6293dc07ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:21.497950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d92b17-0af0-46c8-813c-c6293dc07ed3 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:21.509104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d3ccd-c4df-4b53-ac2a-fc9048715de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:21.509995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d3ccd-c4df-4b53-ac2a-fc9048715de6 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:21.510465 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d3ccd-c4df-4b53-ac2a-fc9048715de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:21.511138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d3ccd-c4df-4b53-ac2a-fc9048715de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:21.552661 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d3ccd-c4df-4b53-ac2a-fc9048715de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:21.555023 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d3ccd-c4df-4b53-ac2a-fc9048715de6 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:21.582323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:21.608673 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 884/1776] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:22.820108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a42561-335a-4724-bafe-7b147a021c22 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:22.821176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a42561-335a-4724-bafe-7b147a021c22 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:22.821914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a42561-335a-4724-bafe-7b147a021c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:22.850941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-92a42561-335a-4724-bafe-7b147a021c22 None None] MFA Rules not processed for user `2b092b666ad84405a6ed07827fcd8a87`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:22.854765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-92a42561-335a-4724-bafe-7b147a021c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:23.049663 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 893/1777] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:23.815602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d3ccd-c4df-4b53-ac2a-fc9048715de6 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:23.817367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0c5d3ccd-c4df-4b53-ac2a-fc9048715de6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:23.969607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d3ccd-c4df-4b53-ac2a-fc9048715de6 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:23.974407 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6f8de-9c2b-46a0-9145-1b2dca9c65f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:23.975201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6f8de-9c2b-46a0-9145-1b2dca9c65f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:23.975426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6f8de-9c2b-46a0-9145-1b2dca9c65f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:23.975922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6f8de-9c2b-46a0-9145-1b2dca9c65f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:23.978424 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-43d6f8de-9c2b-46a0-9145-1b2dca9c65f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:24.157065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6f8de-9c2b-46a0-9145-1b2dca9c65f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:24.164221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6f8de-9c2b-46a0-9145-1b2dca9c65f8 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:24.208593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 885/1778] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:26.271131 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f715e3-7c4d-4e7f-9c22-bd4381142a00 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:26.275331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f715e3-7c4d-4e7f-9c22-bd4381142a00 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:26.276361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f715e3-7c4d-4e7f-9c22-bd4381142a00 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:26.281072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 894/1779] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jul 21 12:16:26 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:16:26.389458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a6516-f36f-4a7e-ab52-453079f44320 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:26.391226 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a6516-f36f-4a7e-ab52-453079f44320 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:26.392180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a6516-f36f-4a7e-ab52-453079f44320 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:26.399293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 886/1780] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jul 21 12:16:26 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:16:26.500231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226961-656e-4180-a040-4ae07a6b977f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:26.502014 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226961-656e-4180-a040-4ae07a6b977f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:26.503072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226961-656e-4180-a040-4ae07a6b977f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:26.578632 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b0226961-656e-4180-a040-4ae07a6b977f None None] MFA Rules not processed for user `f3fb1d091b27472081549f4166ca172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:26.580556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b0226961-656e-4180-a040-4ae07a6b977f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:26.727305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d441f-9bce-4524-842d-db5ed480dea1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:26.727783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d441f-9bce-4524-842d-db5ed480dea1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:26.728168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d441f-9bce-4524-842d-db5ed480dea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:26.841452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-445d441f-9bce-4524-842d-db5ed480dea1 None None] MFA Rules not processed for user `f3fb1d091b27472081549f4166ca172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:26.845008 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-445d441f-9bce-4524-842d-db5ed480dea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:26.872757 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 895/1781] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jul 21 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:27.075151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 887/1782] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jul 21 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:27.629291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0226961-656e-4180-a040-4ae07a6b977f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:27.631187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b0226961-656e-4180-a040-4ae07a6b977f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:27.654530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0226961-656e-4180-a040-4ae07a6b977f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:27.668951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:27.669818 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:27.670106 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:27.670511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] PATH_INFO: `/v3/projects/3dba2b57501349079f9ec77b4e0edfbd` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:27.675659 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dba2b57501349079f9ec77b4e0edfbd)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:27.679646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:27.935651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dba2b57501349079f9ec77b4e0edfbd', 'request_id': 'req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:27.957709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:27.981930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dba2b57501349079f9ec77b4e0edfbd', 'request_id': 'req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:28.047898 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dba2b57501349079f9ec77b4e0edfbd', 'request_id': 'req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:28.107585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] The token cache is being invalidate because project 3dba2b57501349079f9ec77b4e0edfbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:28.108188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:28.110829 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:28.112962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 896/1783] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:27 2022] DELETE /identity/v3/projects/3dba2b57501349079f9ec77b4e0edfbd => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:16:28.119732 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d441f-9bce-4524-842d-db5ed480dea1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:28.216844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d441f-9bce-4524-842d-db5ed480dea1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:28.335485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:28.342799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:28.403746 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:28.427733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221143c-9b0e-49ae-9aa5-abc56d180e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:28.429461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221143c-9b0e-49ae-9aa5-abc56d180e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:28.429844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221143c-9b0e-49ae-9aa5-abc56d180e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:28.430176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221143c-9b0e-49ae-9aa5-abc56d180e0f admin admin] PATH_INFO: `/v3/users/fe356332ec20495694a4890d0bebde50` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:28.432417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221143c-9b0e-49ae-9aa5-abc56d180e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe356332ec20495694a4890d0bebde50)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:28.434125 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221143c-9b0e-49ae-9aa5-abc56d180e0f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:28.538634 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9221143c-9b0e-49ae-9aa5-abc56d180e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe356332ec20495694a4890d0bebde50'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:28.540167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9221143c-9b0e-49ae-9aa5-abc56d180e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe356332ec20495694a4890d0bebde50'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:28.553797 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41503d-def9-4b1e-bbbf-5a7caf2b6c70 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:28.560511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee85b5-4fc8-48df-8a14-d2c29f4d31d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:28.561757 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee85b5-4fc8-48df-8a14-d2c29f4d31d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:28.562218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee85b5-4fc8-48df-8a14-d2c29f4d31d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:28.562636 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee85b5-4fc8-48df-8a14-d2c29f4d31d6 admin admin] PATH_INFO: `/v3/users/0893b1508c92465587f2c0e97449dad2` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:28.564325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee85b5-4fc8-48df-8a14-d2c29f4d31d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0893b1508c92465587f2c0e97449dad2)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:28.567323 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee85b5-4fc8-48df-8a14-d2c29f4d31d6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:28.576105 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9221143c-9b0e-49ae-9aa5-abc56d180e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe356332ec20495694a4890d0bebde50'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:28.597842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9221143c-9b0e-49ae-9aa5-abc56d180e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe356332ec20495694a4890d0bebde50'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:28.600878 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9221143c-9b0e-49ae-9aa5-abc56d180e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe356332ec20495694a4890d0bebde50'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:28.628302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 888/1784] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:28 2022] DELETE /identity/v3/users/fe356332ec20495694a4890d0bebde50 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:16:28.629824 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eb64b-8241-4684-b5ed-95c016760396 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:28.630239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eb64b-8241-4684-b5ed-95c016760396 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:28.630559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eb64b-8241-4684-b5ed-95c016760396 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:28.638988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 889/1785] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jul 21 12:16:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:16:28.651114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1cee85b5-4fc8-48df-8a14-d2c29f4d31d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0893b1508c92465587f2c0e97449dad2'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:28.666116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee269-3315-4980-9909-c537157de91f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:28.666116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee269-3315-4980-9909-c537157de91f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:28.666274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee269-3315-4980-9909-c537157de91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:28.670822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1cee85b5-4fc8-48df-8a14-d2c29f4d31d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0893b1508c92465587f2c0e97449dad2'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:28.671918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1cee85b5-4fc8-48df-8a14-d2c29f4d31d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0893b1508c92465587f2c0e97449dad2'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:28.699177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1cee85b5-4fc8-48df-8a14-d2c29f4d31d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0893b1508c92465587f2c0e97449dad2'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:28.699969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1cee85b5-4fc8-48df-8a14-d2c29f4d31d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0893b1508c92465587f2c0e97449dad2'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:28.701705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8caee269-3315-4980-9909-c537157de91f None None] MFA Rules not processed for user `06c172bcd99f469f83728c98d061a7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:28.705964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8caee269-3315-4980-9909-c537157de91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:28.727834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 897/1786] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:28 2022] DELETE /identity/v3/users/0893b1508c92465587f2c0e97449dad2 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:16:28.731424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc27f1-d240-4a63-977d-4e2520362736 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:28.731960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc27f1-d240-4a63-977d-4e2520362736 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:28.732976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc27f1-d240-4a63-977d-4e2520362736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:28.767777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d5fc27f1-d240-4a63-977d-4e2520362736 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:28.771342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d5fc27f1-d240-4a63-977d-4e2520362736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:28.873745 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:28.897344 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 898/1787] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:28.927789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 890/1788] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jul 21 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:16:28.929618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc27f1-d240-4a63-977d-4e2520362736 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:28.931103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d5fc27f1-d240-4a63-977d-4e2520362736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:28.987606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caee269-3315-4980-9909-c537157de91f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:28.991254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8caee269-3315-4980-9909-c537157de91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:29.002637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc27f1-d240-4a63-977d-4e2520362736 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:29.008261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8edf31-fcd6-4e5f-afd8-baf15aef811c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:29.009065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8edf31-fcd6-4e5f-afd8-baf15aef811c service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:29.009428 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8edf31-fcd6-4e5f-afd8-baf15aef811c service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:29.009768 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8edf31-fcd6-4e5f-afd8-baf15aef811c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:29.022081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8edf31-fcd6-4e5f-afd8-baf15aef811c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:29.023542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8edf31-fcd6-4e5f-afd8-baf15aef811c service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:29.026786 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caee269-3315-4980-9909-c537157de91f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:29.043293 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 899/1789] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:29.220619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:29.270705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4fb52-a24e-452b-8225-924e66fa0c0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06c172bcd99f469f83728c98d061a7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:29.272728 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4fb52-a24e-452b-8225-924e66fa0c0b service placement] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:29.273706 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4fb52-a24e-452b-8225-924e66fa0c0b service placement] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:29.273706 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4fb52-a24e-452b-8225-924e66fa0c0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:29.286575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4fb52-a24e-452b-8225-924e66fa0c0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:29.288575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4fb52-a24e-452b-8225-924e66fa0c0b service placement] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:29.315687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 891/1790] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:16:29.777408 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8edf31-fcd6-4e5f-afd8-baf15aef811c service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:29.778904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7b8edf31-fcd6-4e5f-afd8-baf15aef811c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:29.871351 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8edf31-fcd6-4e5f-afd8-baf15aef811c service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:29.884478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32998000-2988-47ba-aa6f-0afe80f23d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:29.886702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32998000-2988-47ba-aa6f-0afe80f23d03 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:29.887433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32998000-2988-47ba-aa6f-0afe80f23d03 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:29.887731 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32998000-2988-47ba-aa6f-0afe80f23d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:29.890979 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-32998000-2988-47ba-aa6f-0afe80f23d03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:29.908344 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32998000-2988-47ba-aa6f-0afe80f23d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:29.912335 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32998000-2988-47ba-aa6f-0afe80f23d03 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:29.923949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 900/1791] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:30.008766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4fb52-a24e-452b-8225-924e66fa0c0b service placement] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:30.010801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32998000-2988-47ba-aa6f-0afe80f23d03 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:30.012407 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5ad4fb52-a24e-452b-8225-924e66fa0c0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:30.044494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32998000-2988-47ba-aa6f-0afe80f23d03 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:30.051807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a4337-6ea8-4993-82ef-0b3333e9a751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:30.053183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a4337-6ea8-4993-82ef-0b3333e9a751 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:30.053482 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a4337-6ea8-4993-82ef-0b3333e9a751 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:30.053769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a4337-6ea8-4993-82ef-0b3333e9a751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:30.056293 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-658a4337-6ea8-4993-82ef-0b3333e9a751 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:30.072000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a4337-6ea8-4993-82ef-0b3333e9a751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:30.073176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4fb52-a24e-452b-8225-924e66fa0c0b service placement] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:30.075915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a4337-6ea8-4993-82ef-0b3333e9a751 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:30.099368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 901/1792] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:16:30.105668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396b753-ab58-40ab-bb1a-88be819b6326 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:30.108924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396b753-ab58-40ab-bb1a-88be819b6326 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:30.108924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396b753-ab58-40ab-bb1a-88be819b6326 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:30.109373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:30.109596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:30.109694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 902/1793] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jul 21 12:16:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 12:16:30.112231 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:30.112727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] PATH_INFO: `/v3/projects/d4d362db905c4c36ad0da6bf5fccd4a0` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:30.121260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09e727-918e-4d6a-af42-44a28cc40923 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:30.121966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09e727-918e-4d6a-af42-44a28cc40923 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:30.122303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09e727-918e-4d6a-af42-44a28cc40923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:30.132761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d362db905c4c36ad0da6bf5fccd4a0)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:30.143713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:30.158128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ea09e727-918e-4d6a-af42-44a28cc40923 None None] MFA Rules not processed for user `06c172bcd99f469f83728c98d061a7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:30.159511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ea09e727-918e-4d6a-af42-44a28cc40923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:30.184191 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 903/1794] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jul 21 12:16:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:16:30.211576 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09e727-918e-4d6a-af42-44a28cc40923 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:30.214225 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ea09e727-918e-4d6a-af42-44a28cc40923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:30.238121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09e727-918e-4d6a-af42-44a28cc40923 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:30.248755 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9004c2-22b5-43d0-a632-a5335b242072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:30.250091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9004c2-22b5-43d0-a632-a5335b242072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:30.250812 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9004c2-22b5-43d0-a632-a5335b242072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:30.251002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9004c2-22b5-43d0-a632-a5335b242072 admin admin] PATH_INFO: `/v3/users/a04163554a9241b48798b69d9174e672` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:30.252694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9004c2-22b5-43d0-a632-a5335b242072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04163554a9241b48798b69d9174e672)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:30.255075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9004c2-22b5-43d0-a632-a5335b242072 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:30.298157 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d362db905c4c36ad0da6bf5fccd4a0', 'request_id': 'req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.311138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d362db905c4c36ad0da6bf5fccd4a0', 'request_id': 'req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.319419 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d362db905c4c36ad0da6bf5fccd4a0', 'request_id': 'req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.338926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] The token cache is being invalidate because project d4d362db905c4c36ad0da6bf5fccd4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:30.339255 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.339913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.349619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 892/1795] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:29 2022] DELETE /identity/v3/projects/d4d362db905c4c36ad0da6bf5fccd4a0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:30.349619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:30.349619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:30.405403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9b9004c2-22b5-43d0-a632-a5335b242072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04163554a9241b48798b69d9174e672'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.426768 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9b9004c2-22b5-43d0-a632-a5335b242072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04163554a9241b48798b69d9174e672'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.427560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9b9004c2-22b5-43d0-a632-a5335b242072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04163554a9241b48798b69d9174e672'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.436816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:30.455767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9b9004c2-22b5-43d0-a632-a5335b242072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04163554a9241b48798b69d9174e672'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.457146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9b9004c2-22b5-43d0-a632-a5335b242072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04163554a9241b48798b69d9174e672'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.479272 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 904/1796] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:30 2022] DELETE /identity/v3/users/a04163554a9241b48798b69d9174e672 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:30.481005 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc41c7d-9df1-40f0-b81e-4e0063da116d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:30.481461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc41c7d-9df1-40f0-b81e-4e0063da116d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:30.481911 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc41c7d-9df1-40f0-b81e-4e0063da116d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:30.514215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd5a9d-11d0-4b8a-943a-a9d5632a9297 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:30.516150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7bc41c7d-9df1-40f0-b81e-4e0063da116d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:30.517502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7bc41c7d-9df1-40f0-b81e-4e0063da116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:30.644753 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 905/1797] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:30.645703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc41c7d-9df1-40f0-b81e-4e0063da116d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:30.649729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7bc41c7d-9df1-40f0-b81e-4e0063da116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:30.678767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cba784-ecd6-4498-a7c7-8bd1185cf5bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06c172bcd99f469f83728c98d061a7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:30.680306 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cba784-ecd6-4498-a7c7-8bd1185cf5bc service placement] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:30.680596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cba784-ecd6-4498-a7c7-8bd1185cf5bc service placement] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:30.680914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cba784-ecd6-4498-a7c7-8bd1185cf5bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:30.683804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-40cba784-ecd6-4498-a7c7-8bd1185cf5bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:30.684720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc41c7d-9df1-40f0-b81e-4e0063da116d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:30.708643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:30.710470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:30.710821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:30.711106 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] PATH_INFO: `/v3/projects/0f654ba365bb46d5bd169943af20b2f0` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:30.716731 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f654ba365bb46d5bd169943af20b2f0)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:30.719436 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:30.735666 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cba784-ecd6-4498-a7c7-8bd1185cf5bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:30.740141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cba784-ecd6-4498-a7c7-8bd1185cf5bc service placement] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:30.779466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 893/1798] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:30.786282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18518c4-70ca-4276-9db6-f34002b4f4e1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:30.791409 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18518c4-70ca-4276-9db6-f34002b4f4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:30.792999 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18518c4-70ca-4276-9db6-f34002b4f4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:30.821242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:30.871022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a18518c4-70ca-4276-9db6-f34002b4f4e1 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:30.873206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a18518c4-70ca-4276-9db6-f34002b4f4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:30.898887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f654ba365bb46d5bd169943af20b2f0', 'request_id': 'req-6d197a2a-579f-4858-875c-0b015c0ed98d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.910335 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f654ba365bb46d5bd169943af20b2f0', 'request_id': 'req-6d197a2a-579f-4858-875c-0b015c0ed98d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.920793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f654ba365bb46d5bd169943af20b2f0', 'request_id': 'req-6d197a2a-579f-4858-875c-0b015c0ed98d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.941847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] The token cache is being invalidate because project 0f654ba365bb46d5bd169943af20b2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:30.942138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.943251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:30.948130 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 906/1799] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:30 2022] DELETE /identity/v3/projects/0f654ba365bb46d5bd169943af20b2f0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:30.948130 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:30.949835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:31.023313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 894/1800] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:31.024928 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18518c4-70ca-4276-9db6-f34002b4f4e1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:31.027151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a18518c4-70ca-4276-9db6-f34002b4f4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:31.075466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d197a2a-579f-4858-875c-0b015c0ed98d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:31.081810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18518c4-70ca-4276-9db6-f34002b4f4e1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:31.082159 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:31.084084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:31.084522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:31.084805 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] PATH_INFO: `/v3/projects/0b70570330394b079eadbd4d676c1f77` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:31.086482 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b70570330394b079eadbd4d676c1f77)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:31.088844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:31.097706 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:31.100817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faee6c-409d-48fa-a1c7-e513d437e571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:31.103629 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faee6c-409d-48fa-a1c7-e513d437e571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:31.105499 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faee6c-409d-48fa-a1c7-e513d437e571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:31.106057 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faee6c-409d-48fa-a1c7-e513d437e571 admin admin] PATH_INFO: `/v3/users/fa6f796dde1f4b53ba9a027610beaa85` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:31.109747 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3faee6c-409d-48fa-a1c7-e513d437e571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6f796dde1f4b53ba9a027610beaa85)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:31.113575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3faee6c-409d-48fa-a1c7-e513d437e571 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:31.178459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b70570330394b079eadbd4d676c1f77', 'request_id': 'req-8c231d23-78b3-46b3-ad0c-af45d2bcd487'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.188430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b70570330394b079eadbd4d676c1f77', 'request_id': 'req-8c231d23-78b3-46b3-ad0c-af45d2bcd487'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.201513 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b70570330394b079eadbd4d676c1f77', 'request_id': 'req-8c231d23-78b3-46b3-ad0c-af45d2bcd487'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.206592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a3faee6c-409d-48fa-a1c7-e513d437e571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6f796dde1f4b53ba9a027610beaa85'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.207444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a3faee6c-409d-48fa-a1c7-e513d437e571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6f796dde1f4b53ba9a027610beaa85'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.219862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] The token cache is being invalidate because project 0b70570330394b079eadbd4d676c1f77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:31.220572 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.221331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a3faee6c-409d-48fa-a1c7-e513d437e571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6f796dde1f4b53ba9a027610beaa85'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.221925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.224935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 907/1801] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:30 2022] DELETE /identity/v3/projects/0b70570330394b079eadbd4d676c1f77 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:31.226595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:31.228888 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:31.237088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a3faee6c-409d-48fa-a1c7-e513d437e571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6f796dde1f4b53ba9a027610beaa85'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.238146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a3faee6c-409d-48fa-a1c7-e513d437e571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6f796dde1f4b53ba9a027610beaa85'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.256713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 895/1802] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:31 2022] DELETE /identity/v3/users/fa6f796dde1f4b53ba9a027610beaa85 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:31.257618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faee6c-409d-48fa-a1c7-e513d437e571 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:31.259061 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a3faee6c-409d-48fa-a1c7-e513d437e571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:31.353209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c231d23-78b3-46b3-ad0c-af45d2bcd487 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:31.389900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faee6c-409d-48fa-a1c7-e513d437e571 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:31.395001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e84e8-5d2b-4ba6-b71a-ff71f5618e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:31.396290 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e84e8-5d2b-4ba6-b71a-ff71f5618e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:31.396583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e84e8-5d2b-4ba6-b71a-ff71f5618e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:31.396863 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e84e8-5d2b-4ba6-b71a-ff71f5618e93 admin admin] PATH_INFO: `/v3/users/a2eb46710fb84be58bb7052cfa4b5915` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:31.398265 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e84e8-5d2b-4ba6-b71a-ff71f5618e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2eb46710fb84be58bb7052cfa4b5915)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:31.400324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e84e8-5d2b-4ba6-b71a-ff71f5618e93 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:31.427003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:31.429163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da7b68-0c41-4578-9fa9-b1336e1f4a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:31.430108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da7b68-0c41-4578-9fa9-b1336e1f4a29 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:31.430808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da7b68-0c41-4578-9fa9-b1336e1f4a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:31.431106 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da7b68-0c41-4578-9fa9-b1336e1f4a29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:31.432015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da7b68-0c41-4578-9fa9-b1336e1f4a29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:16:31.432465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da7b68-0c41-4578-9fa9-b1336e1f4a29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:31.434382 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da7b68-0c41-4578-9fa9-b1336e1f4a29 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:31.449727 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 908/1803] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:16:31.456236 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da7b68-0c41-4578-9fa9-b1336e1f4a29 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:31.467445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da7b68-0c41-4578-9fa9-b1336e1f4a29 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:31.472833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6036-d1c9-4019-92d7-03101898d0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:31.473611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6036-d1c9-4019-92d7-03101898d0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:31.473879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6036-d1c9-4019-92d7-03101898d0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:31.474412 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6036-d1c9-4019-92d7-03101898d0a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:31.474916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b6036-d1c9-4019-92d7-03101898d0a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:31.476184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0a2e84e8-5d2b-4ba6-b71a-ff71f5618e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2eb46710fb84be58bb7052cfa4b5915'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.476978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0a2e84e8-5d2b-4ba6-b71a-ff71f5618e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2eb46710fb84be58bb7052cfa4b5915'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.477569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b6036-d1c9-4019-92d7-03101898d0a8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:31.493732 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0a2e84e8-5d2b-4ba6-b71a-ff71f5618e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2eb46710fb84be58bb7052cfa4b5915'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.507993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0a2e84e8-5d2b-4ba6-b71a-ff71f5618e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2eb46710fb84be58bb7052cfa4b5915'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.508848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0a2e84e8-5d2b-4ba6-b71a-ff71f5618e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2eb46710fb84be58bb7052cfa4b5915'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:31.512240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 909/1804] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:31 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:16:31.518749 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6036-d1c9-4019-92d7-03101898d0a8 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:31.521743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1a3b6036-d1c9-4019-92d7-03101898d0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:31.536433 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 896/1805] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:31 2022] DELETE /identity/v3/users/a2eb46710fb84be58bb7052cfa4b5915 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:31.558902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:31.687276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6036-d1c9-4019-92d7-03101898d0a8 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:31.811166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538fd8b-bc2c-435b-9086-b3334a7a0a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:31.811861 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538fd8b-bc2c-435b-9086-b3334a7a0a74 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:31.812149 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538fd8b-bc2c-435b-9086-b3334a7a0a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:31.812429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538fd8b-bc2c-435b-9086-b3334a7a0a74 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:31.813158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538fd8b-bc2c-435b-9086-b3334a7a0a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:31.815510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538fd8b-bc2c-435b-9086-b3334a7a0a74 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:31.841930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 910/1806] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:31 2022] POST /identity/v3/users => generated 292 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:16:31.846522 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e84e8-5d2b-4ba6-b71a-ff71f5618e93 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:31.863988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e84e8-5d2b-4ba6-b71a-ff71f5618e93 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:31.874232 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616f7e8-5efa-46f7-9a29-074e016a9752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:31.875120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f7e8-5efa-46f7-9a29-074e016a9752 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:31.876022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f7e8-5efa-46f7-9a29-074e016a9752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:31.876373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f7e8-5efa-46f7-9a29-074e016a9752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:31.877281 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616f7e8-5efa-46f7-9a29-074e016a9752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:31.879114 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616f7e8-5efa-46f7-9a29-074e016a9752 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:31.893006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 897/1807] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:31.897335 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538fd8b-bc2c-435b-9086-b3334a7a0a74 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:31.915844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538fd8b-bc2c-435b-9086-b3334a7a0a74 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:31.921051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616f7e8-5efa-46f7-9a29-074e016a9752 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:31.923535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4616f7e8-5efa-46f7-9a29-074e016a9752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:31.925288 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7c0b2-5b1a-4e7c-a277-d7ede2323756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:31.926095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7c0b2-5b1a-4e7c-a277-d7ede2323756 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:31.926478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7c0b2-5b1a-4e7c-a277-d7ede2323756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:31.926948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7c0b2-5b1a-4e7c-a277-d7ede2323756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:31.927797 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7c0b2-5b1a-4e7c-a277-d7ede2323756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:31.931313 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7c0b2-5b1a-4e7c-a277-d7ede2323756 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:31.948092 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 911/1808] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:31.951668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7c0b2-5b1a-4e7c-a277-d7ede2323756 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:31.965227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616f7e8-5efa-46f7-9a29-074e016a9752 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:31.968493 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7c0b2-5b1a-4e7c-a277-d7ede2323756 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:31.972180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:31.973079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:31.973367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:31.973739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] PATH_INFO: `/v3/projects/717005a55a3a4580b906fb59053ec386` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:31.974264 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9614b9a-b624-447d-be37-fd572d7020d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:31.976037 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614b9a-b624-447d-be37-fd572d7020d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:31.976238 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] RBAC: Authorizing `identity:delete_project(project_id=717005a55a3a4580b906fb59053ec386)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:31.976515 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614b9a-b624-447d-be37-fd572d7020d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:31.977379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614b9a-b624-447d-be37-fd572d7020d6 admin admin] PATH_INFO: `/v3/projects/2d46254ec1434466876d5e6165c1c158/users/17c249886abe4fbca3f25236ea8349e6/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:31.978203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:31.997157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9614b9a-b624-447d-be37-fd572d7020d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d46254ec1434466876d5e6165c1c158, user_id=17c249886abe4fbca3f25236ea8349e6, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:32.001224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9614b9a-b624-447d-be37-fd572d7020d6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:32.030723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 912/1809] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:31 2022] PUT /identity/v3/projects/2d46254ec1434466876d5e6165c1c158/users/17c249886abe4fbca3f25236ea8349e6/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:32.040689 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb7968-74aa-45f0-885a-178e2cfb483a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:32.041525 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb7968-74aa-45f0-885a-178e2cfb483a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:32.042177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb7968-74aa-45f0-885a-178e2cfb483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:32.109466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717005a55a3a4580b906fb59053ec386', 'request_id': 'req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.134071 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717005a55a3a4580b906fb59053ec386', 'request_id': 'req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.144083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717005a55a3a4580b906fb59053ec386', 'request_id': 'req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.159584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-95bb7968-74aa-45f0-885a-178e2cfb483a None None] MFA Rules not processed for user `17c249886abe4fbca3f25236ea8349e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:32.161039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-95bb7968-74aa-45f0-885a-178e2cfb483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:32.175675 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] The token cache is being invalidate because project 717005a55a3a4580b906fb59053ec386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:32.176112 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.178468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.188186 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 898/1810] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:31 2022] DELETE /identity/v3/projects/717005a55a3a4580b906fb59053ec386 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:32.188186 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:32.189340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:32.324881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 913/1811] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:32.335960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb7968-74aa-45f0-885a-178e2cfb483a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:32.339599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-95bb7968-74aa-45f0-885a-178e2cfb483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:32.352790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e434be-b85a-4c84-9c2b-2c8953d9d89d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:32.366761 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:32.370314 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:32.375163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb7968-74aa-45f0-885a-178e2cfb483a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:32.380057 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:32.384448 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:32.385122 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397 admin admin] PATH_INFO: `/v3/projects/441b2e2ca74348538a905b4cf368aeb3` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:32.387576 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d643f1-3960-4ac3-8eec-875ac1d3e4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:32.388742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d643f1-3960-4ac3-8eec-875ac1d3e4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:32.389240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d643f1-3960-4ac3-8eec-875ac1d3e4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:32.389575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d643f1-3960-4ac3-8eec-875ac1d3e4e9 admin admin] PATH_INFO: `/v3/users/c60f614e870f406dab77d40cefaee03b` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:32.393624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d643f1-3960-4ac3-8eec-875ac1d3e4e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60f614e870f406dab77d40cefaee03b)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:32.394991 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=441b2e2ca74348538a905b4cf368aeb3)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:32.395721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d643f1-3960-4ac3-8eec-875ac1d3e4e9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:32.405412 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:32.432026 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:32.529821 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '441b2e2ca74348538a905b4cf368aeb3', 'request_id': 'req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.546381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d7d643f1-3960-4ac3-8eec-875ac1d3e4e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60f614e870f406dab77d40cefaee03b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.552289 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '441b2e2ca74348538a905b4cf368aeb3', 'request_id': 'req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.563176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d7d643f1-3960-4ac3-8eec-875ac1d3e4e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60f614e870f406dab77d40cefaee03b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.564012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d7d643f1-3960-4ac3-8eec-875ac1d3e4e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60f614e870f406dab77d40cefaee03b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.571049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '441b2e2ca74348538a905b4cf368aeb3', 'request_id': 'req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.595396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d7d643f1-3960-4ac3-8eec-875ac1d3e4e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60f614e870f406dab77d40cefaee03b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.596819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d7d643f1-3960-4ac3-8eec-875ac1d3e4e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60f614e870f406dab77d40cefaee03b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.621499 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397 admin admin] The token cache is being invalidate because project 441b2e2ca74348538a905b4cf368aeb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:32.621908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 914/1812] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:32 2022] DELETE /identity/v3/users/c60f614e870f406dab77d40cefaee03b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:32.622457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.622956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d643f1-3960-4ac3-8eec-875ac1d3e4e9 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:32.624243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5985e4bb-1d1e-4a9b-a786-e4ac085d2397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:32.627505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 899/1813] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:32 2022] DELETE /identity/v3/projects/441b2e2ca74348538a905b4cf368aeb3 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:32.630985 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d7d643f1-3960-4ac3-8eec-875ac1d3e4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:32.632803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db563584-ae3d-4af8-9d88-eee3afa45e1e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:32.633099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db563584-ae3d-4af8-9d88-eee3afa45e1e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:32.633397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db563584-ae3d-4af8-9d88-eee3afa45e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:32.695868 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-db563584-ae3d-4af8-9d88-eee3afa45e1e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:32.698003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-db563584-ae3d-4af8-9d88-eee3afa45e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:32.763441 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d643f1-3960-4ac3-8eec-875ac1d3e4e9 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:32.769845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27d1ac-d893-4fc0-8b81-23ddb5053077 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:32.770642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27d1ac-d893-4fc0-8b81-23ddb5053077 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:32.771062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27d1ac-d893-4fc0-8b81-23ddb5053077 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:32.771448 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27d1ac-d893-4fc0-8b81-23ddb5053077 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:32.774801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6a27d1ac-d893-4fc0-8b81-23ddb5053077 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:32.849821 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 900/1814] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:16:32.854588 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27d1ac-d893-4fc0-8b81-23ddb5053077 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:32.856397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27d1ac-d893-4fc0-8b81-23ddb5053077 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:32.860874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805162f4-9d02-4f15-9d02-cea1ac519a2e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:32.861798 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805162f4-9d02-4f15-9d02-cea1ac519a2e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:32.863051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805162f4-9d02-4f15-9d02-cea1ac519a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:32.868126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 915/1815] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:32.896510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27d1ac-d893-4fc0-8b81-23ddb5053077 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:32.897937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6a27d1ac-d893-4fc0-8b81-23ddb5053077 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:32.913927 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27d1ac-d893-4fc0-8b81-23ddb5053077 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:32.919243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80c4da-b77b-4a83-857f-456a31a60df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:32.920429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80c4da-b77b-4a83-857f-456a31a60df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:32.920537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80c4da-b77b-4a83-857f-456a31a60df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:32.920824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80c4da-b77b-4a83-857f-456a31a60df5 admin admin] PATH_INFO: `/v3/users/17c249886abe4fbca3f25236ea8349e6` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:32.922463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80c4da-b77b-4a83-857f-456a31a60df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c249886abe4fbca3f25236ea8349e6)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:32.925194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80c4da-b77b-4a83-857f-456a31a60df5 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:32.930497 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-805162f4-9d02-4f15-9d02-cea1ac519a2e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:32.933244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-805162f4-9d02-4f15-9d02-cea1ac519a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:32.969882 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:32.978702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 901/1816] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:32.983844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805162f4-9d02-4f15-9d02-cea1ac519a2e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:33.001734 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805162f4-9d02-4f15-9d02-cea1ac519a2e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:33.010343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ec75f-1a83-40a0-9a79-4c72771276a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:33.011611 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ec75f-1a83-40a0-9a79-4c72771276a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:33.013009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ec75f-1a83-40a0-9a79-4c72771276a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:33.013547 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ec75f-1a83-40a0-9a79-4c72771276a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:33.015217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ec75f-1a83-40a0-9a79-4c72771276a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:16:33.015756 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ec75f-1a83-40a0-9a79-4c72771276a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:33.018968 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ec75f-1a83-40a0-9a79-4c72771276a4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:33.019903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3a80c4da-b77b-4a83-857f-456a31a60df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c249886abe4fbca3f25236ea8349e6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:33.043466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 902/1817] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:16:33.054759 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ec75f-1a83-40a0-9a79-4c72771276a4 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:33.056260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3a80c4da-b77b-4a83-857f-456a31a60df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c249886abe4fbca3f25236ea8349e6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:33.057465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3a80c4da-b77b-4a83-857f-456a31a60df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c249886abe4fbca3f25236ea8349e6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:33.097133 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ec75f-1a83-40a0-9a79-4c72771276a4 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:33.112819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b89ac-0514-482a-9620-bbb15ac24e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:33.114988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b89ac-0514-482a-9620-bbb15ac24e1c admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:33.116949 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b89ac-0514-482a-9620-bbb15ac24e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:33.117786 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b89ac-0514-482a-9620-bbb15ac24e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:33.120105 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b89ac-0514-482a-9620-bbb15ac24e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:33.123042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3a80c4da-b77b-4a83-857f-456a31a60df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c249886abe4fbca3f25236ea8349e6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:33.125595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3a80c4da-b77b-4a83-857f-456a31a60df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c249886abe4fbca3f25236ea8349e6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:33.125894 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b89ac-0514-482a-9620-bbb15ac24e1c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:33.167482 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 916/1818] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:32 2022] DELETE /identity/v3/users/17c249886abe4fbca3f25236ea8349e6 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:16:33.173759 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf80dd-608e-46af-91c7-23f401ac69ce None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:33.174205 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf80dd-608e-46af-91c7-23f401ac69ce None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:33.174583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf80dd-608e-46af-91c7-23f401ac69ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:33.202028 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9baf80dd-608e-46af-91c7-23f401ac69ce None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:33.203792 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9baf80dd-608e-46af-91c7-23f401ac69ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:33.214492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 903/1819] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:33 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:33.216198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b89ac-0514-482a-9620-bbb15ac24e1c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:33.220751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-eb4b89ac-0514-482a-9620-bbb15ac24e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:33.358600 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 917/1820] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:33.399827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:33.407673 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b89ac-0514-482a-9620-bbb15ac24e1c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:33.417908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf80dd-608e-46af-91c7-23f401ac69ce None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:33.420800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9baf80dd-608e-46af-91c7-23f401ac69ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:33.439208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddca01-f4fb-4129-94bb-9ca520faf5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:33.440664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddca01-f4fb-4129-94bb-9ca520faf5df admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:33.441279 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddca01-f4fb-4129-94bb-9ca520faf5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:33.442201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddca01-f4fb-4129-94bb-9ca520faf5df admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:33.444957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddca01-f4fb-4129-94bb-9ca520faf5df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:33.450215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddca01-f4fb-4129-94bb-9ca520faf5df admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:33.660292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 904/1821] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:33 2022] POST /identity/v3/users => generated 294 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:33.663495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddca01-f4fb-4129-94bb-9ca520faf5df admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:33.678475 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddca01-f4fb-4129-94bb-9ca520faf5df admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:33.684836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac735e-4ec9-4e29-9263-945bcf58420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:33.685537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac735e-4ec9-4e29-9263-945bcf58420d admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:33.688155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac735e-4ec9-4e29-9263-945bcf58420d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:33.688155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac735e-4ec9-4e29-9263-945bcf58420d admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:33.688155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac735e-4ec9-4e29-9263-945bcf58420d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:33.689712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac735e-4ec9-4e29-9263-945bcf58420d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:33.705827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 905/1822] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:33.714147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf80dd-608e-46af-91c7-23f401ac69ce None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:33.718776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac735e-4ec9-4e29-9263-945bcf58420d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:33.745243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac735e-4ec9-4e29-9263-945bcf58420d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:33.762347 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43f096-f1bb-4fa4-8524-ff30d6ccad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:33.763496 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43f096-f1bb-4fa4-8524-ff30d6ccad70 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:33.763822 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43f096-f1bb-4fa4-8524-ff30d6ccad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:33.764141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43f096-f1bb-4fa4-8524-ff30d6ccad70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:33.766462 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43f096-f1bb-4fa4-8524-ff30d6ccad70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:33.767776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43f096-f1bb-4fa4-8524-ff30d6ccad70 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:33.800428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 906/1823] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:33.802405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43f096-f1bb-4fa4-8524-ff30d6ccad70 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:33.810474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bb43f096-f1bb-4fa4-8524-ff30d6ccad70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:33.845611 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43f096-f1bb-4fa4-8524-ff30d6ccad70 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:33.860553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823c94b-a449-4925-98bc-9002dcbc0c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:33.861471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823c94b-a449-4925-98bc-9002dcbc0c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:33.861752 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823c94b-a449-4925-98bc-9002dcbc0c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:33.862028 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823c94b-a449-4925-98bc-9002dcbc0c0d admin admin] PATH_INFO: `/v3/projects/662691dfcc2f4951bc7e7dfb67ac76ca` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:33.863913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823c94b-a449-4925-98bc-9002dcbc0c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=662691dfcc2f4951bc7e7dfb67ac76ca)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:33.866065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823c94b-a449-4925-98bc-9002dcbc0c0d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:33.903863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572e27f-c325-4895-8bfa-1429d659e990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:33.906061 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572e27f-c325-4895-8bfa-1429d659e990 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:33.906456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572e27f-c325-4895-8bfa-1429d659e990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:33.906905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572e27f-c325-4895-8bfa-1429d659e990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:33.940825 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572e27f-c325-4895-8bfa-1429d659e990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:33.943169 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572e27f-c325-4895-8bfa-1429d659e990 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:33.964434 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 918/1824] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:33.968606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572e27f-c325-4895-8bfa-1429d659e990 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:33.974991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:33.978919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3823c94b-a449-4925-98bc-9002dcbc0c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662691dfcc2f4951bc7e7dfb67ac76ca', 'request_id': 'req-3823c94b-a449-4925-98bc-9002dcbc0c0d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:34.009036 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3823c94b-a449-4925-98bc-9002dcbc0c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662691dfcc2f4951bc7e7dfb67ac76ca', 'request_id': 'req-3823c94b-a449-4925-98bc-9002dcbc0c0d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:34.016329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572e27f-c325-4895-8bfa-1429d659e990 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:34.032632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3823c94b-a449-4925-98bc-9002dcbc0c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662691dfcc2f4951bc7e7dfb67ac76ca', 'request_id': 'req-3823c94b-a449-4925-98bc-9002dcbc0c0d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:34.067220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3823c94b-a449-4925-98bc-9002dcbc0c0d admin admin] The token cache is being invalidate because project 662691dfcc2f4951bc7e7dfb67ac76ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:34.067765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3823c94b-a449-4925-98bc-9002dcbc0c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:34.068579 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3823c94b-a449-4925-98bc-9002dcbc0c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:34.072233 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 907/1825] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:33 2022] DELETE /identity/v3/projects/662691dfcc2f4951bc7e7dfb67ac76ca => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:34.083860 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5be41-a5bb-401c-8332-ec7689044fd7 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:34.083860 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5be41-a5bb-401c-8332-ec7689044fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:34.083860 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5be41-a5bb-401c-8332-ec7689044fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:34.112496 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1cc5be41-a5bb-401c-8332-ec7689044fd7 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:34.113861 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1cc5be41-a5bb-401c-8332-ec7689044fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:34.127637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a463e51-cb03-4043-936d-d36320a9d6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:34.129319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a463e51-cb03-4043-936d-d36320a9d6da admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:34.129840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a463e51-cb03-4043-936d-d36320a9d6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:34.130483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a463e51-cb03-4043-936d-d36320a9d6da admin admin] PATH_INFO: `/v3/projects/b9cf92d7375f4b2cb64e65147a85ada7/users/175cfaf1cc5c49b296ff58d68b52d89a/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:34.165848 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a463e51-cb03-4043-936d-d36320a9d6da admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cf92d7375f4b2cb64e65147a85ada7, user_id=175cfaf1cc5c49b296ff58d68b52d89a, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:34.172961 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a463e51-cb03-4043-936d-d36320a9d6da admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:34.211782 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 908/1826] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:16:34.227009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0584848-256e-4791-9d18-8d292315bb73 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:34.227888 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0584848-256e-4791-9d18-8d292315bb73 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:34.228485 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0584848-256e-4791-9d18-8d292315bb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:34.231393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 919/1827] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:33 2022] PUT /identity/v3/projects/b9cf92d7375f4b2cb64e65147a85ada7/users/175cfaf1cc5c49b296ff58d68b52d89a/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:34.262285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfd1a5-8963-4f74-a672-d88cf1d11b59 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:34.262916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfd1a5-8963-4f74-a672-d88cf1d11b59 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:34.263780 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfd1a5-8963-4f74-a672-d88cf1d11b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:34.285204 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c0584848-256e-4791-9d18-8d292315bb73 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:34.287083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c0584848-256e-4791-9d18-8d292315bb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:34.341198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1dbfd1a5-8963-4f74-a672-d88cf1d11b59 None None] MFA Rules not processed for user `175cfaf1cc5c49b296ff58d68b52d89a`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:34.344555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1dbfd1a5-8963-4f74-a672-d88cf1d11b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:34.433399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:34.507540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 909/1828] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:34.514635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0584848-256e-4791-9d18-8d292315bb73 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:34.532243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0584848-256e-4791-9d18-8d292315bb73 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:34.540080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 920/1829] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:34.540782 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdba97-e2e6-4de3-bc8b-53926623cb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:34.542487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdba97-e2e6-4de3-bc8b-53926623cb6f admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:34.542487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdba97-e2e6-4de3-bc8b-53926623cb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:34.542844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdba97-e2e6-4de3-bc8b-53926623cb6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:34.544228 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdba97-e2e6-4de3-bc8b-53926623cb6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:16:34.544228 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdba97-e2e6-4de3-bc8b-53926623cb6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:34.551784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfd1a5-8963-4f74-a672-d88cf1d11b59 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:34.556952 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1dbfd1a5-8963-4f74-a672-d88cf1d11b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:34.558702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdba97-e2e6-4de3-bc8b-53926623cb6f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:34.593530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 910/1830] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:16:34.597709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdba97-e2e6-4de3-bc8b-53926623cb6f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:34.645017 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfd1a5-8963-4f74-a672-d88cf1d11b59 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:34.647902 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdba97-e2e6-4de3-bc8b-53926623cb6f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:34.672042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35d08e-786b-4613-8608-4780a7ee14cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:34.672946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35d08e-786b-4613-8608-4780a7ee14cd admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:34.673311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd7e04-78d3-4fbe-a49a-68e7f1d39fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:34.673448 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35d08e-786b-4613-8608-4780a7ee14cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:34.673849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35d08e-786b-4613-8608-4780a7ee14cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:34.674470 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7e04-78d3-4fbe-a49a-68e7f1d39fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:34.674810 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35d08e-786b-4613-8608-4780a7ee14cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:34.677104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35d08e-786b-4613-8608-4780a7ee14cd admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:34.677772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7e04-78d3-4fbe-a49a-68e7f1d39fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:34.678258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7e04-78d3-4fbe-a49a-68e7f1d39fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:34.679578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd7e04-78d3-4fbe-a49a-68e7f1d39fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:34.691325 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd7e04-78d3-4fbe-a49a-68e7f1d39fe4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:34.718130 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 921/1831] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:34 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:34.727685 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35d08e-786b-4613-8608-4780a7ee14cd admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:34.744819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 911/1832] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:34 2022] POST /identity/v3/projects => generated 401 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:34.751188 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd7e04-78d3-4fbe-a49a-68e7f1d39fe4 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:34.882351 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:34.908696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd7e04-78d3-4fbe-a49a-68e7f1d39fe4 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:34.910687 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35d08e-786b-4613-8608-4780a7ee14cd admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:34.921855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43d036-460f-4c8d-9065-b23ee46d70ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:34.922910 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71481deb-e742-4594-9597-3b1d5a9698a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:34.924278 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71481deb-e742-4594-9597-3b1d5a9698a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:34.925168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d036-460f-4c8d-9065-b23ee46d70ad admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:34.925489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71481deb-e742-4594-9597-3b1d5a9698a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:34.925940 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71481deb-e742-4594-9597-3b1d5a9698a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:34.926335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d036-460f-4c8d-9065-b23ee46d70ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:34.929277 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d036-460f-4c8d-9065-b23ee46d70ad admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:34.930150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71481deb-e742-4594-9597-3b1d5a9698a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:34.931861 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43d036-460f-4c8d-9065-b23ee46d70ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:34.932526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71481deb-e742-4594-9597-3b1d5a9698a6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:34.941886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43d036-460f-4c8d-9065-b23ee46d70ad admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:34.967205 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 922/1833] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:34 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:34.989704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71481deb-e742-4594-9597-3b1d5a9698a6 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:35.019155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 912/1834] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:34 2022] POST /identity/v3/users => generated 301 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:16:35.025955 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43d036-460f-4c8d-9065-b23ee46d70ad admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:35.051806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71481deb-e742-4594-9597-3b1d5a9698a6 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:35.071670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aab602-082a-46c5-9ec7-b7cdfd240fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:35.072503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aab602-082a-46c5-9ec7-b7cdfd240fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:35.072798 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aab602-082a-46c5-9ec7-b7cdfd240fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:35.073080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aab602-082a-46c5-9ec7-b7cdfd240fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:35.074193 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aab602-082a-46c5-9ec7-b7cdfd240fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:35.075597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43d036-460f-4c8d-9065-b23ee46d70ad admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:35.076818 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aab602-082a-46c5-9ec7-b7cdfd240fd9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:35.095915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db46da3-7ca7-49af-99a7-b15f887dbaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:35.096792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46da3-7ca7-49af-99a7-b15f887dbaad admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:35.097359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46da3-7ca7-49af-99a7-b15f887dbaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:35.097992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46da3-7ca7-49af-99a7-b15f887dbaad admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:35.100805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db46da3-7ca7-49af-99a7-b15f887dbaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:35.112268 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db46da3-7ca7-49af-99a7-b15f887dbaad admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:35.112973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 923/1835] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:35.120915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aab602-082a-46c5-9ec7-b7cdfd240fd9 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:35.148634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aab602-082a-46c5-9ec7-b7cdfd240fd9 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:35.149353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 913/1836] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:16:35.155397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db46da3-7ca7-49af-99a7-b15f887dbaad admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:35.163684 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd3cf2-148c-47fa-8ed6-12cebbb1e6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:35.166001 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3cf2-148c-47fa-8ed6-12cebbb1e6b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:35.166547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3cf2-148c-47fa-8ed6-12cebbb1e6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:35.167159 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3cf2-148c-47fa-8ed6-12cebbb1e6b8 admin admin] PATH_INFO: `/v3/projects/db38733f1e7c4074b8cb065f2b6ca0fa/users/25b6092a1e2b42eca3fed71a24a1247f/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:35.195884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db46da3-7ca7-49af-99a7-b15f887dbaad admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:35.209027 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba717daa-da79-4427-8fd5-87e0178b4a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:35.210242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717daa-da79-4427-8fd5-87e0178b4a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:35.210804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717daa-da79-4427-8fd5-87e0178b4a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:35.211314 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717daa-da79-4427-8fd5-87e0178b4a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:35.215322 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba717daa-da79-4427-8fd5-87e0178b4a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:35.218237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd3cf2-148c-47fa-8ed6-12cebbb1e6b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db38733f1e7c4074b8cb065f2b6ca0fa, user_id=25b6092a1e2b42eca3fed71a24a1247f, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:35.219517 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba717daa-da79-4427-8fd5-87e0178b4a52 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:35.225110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd3cf2-148c-47fa-8ed6-12cebbb1e6b8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:35.255599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 914/1837] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:16:35.258705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 924/1838] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:35 2022] PUT /identity/v3/projects/db38733f1e7c4074b8cb065f2b6ca0fa/users/25b6092a1e2b42eca3fed71a24a1247f/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:35.268025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba717daa-da79-4427-8fd5-87e0178b4a52 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:35.269811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd3cf2-148c-47fa-8ed6-12cebbb1e6b8 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:35.295248 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba717daa-da79-4427-8fd5-87e0178b4a52 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:35.521512 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd3cf2-148c-47fa-8ed6-12cebbb1e6b8 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:35.528776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779f0a6-1f2f-4407-b13d-2460a42826cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:35.533491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779f0a6-1f2f-4407-b13d-2460a42826cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:35.534155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779f0a6-1f2f-4407-b13d-2460a42826cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:35.534695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779f0a6-1f2f-4407-b13d-2460a42826cd admin admin] PATH_INFO: `/v3/projects/5218b2df6eac4b28a542d109c3134ec9/users/adb13ac733b14c7fbc69001f19d1bf25/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:35.556540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff3453-c864-42e3-ae36-7975fa252f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:35.565221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff3453-c864-42e3-ae36-7975fa252f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:35.566691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff3453-c864-42e3-ae36-7975fa252f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:35.569287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff3453-c864-42e3-ae36-7975fa252f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:35.573740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff3453-c864-42e3-ae36-7975fa252f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:35.585102 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff3453-c864-42e3-ae36-7975fa252f77 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:35.606491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779f0a6-1f2f-4407-b13d-2460a42826cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5218b2df6eac4b28a542d109c3134ec9, user_id=adb13ac733b14c7fbc69001f19d1bf25, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:35.617335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779f0a6-1f2f-4407-b13d-2460a42826cd admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:35.632161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 925/1839] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:35.639307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cce27a-b9a5-459b-a14a-8113b5b37e8e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:35.639852 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cce27a-b9a5-459b-a14a-8113b5b37e8e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:35.640772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cce27a-b9a5-459b-a14a-8113b5b37e8e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:35.645464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 926/1840] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jul 21 12:16:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:16:35.646170 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cce27a-b9a5-459b-a14a-8113b5b37e8e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:35.677452 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cce27a-b9a5-459b-a14a-8113b5b37e8e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:35.690694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 915/1841] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:35 2022] PUT /identity/v3/projects/5218b2df6eac4b28a542d109c3134ec9/users/adb13ac733b14c7fbc69001f19d1bf25/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:16:35.690694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1f673-a4d8-4d24-a13f-b9a0c4d81e5a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:35.690694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1f673-a4d8-4d24-a13f-b9a0c4d81e5a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:35.690694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1f673-a4d8-4d24-a13f-b9a0c4d81e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:35.715738 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:35.756800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-afb1f673-a4d8-4d24-a13f-b9a0c4d81e5a None None] MFA Rules not processed for user `f3fb1d091b27472081549f4166ca172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:35.761625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-afb1f673-a4d8-4d24-a13f-b9a0c4d81e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:35.925237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588261b-17cc-413f-831f-4b94942a63b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:35.928159 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588261b-17cc-413f-831f-4b94942a63b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:35.929152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588261b-17cc-413f-831f-4b94942a63b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:35.929948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588261b-17cc-413f-831f-4b94942a63b0 admin admin] PATH_INFO: `/v3/projects/db38733f1e7c4074b8cb065f2b6ca0fa/users/25b6092a1e2b42eca3fed71a24a1247f/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:35.934096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588261b-17cc-413f-831f-4b94942a63b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db38733f1e7c4074b8cb065f2b6ca0fa, user_id=25b6092a1e2b42eca3fed71a24a1247f, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:35.944375 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588261b-17cc-413f-831f-4b94942a63b0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:35.978197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 927/1842] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:35 2022] PUT /identity/v3/projects/db38733f1e7c4074b8cb065f2b6ca0fa/users/25b6092a1e2b42eca3fed71a24a1247f/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:35.982839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65f10a-06af-4250-a005-c4ab14e2fea6 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:35.983371 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65f10a-06af-4250-a005-c4ab14e2fea6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:35.983665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65f10a-06af-4250-a005-c4ab14e2fea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:35.988886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 916/1843] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jul 21 12:16:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:35.993927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2d84-065f-4b91-8141-f34a618d5b31 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:35.995671 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2d84-065f-4b91-8141-f34a618d5b31 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:35.995671 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2d84-065f-4b91-8141-f34a618d5b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:36.059621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6e65f10a-06af-4250-a005-c4ab14e2fea6 None None] MFA Rules not processed for user `adb13ac733b14c7fbc69001f19d1bf25`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:36.063494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6e65f10a-06af-4250-a005-c4ab14e2fea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:36.080861 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-181a2d84-065f-4b91-8141-f34a618d5b31 None None] MFA Rules not processed for user `25b6092a1e2b42eca3fed71a24a1247f`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:36.082251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-181a2d84-065f-4b91-8141-f34a618d5b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:36.160372 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:36.233571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 917/1844] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:36.244215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a2d84-065f-4b91-8141-f34a618d5b31 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:36.245869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-181a2d84-065f-4b91-8141-f34a618d5b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:36.323854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 928/1845] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:36.331240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65f10a-06af-4250-a005-c4ab14e2fea6 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:36.401296 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a2d84-065f-4b91-8141-f34a618d5b31 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:36.412985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c678-a704-46e4-aef0-5eb2ca3d1816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:36.413637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c678-a704-46e4-aef0-5eb2ca3d1816 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:36.413969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c678-a704-46e4-aef0-5eb2ca3d1816 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:36.414283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c678-a704-46e4-aef0-5eb2ca3d1816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:36.439561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0c678-a704-46e4-aef0-5eb2ca3d1816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:36.441910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0c678-a704-46e4-aef0-5eb2ca3d1816 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:36.507757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 918/1846] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:36.508789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c678-a704-46e4-aef0-5eb2ca3d1816 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:36.513910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0ac0c678-a704-46e4-aef0-5eb2ca3d1816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:36.597351 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65f10a-06af-4250-a005-c4ab14e2fea6 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:36.618493 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:36.621361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af146ba5-6910-45aa-8321-1e31bb73c3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:36.622892 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af146ba5-6910-45aa-8321-1e31bb73c3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:36.624792 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af146ba5-6910-45aa-8321-1e31bb73c3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:36.625265 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af146ba5-6910-45aa-8321-1e31bb73c3a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:36.629682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af146ba5-6910-45aa-8321-1e31bb73c3a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:36.636785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af146ba5-6910-45aa-8321-1e31bb73c3a4 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:36.681600 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 929/1847] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:36 2022] POST /identity/v3/projects => generated 399 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:36.686409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af146ba5-6910-45aa-8321-1e31bb73c3a4 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:36.806325 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c678-a704-46e4-aef0-5eb2ca3d1816 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:36.869406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af146ba5-6910-45aa-8321-1e31bb73c3a4 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:36.888258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f86ab-b6ba-48be-9370-43ec434ba451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:36.890240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f86ab-b6ba-48be-9370-43ec434ba451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:36.890537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f86ab-b6ba-48be-9370-43ec434ba451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:36.890946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f86ab-b6ba-48be-9370-43ec434ba451 admin admin] PATH_INFO: `/v3/users/175cfaf1cc5c49b296ff58d68b52d89a` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:36.892646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f86ab-b6ba-48be-9370-43ec434ba451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=175cfaf1cc5c49b296ff58d68b52d89a)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:36.898593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f86ab-b6ba-48be-9370-43ec434ba451 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:36.994107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b81f86ab-b6ba-48be-9370-43ec434ba451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175cfaf1cc5c49b296ff58d68b52d89a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:37.007454 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:37.011580 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b81f86ab-b6ba-48be-9370-43ec434ba451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175cfaf1cc5c49b296ff58d68b52d89a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:37.012616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b81f86ab-b6ba-48be-9370-43ec434ba451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175cfaf1cc5c49b296ff58d68b52d89a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:37.042160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b81f86ab-b6ba-48be-9370-43ec434ba451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175cfaf1cc5c49b296ff58d68b52d89a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:37.046844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b81f86ab-b6ba-48be-9370-43ec434ba451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175cfaf1cc5c49b296ff58d68b52d89a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:37.106803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 930/1848] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:36 2022] DELETE /identity/v3/users/175cfaf1cc5c49b296ff58d68b52d89a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:37.113786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f86ab-b6ba-48be-9370-43ec434ba451 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:37.117289 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423dc0b0-1d47-46b7-9160-1112603f6089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:37.120143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc0b0-1d47-46b7-9160-1112603f6089 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:37.121072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc0b0-1d47-46b7-9160-1112603f6089 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:37.121536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc0b0-1d47-46b7-9160-1112603f6089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:37.121804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b81f86ab-b6ba-48be-9370-43ec434ba451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:37.131672 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-423dc0b0-1d47-46b7-9160-1112603f6089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:37.160181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423dc0b0-1d47-46b7-9160-1112603f6089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:37.162703 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423dc0b0-1d47-46b7-9160-1112603f6089 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:37.199556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 919/1849] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:37.204591 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53558-6741-4764-880f-39014a452288 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:37.205158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53558-6741-4764-880f-39014a452288 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:37.206614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53558-6741-4764-880f-39014a452288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:37.281817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-13d53558-6741-4764-880f-39014a452288 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:37.286710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-13d53558-6741-4764-880f-39014a452288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:37.320065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 920/1850] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:37.327626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f86ab-b6ba-48be-9370-43ec434ba451 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:37.341965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543b5fc-98a9-4fd9-b48a-107e0bf62a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:37.344261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543b5fc-98a9-4fd9-b48a-107e0bf62a15 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:37.344860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543b5fc-98a9-4fd9-b48a-107e0bf62a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:37.345369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543b5fc-98a9-4fd9-b48a-107e0bf62a15 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:37.347086 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543b5fc-98a9-4fd9-b48a-107e0bf62a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:37.349212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543b5fc-98a9-4fd9-b48a-107e0bf62a15 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:37.354850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d53558-6741-4764-880f-39014a452288 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:37.357392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-13d53558-6741-4764-880f-39014a452288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:37.388301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 931/1851] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:37 2022] POST /identity/v3/users => generated 306 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:37.393097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543b5fc-98a9-4fd9-b48a-107e0bf62a15 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:37.422289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543b5fc-98a9-4fd9-b48a-107e0bf62a15 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:37.434957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125b598-519a-48d8-ae1b-5f414db8615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:37.436148 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125b598-519a-48d8-ae1b-5f414db8615b admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:37.436642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125b598-519a-48d8-ae1b-5f414db8615b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:37.437123 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125b598-519a-48d8-ae1b-5f414db8615b admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:37.438543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125b598-519a-48d8-ae1b-5f414db8615b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:37.443440 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125b598-519a-48d8-ae1b-5f414db8615b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:37.487473 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 932/1852] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:37.489951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125b598-519a-48d8-ae1b-5f414db8615b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:37.540703 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d53558-6741-4764-880f-39014a452288 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:37.555325 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66386e43-8b8f-4d33-b5b8-42a357da0d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:37.556341 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66386e43-8b8f-4d33-b5b8-42a357da0d4c service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:37.556641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66386e43-8b8f-4d33-b5b8-42a357da0d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:37.556939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66386e43-8b8f-4d33-b5b8-42a357da0d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:37.559800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125b598-519a-48d8-ae1b-5f414db8615b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:37.611171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f91f0-0652-452e-9101-3557739ecb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:37.614368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f91f0-0652-452e-9101-3557739ecb6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:37.616478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66386e43-8b8f-4d33-b5b8-42a357da0d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:37.619286 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f91f0-0652-452e-9101-3557739ecb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:37.619874 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f91f0-0652-452e-9101-3557739ecb6f admin admin] PATH_INFO: `/v3/projects/56670fcffdd347c8982ddbca2d98cfff/users/093204c79666412fbf3c65946b3fca86/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:37.624041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66386e43-8b8f-4d33-b5b8-42a357da0d4c service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:37.680043 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 921/1853] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:37.681783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66386e43-8b8f-4d33-b5b8-42a357da0d4c service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:37.688331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-66386e43-8b8f-4d33-b5b8-42a357da0d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:37.696754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f91f0-0652-452e-9101-3557739ecb6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56670fcffdd347c8982ddbca2d98cfff, user_id=093204c79666412fbf3c65946b3fca86, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:37.715289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f91f0-0652-452e-9101-3557739ecb6f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:37.740598 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66386e43-8b8f-4d33-b5b8-42a357da0d4c service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:37.767473 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 933/1854] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:37 2022] PUT /identity/v3/projects/56670fcffdd347c8982ddbca2d98cfff/users/093204c79666412fbf3c65946b3fca86/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:37.772678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a452efe-ed16-4873-9896-1f89a6c08ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:37.773718 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f91f0-0652-452e-9101-3557739ecb6f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:37.775208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452efe-ed16-4873-9896-1f89a6c08ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:37.780063 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452efe-ed16-4873-9896-1f89a6c08ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:37.780679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452efe-ed16-4873-9896-1f89a6c08ebb admin admin] PATH_INFO: `/v3/projects/2d46254ec1434466876d5e6165c1c158` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:37.784187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a452efe-ed16-4873-9896-1f89a6c08ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d46254ec1434466876d5e6165c1c158)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:37.800881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a452efe-ed16-4873-9896-1f89a6c08ebb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:37.911119 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:37.928016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4a452efe-ed16-4873-9896-1f89a6c08ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d46254ec1434466876d5e6165c1c158', 'request_id': 'req-4a452efe-ed16-4873-9896-1f89a6c08ebb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:37.967633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4a452efe-ed16-4873-9896-1f89a6c08ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d46254ec1434466876d5e6165c1c158', 'request_id': 'req-4a452efe-ed16-4873-9896-1f89a6c08ebb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:37.974538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f91f0-0652-452e-9101-3557739ecb6f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:37.983874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4a452efe-ed16-4873-9896-1f89a6c08ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d46254ec1434466876d5e6165c1c158', 'request_id': 'req-4a452efe-ed16-4873-9896-1f89a6c08ebb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:38.012787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4a452efe-ed16-4873-9896-1f89a6c08ebb admin admin] The token cache is being invalidate because project 2d46254ec1434466876d5e6165c1c158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:38.013487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4a452efe-ed16-4873-9896-1f89a6c08ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:38.014674 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4a452efe-ed16-4873-9896-1f89a6c08ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:38.020529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 922/1855] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:37 2022] DELETE /identity/v3/projects/2d46254ec1434466876d5e6165c1c158 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:38.027638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879723f-41de-41ec-9595-316690ed3ace None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:38.029238 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879723f-41de-41ec-9595-316690ed3ace None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:38.029889 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879723f-41de-41ec-9595-316690ed3ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:38.041094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:38.089195 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7879723f-41de-41ec-9595-316690ed3ace None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:38.090544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7879723f-41de-41ec-9595-316690ed3ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:38.126018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234436d-97f2-421b-84d6-ad45a7e0f448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:38.128201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234436d-97f2-421b-84d6-ad45a7e0f448 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:38.128742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234436d-97f2-421b-84d6-ad45a7e0f448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:38.129258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234436d-97f2-421b-84d6-ad45a7e0f448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:38.131029 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234436d-97f2-421b-84d6-ad45a7e0f448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:38.133804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234436d-97f2-421b-84d6-ad45a7e0f448 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:38.154940 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 934/1856] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:38.159765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234436d-97f2-421b-84d6-ad45a7e0f448 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:38.162231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7234436d-97f2-421b-84d6-ad45a7e0f448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:38.183857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234436d-97f2-421b-84d6-ad45a7e0f448 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:38.192573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27119-89f9-4b79-bfb0-47e0e5fdc7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:38.193836 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27119-89f9-4b79-bfb0-47e0e5fdc7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:38.194430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27119-89f9-4b79-bfb0-47e0e5fdc7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:38.195112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27119-89f9-4b79-bfb0-47e0e5fdc7ed admin admin] PATH_INFO: `/v3/projects/56670fcffdd347c8982ddbca2d98cfff/users/093204c79666412fbf3c65946b3fca86/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:38.198163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba27119-89f9-4b79-bfb0-47e0e5fdc7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=56670fcffdd347c8982ddbca2d98cfff, user_id=093204c79666412fbf3c65946b3fca86, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:38.202796 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba27119-89f9-4b79-bfb0-47e0e5fdc7ed admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:38.205643 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 923/1857] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:38.216549 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc0f6f-2cf5-457d-aca9-c8a29aa39b1b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:38.216969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc0f6f-2cf5-457d-aca9-c8a29aa39b1b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:38.217160 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc0f6f-2cf5-457d-aca9-c8a29aa39b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:38.222725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 935/1858] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:38 2022] PUT /identity/v3/projects/56670fcffdd347c8982ddbca2d98cfff/users/093204c79666412fbf3c65946b3fca86/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:38.234321 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb2a92-4723-4284-a844-66a263c4d684 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:38.234899 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb2a92-4723-4284-a844-66a263c4d684 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:38.235501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb2a92-4723-4284-a844-66a263c4d684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:38.240344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-23bc0f6f-2cf5-457d-aca9-c8a29aa39b1b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:38.241716 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-23bc0f6f-2cf5-457d-aca9-c8a29aa39b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:38.300681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b1cb2a92-4723-4284-a844-66a263c4d684 None None] MFA Rules not processed for user `093204c79666412fbf3c65946b3fca86`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:38.303464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b1cb2a92-4723-4284-a844-66a263c4d684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:38.393253 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 924/1859] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:38.394418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc0f6f-2cf5-457d-aca9-c8a29aa39b1b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:38.405851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc0f6f-2cf5-457d-aca9-c8a29aa39b1b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:38.412213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91736064-dc7e-4a9c-a9a1-e05220ce7ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:38.412921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91736064-dc7e-4a9c-a9a1-e05220ce7ebe admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:38.413209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91736064-dc7e-4a9c-a9a1-e05220ce7ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:38.413534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91736064-dc7e-4a9c-a9a1-e05220ce7ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:38.414303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91736064-dc7e-4a9c-a9a1-e05220ce7ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:16:38.414750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91736064-dc7e-4a9c-a9a1-e05220ce7ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:38.416638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91736064-dc7e-4a9c-a9a1-e05220ce7ebe admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:38.436356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 925/1860] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:16:38.441610 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91736064-dc7e-4a9c-a9a1-e05220ce7ebe admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:38.452519 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 936/1861] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:38 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:16:38.454632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91736064-dc7e-4a9c-a9a1-e05220ce7ebe admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:38.460458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065789f-7248-4cf4-968e-9585832fe349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:38.461493 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065789f-7248-4cf4-968e-9585832fe349 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:38.461782 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065789f-7248-4cf4-968e-9585832fe349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:38.462060 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065789f-7248-4cf4-968e-9585832fe349 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:38.462966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065789f-7248-4cf4-968e-9585832fe349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:38.464924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065789f-7248-4cf4-968e-9585832fe349 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:38.476863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb2a92-4723-4284-a844-66a263c4d684 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:38.479768 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b1cb2a92-4723-4284-a844-66a263c4d684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:38.513313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 926/1862] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:38 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:38.515337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065789f-7248-4cf4-968e-9585832fe349 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:38.573773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:38.630315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb2a92-4723-4284-a844-66a263c4d684 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:38.635633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065789f-7248-4cf4-968e-9585832fe349 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:38.644563 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2ca2e-1b7a-4d75-8257-2ccb23edccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:38.645615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2ca2e-1b7a-4d75-8257-2ccb23edccca admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:38.646081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2ca2e-1b7a-4d75-8257-2ccb23edccca admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:38.646524 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2ca2e-1b7a-4d75-8257-2ccb23edccca admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:38.648838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2ca2e-1b7a-4d75-8257-2ccb23edccca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:38.652890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2ca2e-1b7a-4d75-8257-2ccb23edccca admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:38.700491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 927/1863] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:38 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:38.702181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2ca2e-1b7a-4d75-8257-2ccb23edccca admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:38.722373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2ca2e-1b7a-4d75-8257-2ccb23edccca admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:38.730074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e6d0c-d685-4e53-a3cb-1b03c77d9ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:38.731372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e6d0c-d685-4e53-a3cb-1b03c77d9ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:38.732003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e6d0c-d685-4e53-a3cb-1b03c77d9ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:38.736605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68968949-39e4-4c12-b135-e39b438daa64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:38.737183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68968949-39e4-4c12-b135-e39b438daa64 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:38.737666 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68968949-39e4-4c12-b135-e39b438daa64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:38.738071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68968949-39e4-4c12-b135-e39b438daa64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:38.743835 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e6d0c-d685-4e53-a3cb-1b03c77d9ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:38.745112 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e6d0c-d685-4e53-a3cb-1b03c77d9ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:38.748162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e6d0c-d685-4e53-a3cb-1b03c77d9ab5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:38.771374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:38.801813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 928/1864] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:38.809883 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e6d0c-d685-4e53-a3cb-1b03c77d9ab5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:38.846364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e6d0c-d685-4e53-a3cb-1b03c77d9ab5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:38.867922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2370-e846-45ba-ac8b-24e03890c29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:38.870597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2370-e846-45ba-ac8b-24e03890c29c admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:38.871312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2370-e846-45ba-ac8b-24e03890c29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:38.871312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2370-e846-45ba-ac8b-24e03890c29c admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:38.872184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf2370-e846-45ba-ac8b-24e03890c29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:38.880568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf2370-e846-45ba-ac8b-24e03890c29c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:38.910464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68968949-39e4-4c12-b135-e39b438daa64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:38.912779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68968949-39e4-4c12-b135-e39b438daa64 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:38.912945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 929/1865] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:38.926453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2370-e846-45ba-ac8b-24e03890c29c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:38.939889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 937/1866] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:38 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:16:38.945084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2370-e846-45ba-ac8b-24e03890c29c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:38.956420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff19b1-ca02-46e9-858a-3b52e9f61c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:38.957554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff19b1-ca02-46e9-858a-3b52e9f61c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:38.958033 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff19b1-ca02-46e9-858a-3b52e9f61c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:38.958478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff19b1-ca02-46e9-858a-3b52e9f61c90 admin admin] PATH_INFO: `/v3/projects/350b83d4d1cd4ef1a25e429307bd8e4a/users/6de0b0b0f59240ad9ab55a21ef78532f/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:38.999466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff19b1-ca02-46e9-858a-3b52e9f61c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350b83d4d1cd4ef1a25e429307bd8e4a, user_id=6de0b0b0f59240ad9ab55a21ef78532f, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:38.999466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff19b1-ca02-46e9-858a-3b52e9f61c90 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:39.023450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 930/1867] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:38 2022] PUT /identity/v3/projects/350b83d4d1cd4ef1a25e429307bd8e4a/users/6de0b0b0f59240ad9ab55a21ef78532f/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:39.033761 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78b889-1ad0-44a6-8a8e-b4a2d6c97ea0 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:39.036821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78b889-1ad0-44a6-8a8e-b4a2d6c97ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:39.037140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78b889-1ad0-44a6-8a8e-b4a2d6c97ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:39.071304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff19b1-ca02-46e9-858a-3b52e9f61c90 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:39.099194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0f78b889-1ad0-44a6-8a8e-b4a2d6c97ea0 None None] MFA Rules not processed for user `6de0b0b0f59240ad9ab55a21ef78532f`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:39.100577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0f78b889-1ad0-44a6-8a8e-b4a2d6c97ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:39.218136 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff19b1-ca02-46e9-858a-3b52e9f61c90 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:39.223006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b1148-a823-4e2f-bc71-904f0819a7b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:39.223940 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b1148-a823-4e2f-bc71-904f0819a7b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:39.224306 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b1148-a823-4e2f-bc71-904f0819a7b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:39.224641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b1148-a823-4e2f-bc71-904f0819a7b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:39.230006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-586b1148-a823-4e2f-bc71-904f0819a7b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:39.301750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 938/1868] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:39.310239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78b889-1ad0-44a6-8a8e-b4a2d6c97ea0 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:39.311408 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0f78b889-1ad0-44a6-8a8e-b4a2d6c97ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:39.329481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78b889-1ad0-44a6-8a8e-b4a2d6c97ea0 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:39.335441 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d4608-28a1-42d1-bc15-b98ba92fc766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:39.336215 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d4608-28a1-42d1-bc15-b98ba92fc766 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:39.336506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d4608-28a1-42d1-bc15-b98ba92fc766 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:39.336783 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d4608-28a1-42d1-bc15-b98ba92fc766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:39.349572 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d4608-28a1-42d1-bc15-b98ba92fc766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:39.351815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d4608-28a1-42d1-bc15-b98ba92fc766 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:39.362784 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b1148-a823-4e2f-bc71-904f0819a7b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:39.364303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 939/1869] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:39.364776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b1148-a823-4e2f-bc71-904f0819a7b5 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:39.383597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 931/1870] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:39.396902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d4608-28a1-42d1-bc15-b98ba92fc766 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:39.398469 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-dc4d4608-28a1-42d1-bc15-b98ba92fc766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:39.556538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d4608-28a1-42d1-bc15-b98ba92fc766 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:39.570457 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:39.572496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:39.574068 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:39.575468 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] PATH_INFO: `/v3/projects/b9cf92d7375f4b2cb64e65147a85ada7` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:39.579823 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9cf92d7375f4b2cb64e65147a85ada7)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:39.584925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:39.669685 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:39.734793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9cf92d7375f4b2cb64e65147a85ada7', 'request_id': 'req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:39.749803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9cf92d7375f4b2cb64e65147a85ada7', 'request_id': 'req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:39.793003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9cf92d7375f4b2cb64e65147a85ada7', 'request_id': 'req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:39.824798 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] The token cache is being invalidate because project b9cf92d7375f4b2cb64e65147a85ada7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:39.825204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:39.831336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:39.835785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 940/1871] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:39 2022] DELETE /identity/v3/projects/b9cf92d7375f4b2cb64e65147a85ada7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:39.839715 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b1148-a823-4e2f-bc71-904f0819a7b5 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:39.867350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b1148-a823-4e2f-bc71-904f0819a7b5 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:39.987214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:40.077591 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93843c-e93f-4e10-9c91-d3273bd70387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:40.078572 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93843c-e93f-4e10-9c91-d3273bd70387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:40.078893 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93843c-e93f-4e10-9c91-d3273bd70387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:40.079169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93843c-e93f-4e10-9c91-d3273bd70387 admin admin] PATH_INFO: `/v3/users/25b6092a1e2b42eca3fed71a24a1247f` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:40.080452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93843c-e93f-4e10-9c91-d3273bd70387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b6092a1e2b42eca3fed71a24a1247f)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:40.082409 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93843c-e93f-4e10-9c91-d3273bd70387 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:40.152422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ae93843c-e93f-4e10-9c91-d3273bd70387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b6092a1e2b42eca3fed71a24a1247f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:40.162960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ae93843c-e93f-4e10-9c91-d3273bd70387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b6092a1e2b42eca3fed71a24a1247f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:40.189492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ae93843c-e93f-4e10-9c91-d3273bd70387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b6092a1e2b42eca3fed71a24a1247f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:40.199425 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ae93843c-e93f-4e10-9c91-d3273bd70387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b6092a1e2b42eca3fed71a24a1247f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:40.200655 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ae93843c-e93f-4e10-9c91-d3273bd70387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b6092a1e2b42eca3fed71a24a1247f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:40.222058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 932/1872] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:39 2022] DELETE /identity/v3/users/25b6092a1e2b42eca3fed71a24a1247f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:40.681736 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:40.683352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:40.711480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b49c28-fbd9-4f4f-be81-d02bddcce5c3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:40.824335 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69a69f-2e46-40fc-9b66-10498570016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:40.825270 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a69f-2e46-40fc-9b66-10498570016f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:40.825748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a69f-2e46-40fc-9b66-10498570016f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:40.826237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a69f-2e46-40fc-9b66-10498570016f admin admin] PATH_INFO: `/v3/projects/db38733f1e7c4074b8cb065f2b6ca0fa` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:40.827861 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69a69f-2e46-40fc-9b66-10498570016f admin admin] RBAC: Authorizing `identity:delete_project(project_id=db38733f1e7c4074b8cb065f2b6ca0fa)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:40.829983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69a69f-2e46-40fc-9b66-10498570016f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:40.884834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4e69a69f-2e46-40fc-9b66-10498570016f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db38733f1e7c4074b8cb065f2b6ca0fa', 'request_id': 'req-4e69a69f-2e46-40fc-9b66-10498570016f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:40.900888 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4e69a69f-2e46-40fc-9b66-10498570016f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db38733f1e7c4074b8cb065f2b6ca0fa', 'request_id': 'req-4e69a69f-2e46-40fc-9b66-10498570016f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:40.907725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4e69a69f-2e46-40fc-9b66-10498570016f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db38733f1e7c4074b8cb065f2b6ca0fa', 'request_id': 'req-4e69a69f-2e46-40fc-9b66-10498570016f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:40.928048 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4e69a69f-2e46-40fc-9b66-10498570016f admin admin] The token cache is being invalidate because project db38733f1e7c4074b8cb065f2b6ca0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:40.928441 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4e69a69f-2e46-40fc-9b66-10498570016f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:40.929552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4e69a69f-2e46-40fc-9b66-10498570016f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:40.931394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 941/1873] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:40 2022] DELETE /identity/v3/projects/db38733f1e7c4074b8cb065f2b6ca0fa => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:40.936634 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962581e-0252-4046-8ec2-34af38cea537 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:40.937154 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962581e-0252-4046-8ec2-34af38cea537 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:40.937258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962581e-0252-4046-8ec2-34af38cea537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:40.958614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2962581e-0252-4046-8ec2-34af38cea537 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:40.959985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2962581e-0252-4046-8ec2-34af38cea537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:41.100299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 933/1874] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:16:41.103742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a95a-1f5d-4ccc-8644-de16ecddf71b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:41.104567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a95a-1f5d-4ccc-8644-de16ecddf71b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:41.105081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a95a-1f5d-4ccc-8644-de16ecddf71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:41.176081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ff41a95a-1f5d-4ccc-8644-de16ecddf71b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:41.200683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ff41a95a-1f5d-4ccc-8644-de16ecddf71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:41.247243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 942/1875] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:41.252552 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962581e-0252-4046-8ec2-34af38cea537 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:41.286822 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962581e-0252-4046-8ec2-34af38cea537 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:41.303445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcab53a-60a0-4c58-87fb-2cb0f58cab45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:41.305938 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcab53a-60a0-4c58-87fb-2cb0f58cab45 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:41.306328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcab53a-60a0-4c58-87fb-2cb0f58cab45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:41.306868 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcab53a-60a0-4c58-87fb-2cb0f58cab45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:41.308545 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcab53a-60a0-4c58-87fb-2cb0f58cab45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:16:41.310311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcab53a-60a0-4c58-87fb-2cb0f58cab45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:41.312810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcab53a-60a0-4c58-87fb-2cb0f58cab45 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:41.344443 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41a95a-1f5d-4ccc-8644-de16ecddf71b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:41.346246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 934/1876] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:16:41.366385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41a95a-1f5d-4ccc-8644-de16ecddf71b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:41.415279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053ec4c-9856-4b76-a2b3-9c86130b88df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:41.418934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053ec4c-9856-4b76-a2b3-9c86130b88df admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:41.420839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053ec4c-9856-4b76-a2b3-9c86130b88df admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:41.421171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053ec4c-9856-4b76-a2b3-9c86130b88df admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:41.425712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053ec4c-9856-4b76-a2b3-9c86130b88df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:41.433553 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053ec4c-9856-4b76-a2b3-9c86130b88df admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:41.513938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 943/1877] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:41 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:41.518241 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcab53a-60a0-4c58-87fb-2cb0f58cab45 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:41.542498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcab53a-60a0-4c58-87fb-2cb0f58cab45 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:41.645633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:41.688366 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a29a68-cabb-40c1-8e78-ca6aa27ae1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:41.689216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a29a68-cabb-40c1-8e78-ca6aa27ae1cf admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:41.690056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a29a68-cabb-40c1-8e78-ca6aa27ae1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:41.690509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a29a68-cabb-40c1-8e78-ca6aa27ae1cf admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:41.692050 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a29a68-cabb-40c1-8e78-ca6aa27ae1cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:41.696098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a29a68-cabb-40c1-8e78-ca6aa27ae1cf admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:41.739498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 935/1878] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:41 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:16:41.743413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053ec4c-9856-4b76-a2b3-9c86130b88df admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:41.755273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053ec4c-9856-4b76-a2b3-9c86130b88df admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:41.762380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e9497-8f06-4c4a-a711-cf324f646c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:41.763860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e9497-8f06-4c4a-a711-cf324f646c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:41.764355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e9497-8f06-4c4a-a711-cf324f646c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:41.765119 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e9497-8f06-4c4a-a711-cf324f646c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:41.766824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e9497-8f06-4c4a-a711-cf324f646c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:41.770282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e9497-8f06-4c4a-a711-cf324f646c6d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:41.795501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 944/1879] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:41.801883 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a29a68-cabb-40c1-8e78-ca6aa27ae1cf admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:41.815334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a29a68-cabb-40c1-8e78-ca6aa27ae1cf admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:41.821544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecb745-59e3-4798-9337-eba6cdb9f5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:41.822239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecb745-59e3-4798-9337-eba6cdb9f5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:41.822584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecb745-59e3-4798-9337-eba6cdb9f5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:41.823116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecb745-59e3-4798-9337-eba6cdb9f5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:41.823961 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecb745-59e3-4798-9337-eba6cdb9f5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:41.825737 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecb745-59e3-4798-9337-eba6cdb9f5a0 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:41.839139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 936/1880] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:41.843465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e9497-8f06-4c4a-a711-cf324f646c6d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:41.851802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:41.857931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e9497-8f06-4c4a-a711-cf324f646c6d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:41.880466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fa6e3-dd69-42c4-b79c-f3b39d783f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:41.882070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fa6e3-dd69-42c4-b79c-f3b39d783f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:41.882778 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fa6e3-dd69-42c4-b79c-f3b39d783f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:41.883247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fa6e3-dd69-42c4-b79c-f3b39d783f38 admin admin] PATH_INFO: `/v3/projects/9ad529b31e5347d8a1a3b158766393dd/users/3131b7d6a2574adcb05c40adea19ae7b/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:41.908656 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fa6e3-dd69-42c4-b79c-f3b39d783f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad529b31e5347d8a1a3b158766393dd, user_id=3131b7d6a2574adcb05c40adea19ae7b, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:41.915620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fa6e3-dd69-42c4-b79c-f3b39d783f38 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:41.943736 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 945/1881] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:41 2022] PUT /identity/v3/projects/9ad529b31e5347d8a1a3b158766393dd/users/3131b7d6a2574adcb05c40adea19ae7b/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:41.962246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91978c21-789e-4a1c-8e01-a657897371ba None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:41.963130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91978c21-789e-4a1c-8e01-a657897371ba None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:41.963687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91978c21-789e-4a1c-8e01-a657897371ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:42.007820 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-91978c21-789e-4a1c-8e01-a657897371ba None None] MFA Rules not processed for user `3131b7d6a2574adcb05c40adea19ae7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:42.009089 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-91978c21-789e-4a1c-8e01-a657897371ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:42.104949 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 937/1882] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:42.109124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fa6e3-dd69-42c4-b79c-f3b39d783f38 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:42.208169 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fa6e3-dd69-42c4-b79c-f3b39d783f38 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:42.215548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf23f1a-9331-4fc2-8343-cdd53e4bad0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:42.217934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf23f1a-9331-4fc2-8343-cdd53e4bad0d admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:42.218379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf23f1a-9331-4fc2-8343-cdd53e4bad0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:42.218379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf23f1a-9331-4fc2-8343-cdd53e4bad0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:42.223255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf23f1a-9331-4fc2-8343-cdd53e4bad0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:42.225284 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf23f1a-9331-4fc2-8343-cdd53e4bad0d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:42.288845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 946/1883] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:42 2022] POST /identity/v3/projects => generated 389 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:16:42.293754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91978c21-789e-4a1c-8e01-a657897371ba None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:42.306356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91978c21-789e-4a1c-8e01-a657897371ba None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:42.394069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14351b16-ad98-49fd-ba35-b229130703e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:42.395159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14351b16-ad98-49fd-ba35-b229130703e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:42.395801 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14351b16-ad98-49fd-ba35-b229130703e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:42.396236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14351b16-ad98-49fd-ba35-b229130703e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:42.397215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14351b16-ad98-49fd-ba35-b229130703e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:42.399402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14351b16-ad98-49fd-ba35-b229130703e2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:42.427278 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 938/1884] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:42 2022] POST /identity/v3/users => generated 301 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:42.431991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf23f1a-9331-4fc2-8343-cdd53e4bad0d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:42.446456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf23f1a-9331-4fc2-8343-cdd53e4bad0d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:42.456524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8efc50-474f-4e13-afe0-8693f34b35f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:42.457421 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8efc50-474f-4e13-afe0-8693f34b35f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:42.458582 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8efc50-474f-4e13-afe0-8693f34b35f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:42.458876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8efc50-474f-4e13-afe0-8693f34b35f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:42.460101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8efc50-474f-4e13-afe0-8693f34b35f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:42.463231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8efc50-474f-4e13-afe0-8693f34b35f9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:42.487111 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 947/1885] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:42.488439 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14351b16-ad98-49fd-ba35-b229130703e2 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:42.501559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14351b16-ad98-49fd-ba35-b229130703e2 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:42.508285 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8213f1-c847-4cb5-be33-25eb6a7cccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:42.509472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8213f1-c847-4cb5-be33-25eb6a7cccef admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:42.509856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8213f1-c847-4cb5-be33-25eb6a7cccef admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:42.511043 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8213f1-c847-4cb5-be33-25eb6a7cccef admin admin] PATH_INFO: `/v3/projects/67c282fcf180407284547ec9864f75d8/users/9246aea7c7214d78bf2cd126e01ca034/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:42.532920 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8213f1-c847-4cb5-be33-25eb6a7cccef admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c282fcf180407284547ec9864f75d8, user_id=9246aea7c7214d78bf2cd126e01ca034, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:42.536026 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8213f1-c847-4cb5-be33-25eb6a7cccef admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:42.567713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 939/1886] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:42 2022] PUT /identity/v3/projects/67c282fcf180407284547ec9864f75d8/users/9246aea7c7214d78bf2cd126e01ca034/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:42.569644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8efc50-474f-4e13-afe0-8693f34b35f9 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:42.612808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8efc50-474f-4e13-afe0-8693f34b35f9 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:42.707464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31d343-9f20-4381-90c7-3a9e78c6f93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:42.708045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31d343-9f20-4381-90c7-3a9e78c6f93e admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:42.708211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31d343-9f20-4381-90c7-3a9e78c6f93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:42.708460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31d343-9f20-4381-90c7-3a9e78c6f93e admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:42.709214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31d343-9f20-4381-90c7-3a9e78c6f93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:42.710881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31d343-9f20-4381-90c7-3a9e78c6f93e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:42.722293 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 948/1887] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:16:42.728181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8213f1-c847-4cb5-be33-25eb6a7cccef admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:42.745152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8213f1-c847-4cb5-be33-25eb6a7cccef admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:42.750711 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b2cc3-0ac0-4bdf-9a3f-2d08fe5e2ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:42.751741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2cc3-0ac0-4bdf-9a3f-2d08fe5e2ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:42.752238 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2cc3-0ac0-4bdf-9a3f-2d08fe5e2ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:42.752554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2cc3-0ac0-4bdf-9a3f-2d08fe5e2ce1 admin admin] PATH_INFO: `/v3/projects/67c282fcf180407284547ec9864f75d8/users/9246aea7c7214d78bf2cd126e01ca034/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:42.754832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b2cc3-0ac0-4bdf-9a3f-2d08fe5e2ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c282fcf180407284547ec9864f75d8, user_id=9246aea7c7214d78bf2cd126e01ca034, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:42.758277 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b2cc3-0ac0-4bdf-9a3f-2d08fe5e2ce1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:42.765165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:42.772344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 940/1888] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:42 2022] PUT /identity/v3/projects/67c282fcf180407284547ec9864f75d8/users/9246aea7c7214d78bf2cd126e01ca034/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:42.784909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e69a-7e6b-4fad-bf73-3950bdb16a45 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:42.785777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e69a-7e6b-4fad-bf73-3950bdb16a45 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:42.785777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e69a-7e6b-4fad-bf73-3950bdb16a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:42.836664 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0a85e69a-7e6b-4fad-bf73-3950bdb16a45 None None] MFA Rules not processed for user `9246aea7c7214d78bf2cd126e01ca034`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:42.841814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0a85e69a-7e6b-4fad-bf73-3950bdb16a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:42.947781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:43.043442 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 949/1889] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:43.126067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b2cc3-0ac0-4bdf-9a3f-2d08fe5e2ce1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:43.128234 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d46b2cc3-0ac0-4bdf-9a3f-2d08fe5e2ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:43.283869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b2cc3-0ac0-4bdf-9a3f-2d08fe5e2ce1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:43.296102 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d89a-8e0e-45d4-bfc9-9c5026274ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:43.297540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d89a-8e0e-45d4-bfc9-9c5026274ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:43.298956 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d89a-8e0e-45d4-bfc9-9c5026274ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:43.299503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d89a-8e0e-45d4-bfc9-9c5026274ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:43.319825 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02d89a-8e0e-45d4-bfc9-9c5026274ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:43.321455 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02d89a-8e0e-45d4-bfc9-9c5026274ba9 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:43.335686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 941/1890] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:43.550835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85e69a-7e6b-4fad-bf73-3950bdb16a45 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:43.663734 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85e69a-7e6b-4fad-bf73-3950bdb16a45 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:43.674246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a43d98-3df2-440b-aa08-dd1e3cffc395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:43.676184 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a43d98-3df2-440b-aa08-dd1e3cffc395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:43.676766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a43d98-3df2-440b-aa08-dd1e3cffc395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:43.677328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a43d98-3df2-440b-aa08-dd1e3cffc395 admin admin] PATH_INFO: `/v3/users/3131b7d6a2574adcb05c40adea19ae7b` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:43.680071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a43d98-3df2-440b-aa08-dd1e3cffc395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3131b7d6a2574adcb05c40adea19ae7b)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:43.683941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a43d98-3df2-440b-aa08-dd1e3cffc395 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:43.778856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a1a43d98-3df2-440b-aa08-dd1e3cffc395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3131b7d6a2574adcb05c40adea19ae7b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:43.794760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a1a43d98-3df2-440b-aa08-dd1e3cffc395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3131b7d6a2574adcb05c40adea19ae7b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:43.796107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a1a43d98-3df2-440b-aa08-dd1e3cffc395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3131b7d6a2574adcb05c40adea19ae7b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:43.839016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a1a43d98-3df2-440b-aa08-dd1e3cffc395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3131b7d6a2574adcb05c40adea19ae7b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:43.842038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a1a43d98-3df2-440b-aa08-dd1e3cffc395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3131b7d6a2574adcb05c40adea19ae7b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:43.874786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 950/1891] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:43 2022] DELETE /identity/v3/users/3131b7d6a2574adcb05c40adea19ae7b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:43.880536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0778d-7245-4f5b-aef3-e6fb9930a3f2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:43.881721 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0778d-7245-4f5b-aef3-e6fb9930a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:43.883628 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0778d-7245-4f5b-aef3-e6fb9930a3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:43.922168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1fa0778d-7245-4f5b-aef3-e6fb9930a3f2 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:43.925344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1fa0778d-7245-4f5b-aef3-e6fb9930a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:44.033853 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 942/1892] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:44.055497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a43d98-3df2-440b-aa08-dd1e3cffc395 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:44.057394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a1a43d98-3df2-440b-aa08-dd1e3cffc395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:44.132047 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a43d98-3df2-440b-aa08-dd1e3cffc395 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:44.139411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac206f-86cb-4a1a-ab3f-981d48489a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:44.140930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac206f-86cb-4a1a-ab3f-981d48489a9a service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:44.141433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac206f-86cb-4a1a-ab3f-981d48489a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:44.141964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac206f-86cb-4a1a-ab3f-981d48489a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:44.160666 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac206f-86cb-4a1a-ab3f-981d48489a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:44.163560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac206f-86cb-4a1a-ab3f-981d48489a9a service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:44.172000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:44.183683 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 951/1893] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:16:44.686424 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0778d-7245-4f5b-aef3-e6fb9930a3f2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:44.689069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1fa0778d-7245-4f5b-aef3-e6fb9930a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:44.716530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0778d-7245-4f5b-aef3-e6fb9930a3f2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:44.727694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b3d62-06d4-434c-8155-10f0b2e6488c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:44.730039 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b3d62-06d4-434c-8155-10f0b2e6488c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:44.730705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b3d62-06d4-434c-8155-10f0b2e6488c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:44.731343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b3d62-06d4-434c-8155-10f0b2e6488c admin admin] PATH_INFO: `/v3/users/adb13ac733b14c7fbc69001f19d1bf25` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:44.734120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b3d62-06d4-434c-8155-10f0b2e6488c admin admin] RBAC: Authorizing `identity:delete_user(user_id=adb13ac733b14c7fbc69001f19d1bf25)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:44.738874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b3d62-06d4-434c-8155-10f0b2e6488c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:44.875018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac206f-86cb-4a1a-ab3f-981d48489a9a service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:44.877799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d0ac206f-86cb-4a1a-ab3f-981d48489a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:44.903403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-382b3d62-06d4-434c-8155-10f0b2e6488c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb13ac733b14c7fbc69001f19d1bf25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:44.904844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-382b3d62-06d4-434c-8155-10f0b2e6488c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb13ac733b14c7fbc69001f19d1bf25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:44.922575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac206f-86cb-4a1a-ab3f-981d48489a9a service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:44.939816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-382b3d62-06d4-434c-8155-10f0b2e6488c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb13ac733b14c7fbc69001f19d1bf25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:44.940400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:44.942133 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:44.942597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:44.944346 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] PATH_INFO: `/v3/projects/9ad529b31e5347d8a1a3b158766393dd` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:44.948108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad529b31e5347d8a1a3b158766393dd)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:44.952651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:44.954687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-382b3d62-06d4-434c-8155-10f0b2e6488c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb13ac733b14c7fbc69001f19d1bf25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:44.955999 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-382b3d62-06d4-434c-8155-10f0b2e6488c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb13ac733b14c7fbc69001f19d1bf25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:44.986910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 943/1894] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:44 2022] DELETE /identity/v3/users/adb13ac733b14c7fbc69001f19d1bf25 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:44.993708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203c8aa-89f0-4fa3-93b8-328709c0e69d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:44.994441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203c8aa-89f0-4fa3-93b8-328709c0e69d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:44.995350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203c8aa-89f0-4fa3-93b8-328709c0e69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:45.034843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3203c8aa-89f0-4fa3-93b8-328709c0e69d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:45.037114 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3203c8aa-89f0-4fa3-93b8-328709c0e69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:45.054308 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:45.069499 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad529b31e5347d8a1a3b158766393dd', 'request_id': 'req-d0165060-96ef-444e-b946-fe0872d765ab'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:45.082700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad529b31e5347d8a1a3b158766393dd', 'request_id': 'req-d0165060-96ef-444e-b946-fe0872d765ab'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:45.092493 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad529b31e5347d8a1a3b158766393dd', 'request_id': 'req-d0165060-96ef-444e-b946-fe0872d765ab'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:45.150403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] The token cache is being invalidate because project 9ad529b31e5347d8a1a3b158766393dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:45.151141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:45.152461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:45.155896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 952/1895] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:44 2022] DELETE /identity/v3/projects/9ad529b31e5347d8a1a3b158766393dd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:45.162219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:45.169416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:45.229394 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 944/1896] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:16:45.258729 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203c8aa-89f0-4fa3-93b8-328709c0e69d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:45.264175 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3203c8aa-89f0-4fa3-93b8-328709c0e69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:45.481353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203c8aa-89f0-4fa3-93b8-328709c0e69d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:45.495718 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0165060-96ef-444e-b946-fe0872d765ab admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:45.497386 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dba94-33c0-4895-a792-c1776fcb2f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:45.498973 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dba94-33c0-4895-a792-c1776fcb2f6e service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:45.499536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dba94-33c0-4895-a792-c1776fcb2f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:45.500283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dba94-33c0-4895-a792-c1776fcb2f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:45.502064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f333a85-73be-4642-b7f7-5921211453da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:45.503357 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f333a85-73be-4642-b7f7-5921211453da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:45.503644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f333a85-73be-4642-b7f7-5921211453da admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:45.503922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f333a85-73be-4642-b7f7-5921211453da admin admin] PATH_INFO: `/v3/users/9246aea7c7214d78bf2cd126e01ca034` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:45.505515 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f333a85-73be-4642-b7f7-5921211453da admin admin] RBAC: Authorizing `identity:delete_user(user_id=9246aea7c7214d78bf2cd126e01ca034)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:45.507679 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f333a85-73be-4642-b7f7-5921211453da admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:45.520632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dba94-33c0-4895-a792-c1776fcb2f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:45.523182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dba94-33c0-4895-a792-c1776fcb2f6e service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:45.544658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 945/1897] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:45.602232 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3f333a85-73be-4642-b7f7-5921211453da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9246aea7c7214d78bf2cd126e01ca034'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:45.613165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3f333a85-73be-4642-b7f7-5921211453da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9246aea7c7214d78bf2cd126e01ca034'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:45.629749 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3f333a85-73be-4642-b7f7-5921211453da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9246aea7c7214d78bf2cd126e01ca034'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:45.675320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3f333a85-73be-4642-b7f7-5921211453da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9246aea7c7214d78bf2cd126e01ca034'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:45.676400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3f333a85-73be-4642-b7f7-5921211453da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9246aea7c7214d78bf2cd126e01ca034'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:45.698679 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:45.712645 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 953/1898] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:45 2022] DELETE /identity/v3/users/9246aea7c7214d78bf2cd126e01ca034 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:16:46.435324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dba94-33c0-4895-a792-c1776fcb2f6e service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:46.437570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c75dba94-33c0-4895-a792-c1776fcb2f6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:46.487209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dba94-33c0-4895-a792-c1776fcb2f6e service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:46.596334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:46.596334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:46.596334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:46.596334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] PATH_INFO: `/v3/projects/5218b2df6eac4b28a542d109c3134ec9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:46.599080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5218b2df6eac4b28a542d109c3134ec9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:46.601257 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:46.688868 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5218b2df6eac4b28a542d109c3134ec9', 'request_id': 'req-75df5956-9e72-4fb3-91b4-b8f79f01190c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:46.707818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5218b2df6eac4b28a542d109c3134ec9', 'request_id': 'req-75df5956-9e72-4fb3-91b4-b8f79f01190c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:46.716023 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:46.724604 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5218b2df6eac4b28a542d109c3134ec9', 'request_id': 'req-75df5956-9e72-4fb3-91b4-b8f79f01190c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:46.750930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] The token cache is being invalidate because project 5218b2df6eac4b28a542d109c3134ec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:46.750930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:46.752538 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:46.755827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 946/1899] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:46 2022] DELETE /identity/v3/projects/5218b2df6eac4b28a542d109c3134ec9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:46.762065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f333a85-73be-4642-b7f7-5921211453da admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:46.764383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3f333a85-73be-4642-b7f7-5921211453da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:46.802796 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f333a85-73be-4642-b7f7-5921211453da admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:46.943191 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f05a24-2816-423f-98d9-38ff997ad6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:46.944814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f05a24-2816-423f-98d9-38ff997ad6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:46.945477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f05a24-2816-423f-98d9-38ff997ad6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:46.946078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f05a24-2816-423f-98d9-38ff997ad6dc admin admin] PATH_INFO: `/v3/users/093204c79666412fbf3c65946b3fca86` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:46.948558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f05a24-2816-423f-98d9-38ff997ad6dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=093204c79666412fbf3c65946b3fca86)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:46.953075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f05a24-2816-423f-98d9-38ff997ad6dc admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:47.062723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-51f05a24-2816-423f-98d9-38ff997ad6dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093204c79666412fbf3c65946b3fca86'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:47.073133 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-51f05a24-2816-423f-98d9-38ff997ad6dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093204c79666412fbf3c65946b3fca86'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:47.073904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-51f05a24-2816-423f-98d9-38ff997ad6dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093204c79666412fbf3c65946b3fca86'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:47.090965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-51f05a24-2816-423f-98d9-38ff997ad6dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093204c79666412fbf3c65946b3fca86'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:47.091950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-51f05a24-2816-423f-98d9-38ff997ad6dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093204c79666412fbf3c65946b3fca86'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:47.116523 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 954/1900] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:46 2022] DELETE /identity/v3/users/093204c79666412fbf3c65946b3fca86 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:47.520981 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:47.520981 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:47.545605 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df5956-9e72-4fb3-91b4-b8f79f01190c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:47.702302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:47.703788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:47.704191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:47.704598 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd admin admin] PATH_INFO: `/v3/projects/67c282fcf180407284547ec9864f75d8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:47.706346 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c282fcf180407284547ec9864f75d8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:47.708667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:47.817261 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c282fcf180407284547ec9864f75d8', 'request_id': 'req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:47.837645 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c282fcf180407284547ec9864f75d8', 'request_id': 'req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:47.857200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c282fcf180407284547ec9864f75d8', 'request_id': 'req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:47.892823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd admin admin] The token cache is being invalidate because project 67c282fcf180407284547ec9864f75d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:47.893686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:47.895124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-096d7d69-9c9a-4b5c-972d-eda85cf76dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:47.905005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 947/1901] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:47 2022] DELETE /identity/v3/projects/67c282fcf180407284547ec9864f75d8 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:47.906918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbe4b1-6071-437a-80ca-1fb1d17512ad None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:47.907837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbe4b1-6071-437a-80ca-1fb1d17512ad None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:47.908278 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbe4b1-6071-437a-80ca-1fb1d17512ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:47.952785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8bfbe4b1-6071-437a-80ca-1fb1d17512ad None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:47.955963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8bfbe4b1-6071-437a-80ca-1fb1d17512ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:48.090381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 955/1902] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:48.105281 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2758cc-7570-4d49-9a67-ac70ed95a0de None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:48.111214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2758cc-7570-4d49-9a67-ac70ed95a0de None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:48.112297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2758cc-7570-4d49-9a67-ac70ed95a0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:48.179705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ed2758cc-7570-4d49-9a67-ac70ed95a0de None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:48.186827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ed2758cc-7570-4d49-9a67-ac70ed95a0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:48.230745 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbe4b1-6071-437a-80ca-1fb1d17512ad None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:48.241386 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 948/1903] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:48.264364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbe4b1-6071-437a-80ca-1fb1d17512ad None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:48.274133 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7420f-3183-40ce-a54f-72e1c2f64ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:48.289453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7420f-3183-40ce-a54f-72e1c2f64ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:48.289969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7420f-3183-40ce-a54f-72e1c2f64ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:48.294641 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7420f-3183-40ce-a54f-72e1c2f64ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:48.296291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7420f-3183-40ce-a54f-72e1c2f64ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:16:48.296860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7420f-3183-40ce-a54f-72e1c2f64ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:48.301048 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7420f-3183-40ce-a54f-72e1c2f64ad5 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:48.335235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2758cc-7570-4d49-9a67-ac70ed95a0de None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:48.344158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 956/1904] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:16:48.356602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7420f-3183-40ce-a54f-72e1c2f64ad5 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:48.359638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6ff7420f-3183-40ce-a54f-72e1c2f64ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:48.365340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2758cc-7570-4d49-9a67-ac70ed95a0de None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:48.409905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c60881-8e61-42bf-b593-4832dba5cd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:48.410281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7420f-3183-40ce-a54f-72e1c2f64ad5 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:48.412130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c60881-8e61-42bf-b593-4832dba5cd31 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:48.412790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c60881-8e61-42bf-b593-4832dba5cd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:48.413367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c60881-8e61-42bf-b593-4832dba5cd31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:48.415651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c60881-8e61-42bf-b593-4832dba5cd31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:48.416838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c2416-81b9-455e-9d8d-5827c9283318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:48.420038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c2416-81b9-455e-9d8d-5827c9283318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:48.420382 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c2416-81b9-455e-9d8d-5827c9283318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:48.420672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c2416-81b9-455e-9d8d-5827c9283318 admin admin] PATH_INFO: `/v3/projects/56670fcffdd347c8982ddbca2d98cfff` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:48.422140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c2416-81b9-455e-9d8d-5827c9283318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56670fcffdd347c8982ddbca2d98cfff)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:48.424217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c60881-8e61-42bf-b593-4832dba5cd31 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:48.424394 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c2416-81b9-455e-9d8d-5827c9283318 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:48.428022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:48.495830 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 949/1905] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:48 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:48.497104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c60881-8e61-42bf-b593-4832dba5cd31 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:48.511247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-657c2416-81b9-455e-9d8d-5827c9283318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56670fcffdd347c8982ddbca2d98cfff', 'request_id': 'req-657c2416-81b9-455e-9d8d-5827c9283318'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:48.522416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-657c2416-81b9-455e-9d8d-5827c9283318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56670fcffdd347c8982ddbca2d98cfff', 'request_id': 'req-657c2416-81b9-455e-9d8d-5827c9283318'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:48.534307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-657c2416-81b9-455e-9d8d-5827c9283318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56670fcffdd347c8982ddbca2d98cfff', 'request_id': 'req-657c2416-81b9-455e-9d8d-5827c9283318'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:48.556100 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-657c2416-81b9-455e-9d8d-5827c9283318 admin admin] The token cache is being invalidate because project 56670fcffdd347c8982ddbca2d98cfff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:48.556482 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-657c2416-81b9-455e-9d8d-5827c9283318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:48.557197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-657c2416-81b9-455e-9d8d-5827c9283318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:48.562456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 957/1906] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:48 2022] DELETE /identity/v3/projects/56670fcffdd347c8982ddbca2d98cfff => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:48.564345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bc282-702e-40f7-b582-9208b825d5e4 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:48.564637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bc282-702e-40f7-b582-9208b825d5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:48.564912 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bc282-702e-40f7-b582-9208b825d5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:48.575402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:48.595096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f97bc282-702e-40f7-b582-9208b825d5e4 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:48.596505 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f97bc282-702e-40f7-b582-9208b825d5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:48.597311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c60881-8e61-42bf-b593-4832dba5cd31 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:48.721859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4cbc0-5490-4389-8229-c1113f9a4195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:48.723595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 958/1907] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:48.724271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4cbc0-5490-4389-8229-c1113f9a4195 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:48.725103 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4cbc0-5490-4389-8229-c1113f9a4195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:48.725590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4cbc0-5490-4389-8229-c1113f9a4195 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:48.727652 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4cbc0-5490-4389-8229-c1113f9a4195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:48.731609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4cbc0-5490-4389-8229-c1113f9a4195 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:48.736152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8f571-dd45-43de-a085-5b49d75e3657 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:48.736451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8f571-dd45-43de-a085-5b49d75e3657 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:48.736726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8f571-dd45-43de-a085-5b49d75e3657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:48.766075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c3e8f571-dd45-43de-a085-5b49d75e3657 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:48.767722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c3e8f571-dd45-43de-a085-5b49d75e3657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:48.770562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 950/1908] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:48 2022] POST /identity/v3/users => generated 289 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:48.777320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4cbc0-5490-4389-8229-c1113f9a4195 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:48.784152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d0b4cbc0-5490-4389-8229-c1113f9a4195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:48.798960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 959/1909] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:16:48.807126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8f571-dd45-43de-a085-5b49d75e3657 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:48.807588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4cbc0-5490-4389-8229-c1113f9a4195 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:48.819334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0a153-29c1-45fe-8148-36b227ecfe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:48.820662 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0a153-29c1-45fe-8148-36b227ecfe2b admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:48.821634 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0a153-29c1-45fe-8148-36b227ecfe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:48.822290 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0a153-29c1-45fe-8148-36b227ecfe2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:48.831350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0a153-29c1-45fe-8148-36b227ecfe2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:48.831664 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8f571-dd45-43de-a085-5b49d75e3657 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:48.833988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0a153-29c1-45fe-8148-36b227ecfe2b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:48.852131 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340976c-5373-45eb-ba24-134922128da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:48.853345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340976c-5373-45eb-ba24-134922128da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:48.854355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340976c-5373-45eb-ba24-134922128da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:48.854950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340976c-5373-45eb-ba24-134922128da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:48.856124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 951/1910] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:48.861294 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0a153-29c1-45fe-8148-36b227ecfe2b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:48.861671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340976c-5373-45eb-ba24-134922128da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:16:48.862571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340976c-5373-45eb-ba24-134922128da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:48.866630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340976c-5373-45eb-ba24-134922128da3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:48.891936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0a153-29c1-45fe-8148-36b227ecfe2b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:48.897966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 960/1911] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:16:48.904926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340976c-5373-45eb-ba24-134922128da3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:48.910266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a80ed7-da38-4347-b9c7-46de6de4be58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:48.911544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a80ed7-da38-4347-b9c7-46de6de4be58 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:48.912028 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a80ed7-da38-4347-b9c7-46de6de4be58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:48.912537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a80ed7-da38-4347-b9c7-46de6de4be58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:48.914178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a80ed7-da38-4347-b9c7-46de6de4be58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:48.917250 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a80ed7-da38-4347-b9c7-46de6de4be58 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:48.940754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 952/1912] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:48.944674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340976c-5373-45eb-ba24-134922128da3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:48.945787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a80ed7-da38-4347-b9c7-46de6de4be58 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:48.953507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af0862-c666-4272-be6e-2850e3d5f824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:48.954680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af0862-c666-4272-be6e-2850e3d5f824 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:48.955161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af0862-c666-4272-be6e-2850e3d5f824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:48.955615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af0862-c666-4272-be6e-2850e3d5f824 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:48.957391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af0862-c666-4272-be6e-2850e3d5f824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:48.961266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af0862-c666-4272-be6e-2850e3d5f824 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:48.965376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a80ed7-da38-4347-b9c7-46de6de4be58 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:48.975243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef47de-3414-46b7-94a4-f4426ef137d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:48.976791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef47de-3414-46b7-94a4-f4426ef137d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:48.977242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef47de-3414-46b7-94a4-f4426ef137d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:48.977702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef47de-3414-46b7-94a4-f4426ef137d7 admin admin] PATH_INFO: `/v3/projects/2762e4fd6a6b48eeb14e019dee362250/users/9264f5ddbafd40488ff810c87739330e/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:49.025693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef47de-3414-46b7-94a4-f4426ef137d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2762e4fd6a6b48eeb14e019dee362250, user_id=9264f5ddbafd40488ff810c87739330e, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:49.031193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef47de-3414-46b7-94a4-f4426ef137d7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:49.038426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 961/1913] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:48 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:16:49.044605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af0862-c666-4272-be6e-2850e3d5f824 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:49.060752 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 953/1914] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:48 2022] PUT /identity/v3/projects/2762e4fd6a6b48eeb14e019dee362250/users/9264f5ddbafd40488ff810c87739330e/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:16:49.085766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1a4b-c38b-48ac-89c5-6eb57f182e1f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:49.086299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1a4b-c38b-48ac-89c5-6eb57f182e1f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:49.086736 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1a4b-c38b-48ac-89c5-6eb57f182e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:49.149996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1a5c1a4b-c38b-48ac-89c5-6eb57f182e1f None None] MFA Rules not processed for user `9264f5ddbafd40488ff810c87739330e`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:49.152144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1a5c1a4b-c38b-48ac-89c5-6eb57f182e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:49.219667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:49.280112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af0862-c666-4272-be6e-2850e3d5f824 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:49.330496 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 954/1915] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:16:49.335742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c1a4b-c38b-48ac-89c5-6eb57f182e1f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:49.426066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:49.543235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c1a4b-c38b-48ac-89c5-6eb57f182e1f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:49.554900 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7aa8fb-ce8f-4818-be43-ca907e4adbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:49.556331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aa8fb-ce8f-4818-be43-ca907e4adbda admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:49.556908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aa8fb-ce8f-4818-be43-ca907e4adbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:49.558368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aa8fb-ce8f-4818-be43-ca907e4adbda admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:49.559730 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7aa8fb-ce8f-4818-be43-ca907e4adbda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:49.564603 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7aa8fb-ce8f-4818-be43-ca907e4adbda admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:49.578376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc7188-7acb-472a-8981-97721adf230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:49.579081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc7188-7acb-472a-8981-97721adf230d admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:49.580372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc7188-7acb-472a-8981-97721adf230d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:49.580372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc7188-7acb-472a-8981-97721adf230d admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:49.581240 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc7188-7acb-472a-8981-97721adf230d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:49.589245 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc7188-7acb-472a-8981-97721adf230d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:49.634447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 962/1916] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:49 2022] POST /identity/v3/users => generated 292 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:49.639701 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7aa8fb-ce8f-4818-be43-ca907e4adbda admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:49.653030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 955/1917] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:49 2022] POST /identity/v3/projects => generated 375 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:49.654283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc7188-7acb-472a-8981-97721adf230d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:49.709937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7aa8fb-ce8f-4818-be43-ca907e4adbda admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:49.745444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc7188-7acb-472a-8981-97721adf230d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:49.752311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed594a7-2f38-4220-82d7-fb51c7ed50cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:49.753126 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed594a7-2f38-4220-82d7-fb51c7ed50cc admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:49.753514 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed594a7-2f38-4220-82d7-fb51c7ed50cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:49.753903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed594a7-2f38-4220-82d7-fb51c7ed50cc admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:49.754890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed594a7-2f38-4220-82d7-fb51c7ed50cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:49.757606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed594a7-2f38-4220-82d7-fb51c7ed50cc admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:49.804056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 956/1918] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:49 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:49.807958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed594a7-2f38-4220-82d7-fb51c7ed50cc admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:49.822136 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed594a7-2f38-4220-82d7-fb51c7ed50cc admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:49.827870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e2412-644b-4b28-a495-5567b0025d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:49.828634 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e2412-644b-4b28-a495-5567b0025d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:49.828923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e2412-644b-4b28-a495-5567b0025d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:49.829255 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e2412-644b-4b28-a495-5567b0025d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:49.830033 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e2412-644b-4b28-a495-5567b0025d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:49.832235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e2412-644b-4b28-a495-5567b0025d03 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:49.857292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 957/1919] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:49.861056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e2412-644b-4b28-a495-5567b0025d03 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:49.867923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c64bd5-53d8-46d1-b228-ae9d52b619c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:49.868644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c64bd5-53d8-46d1-b228-ae9d52b619c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:49.868932 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c64bd5-53d8-46d1-b228-ae9d52b619c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:49.869211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c64bd5-53d8-46d1-b228-ae9d52b619c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:49.869979 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c64bd5-53d8-46d1-b228-ae9d52b619c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:49.873784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c64bd5-53d8-46d1-b228-ae9d52b619c4 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:49.876835 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e2412-644b-4b28-a495-5567b0025d03 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:49.883086 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d07ba7-59fe-4c90-9102-ad49a40f073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:49.883957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d07ba7-59fe-4c90-9102-ad49a40f073e admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:49.884251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d07ba7-59fe-4c90-9102-ad49a40f073e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:49.884667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d07ba7-59fe-4c90-9102-ad49a40f073e admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:49.889718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d07ba7-59fe-4c90-9102-ad49a40f073e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:49.891606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d07ba7-59fe-4c90-9102-ad49a40f073e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:49.914588 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 963/1920] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:16:49.915997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c64bd5-53d8-46d1-b228-ae9d52b619c4 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:49.929441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 958/1921] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:49.931594 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c64bd5-53d8-46d1-b228-ae9d52b619c4 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:49.933143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d07ba7-59fe-4c90-9102-ad49a40f073e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:49.938388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eab46-3c6a-4cfc-8864-3b9c54c86bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:49.941000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eab46-3c6a-4cfc-8864-3b9c54c86bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:49.941441 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eab46-3c6a-4cfc-8864-3b9c54c86bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:49.941802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eab46-3c6a-4cfc-8864-3b9c54c86bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:49.943209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8eab46-3c6a-4cfc-8864-3b9c54c86bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:49.945170 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8eab46-3c6a-4cfc-8864-3b9c54c86bbd admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:49.966109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d07ba7-59fe-4c90-9102-ad49a40f073e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:49.968680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 964/1922] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:49.972470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eab46-3c6a-4cfc-8864-3b9c54c86bbd admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:49.980230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa9543-12f9-414c-89bf-5ab9765903c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:49.982164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa9543-12f9-414c-89bf-5ab9765903c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:49.985359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa9543-12f9-414c-89bf-5ab9765903c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:49.985944 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa9543-12f9-414c-89bf-5ab9765903c7 admin admin] PATH_INFO: `/v3/projects/f59bdc25fed3462680935f67b58ca13b/users/4f524cf368804af5a4c290bdcef1bd91/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:49.995362 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eab46-3c6a-4cfc-8864-3b9c54c86bbd admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:50.003088 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599e413-1dd0-4b84-842b-50f26ac11b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:50.005493 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599e413-1dd0-4b84-842b-50f26ac11b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:50.005851 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599e413-1dd0-4b84-842b-50f26ac11b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:50.006259 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599e413-1dd0-4b84-842b-50f26ac11b3d admin admin] PATH_INFO: `/v3/projects/72ebe7d53d3340d6bf0a97478203df98/users/e1b9a8ed3f97498cb424a36d3bdc597c/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:50.044707 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599e413-1dd0-4b84-842b-50f26ac11b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ebe7d53d3340d6bf0a97478203df98, user_id=e1b9a8ed3f97498cb424a36d3bdc597c, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:50.059918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599e413-1dd0-4b84-842b-50f26ac11b3d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:50.069140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa9543-12f9-414c-89bf-5ab9765903c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59bdc25fed3462680935f67b58ca13b, user_id=4f524cf368804af5a4c290bdcef1bd91, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:50.078698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa9543-12f9-414c-89bf-5ab9765903c7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:50.094851 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 965/1923] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:49 2022] PUT /identity/v3/projects/72ebe7d53d3340d6bf0a97478203df98/users/e1b9a8ed3f97498cb424a36d3bdc597c/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:50.102214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2142d-4177-466d-8466-7ed7ffba9fd2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:50.102214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2142d-4177-466d-8466-7ed7ffba9fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:50.102214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2142d-4177-466d-8466-7ed7ffba9fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:50.119945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 959/1924] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:49 2022] PUT /identity/v3/projects/f59bdc25fed3462680935f67b58ca13b/users/4f524cf368804af5a4c290bdcef1bd91/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:50.130590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d273d5b-5ad3-4e6a-862a-f30badf45c0b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:50.130917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d273d5b-5ad3-4e6a-862a-f30badf45c0b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:50.131267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d273d5b-5ad3-4e6a-862a-f30badf45c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:50.171786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d1c2142d-4177-466d-8466-7ed7ffba9fd2 None None] MFA Rules not processed for user `e1b9a8ed3f97498cb424a36d3bdc597c`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:50.174499 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d1c2142d-4177-466d-8466-7ed7ffba9fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:50.215905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2d273d5b-5ad3-4e6a-862a-f30badf45c0b None None] MFA Rules not processed for user `4f524cf368804af5a4c290bdcef1bd91`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:50.222017 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2d273d5b-5ad3-4e6a-862a-f30badf45c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:50.253977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:50.328447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 966/1925] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:50.332882 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2142d-4177-466d-8466-7ed7ffba9fd2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:50.363789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:50.419999 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 960/1926] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:50.423172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d273d5b-5ad3-4e6a-862a-f30badf45c0b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:50.446142 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2142d-4177-466d-8466-7ed7ffba9fd2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:50.452414 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f713f85-7b71-49f0-bc4a-a06844b0effd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:50.454314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f713f85-7b71-49f0-bc4a-a06844b0effd admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:50.454913 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f713f85-7b71-49f0-bc4a-a06844b0effd admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:50.455409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f713f85-7b71-49f0-bc4a-a06844b0effd admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:50.456393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f713f85-7b71-49f0-bc4a-a06844b0effd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:50.458625 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f713f85-7b71-49f0-bc4a-a06844b0effd admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:50.558108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 967/1927] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:50 2022] POST /identity/v3/projects => generated 383 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:16:50.560604 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f713f85-7b71-49f0-bc4a-a06844b0effd admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:50.771370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d273d5b-5ad3-4e6a-862a-f30badf45c0b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:50.815388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f713f85-7b71-49f0-bc4a-a06844b0effd admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:50.823633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16262d2-1d51-4cd4-acc1-9ce899232bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:50.824554 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16262d2-1d51-4cd4-acc1-9ce899232bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:50.824936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16262d2-1d51-4cd4-acc1-9ce899232bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:50.825546 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16262d2-1d51-4cd4-acc1-9ce899232bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:50.827321 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16262d2-1d51-4cd4-acc1-9ce899232bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:50.829935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16262d2-1d51-4cd4-acc1-9ce899232bc9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:50.873213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 968/1928] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:50 2022] POST /identity/v3/users => generated 298 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:50.874885 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16262d2-1d51-4cd4-acc1-9ce899232bc9 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:50.907380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16262d2-1d51-4cd4-acc1-9ce899232bc9 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:50.925194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec753d7f-ef98-4504-8632-7a1671bb2367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:50.926305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec753d7f-ef98-4504-8632-7a1671bb2367 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:50.926858 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec753d7f-ef98-4504-8632-7a1671bb2367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:50.927639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec753d7f-ef98-4504-8632-7a1671bb2367 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:50.929320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec753d7f-ef98-4504-8632-7a1671bb2367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:50.932887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec753d7f-ef98-4504-8632-7a1671bb2367 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:50.938216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0f3f7-f5f9-418a-a9c6-7f3aca894b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:50.943152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f3f7-f5f9-418a-a9c6-7f3aca894b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:50.943552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f3f7-f5f9-418a-a9c6-7f3aca894b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:50.944226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f3f7-f5f9-418a-a9c6-7f3aca894b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:50.945148 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0f3f7-f5f9-418a-a9c6-7f3aca894b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:50.954907 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0f3f7-f5f9-418a-a9c6-7f3aca894b8d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:50.965147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 969/1929] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:50.966260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0f3f7-f5f9-418a-a9c6-7f3aca894b8d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:50.978377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0f3f7-f5f9-418a-a9c6-7f3aca894b8d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:50.985267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47e85d-25ee-4e20-ae05-b7fe7b8365c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:50.986450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47e85d-25ee-4e20-ae05-b7fe7b8365c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:50.987059 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47e85d-25ee-4e20-ae05-b7fe7b8365c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:50.987329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47e85d-25ee-4e20-ae05-b7fe7b8365c0 admin admin] PATH_INFO: `/v3/projects/70f9296129974a0791bb0767fc9f43a8/users/5cc5145c238c43549a71a4e57b4ddabb/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:51.006825 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 961/1930] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:50 2022] POST /identity/v3/projects => generated 375 bytes in 585 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:51.009334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec753d7f-ef98-4504-8632-7a1671bb2367 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:51.029296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47e85d-25ee-4e20-ae05-b7fe7b8365c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f9296129974a0791bb0767fc9f43a8, user_id=5cc5145c238c43549a71a4e57b4ddabb, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:51.044403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47e85d-25ee-4e20-ae05-b7fe7b8365c0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:51.090606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 970/1931] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:50 2022] PUT /identity/v3/projects/70f9296129974a0791bb0767fc9f43a8/users/5cc5145c238c43549a71a4e57b4ddabb/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:51.093294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47e85d-25ee-4e20-ae05-b7fe7b8365c0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:51.160343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec753d7f-ef98-4504-8632-7a1671bb2367 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:51.170083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:51.200073 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:51.296737 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47e85d-25ee-4e20-ae05-b7fe7b8365c0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:51.300925 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c32312-977b-4e75-81d2-9d7a7e2d6c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:51.302530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c32312-977b-4e75-81d2-9d7a7e2d6c04 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:51.304078 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c32312-977b-4e75-81d2-9d7a7e2d6c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:51.304561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c32312-977b-4e75-81d2-9d7a7e2d6c04 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:51.306025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c32312-977b-4e75-81d2-9d7a7e2d6c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:51.310901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c32312-977b-4e75-81d2-9d7a7e2d6c04 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:51.311419 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78788bf7-abc8-4a6a-961b-b8da24136926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:51.313172 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78788bf7-abc8-4a6a-961b-b8da24136926 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:51.314326 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78788bf7-abc8-4a6a-961b-b8da24136926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:51.315033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78788bf7-abc8-4a6a-961b-b8da24136926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:51.318501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78788bf7-abc8-4a6a-961b-b8da24136926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:51.324052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78788bf7-abc8-4a6a-961b-b8da24136926 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:51.350437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 971/1932] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:51.355521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78788bf7-abc8-4a6a-961b-b8da24136926 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:51.367628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78788bf7-abc8-4a6a-961b-b8da24136926 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:51.374226 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 962/1933] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:51 2022] POST /identity/v3/users => generated 294 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:51.377424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65766e92-a117-4f96-8f2d-d5a5ee1b46e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:51.378885 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65766e92-a117-4f96-8f2d-d5a5ee1b46e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:51.379324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65766e92-a117-4f96-8f2d-d5a5ee1b46e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:51.379703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65766e92-a117-4f96-8f2d-d5a5ee1b46e7 admin admin] PATH_INFO: `/v3/projects/70f9296129974a0791bb0767fc9f43a8/users/5cc5145c238c43549a71a4e57b4ddabb/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:51.379862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c32312-977b-4e75-81d2-9d7a7e2d6c04 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:51.382393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65766e92-a117-4f96-8f2d-d5a5ee1b46e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f9296129974a0791bb0767fc9f43a8, user_id=5cc5145c238c43549a71a4e57b4ddabb, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:51.385372 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65766e92-a117-4f96-8f2d-d5a5ee1b46e7 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:51.396041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c32312-977b-4e75-81d2-9d7a7e2d6c04 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:51.398609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 972/1934] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:51 2022] PUT /identity/v3/projects/70f9296129974a0791bb0767fc9f43a8/users/5cc5145c238c43549a71a4e57b4ddabb/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:51.409216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d383c-88ff-454c-ae54-32dfd40637b2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:51.409825 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d383c-88ff-454c-ae54-32dfd40637b2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:51.409994 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d383c-88ff-454c-ae54-32dfd40637b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:51.451613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d24d383c-88ff-454c-ae54-32dfd40637b2 None None] MFA Rules not processed for user `5cc5145c238c43549a71a4e57b4ddabb`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:51.452984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d24d383c-88ff-454c-ae54-32dfd40637b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:51.490322 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499e4c9-c53d-4a41-86cf-6336cddc7401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:51.491599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499e4c9-c53d-4a41-86cf-6336cddc7401 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:51.492781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499e4c9-c53d-4a41-86cf-6336cddc7401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:51.492781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499e4c9-c53d-4a41-86cf-6336cddc7401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:51.493180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499e4c9-c53d-4a41-86cf-6336cddc7401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:51.495116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499e4c9-c53d-4a41-86cf-6336cddc7401 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:51.509922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 963/1935] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:16:51.515013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499e4c9-c53d-4a41-86cf-6336cddc7401 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:51.526998 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499e4c9-c53d-4a41-86cf-6336cddc7401 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:51.534712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343e817-35c9-4e0e-a4a3-523defdfdcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:51.536137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343e817-35c9-4e0e-a4a3-523defdfdcd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:51.537231 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343e817-35c9-4e0e-a4a3-523defdfdcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:51.537848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343e817-35c9-4e0e-a4a3-523defdfdcd1 admin admin] PATH_INFO: `/v3/projects/023f5a50e09740b3b1e9bbfb0acced8d/users/3fe401f89d3c4bd7820aadaa7bd0fd29/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:51.561269 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343e817-35c9-4e0e-a4a3-523defdfdcd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023f5a50e09740b3b1e9bbfb0acced8d, user_id=3fe401f89d3c4bd7820aadaa7bd0fd29, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:51.564633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343e817-35c9-4e0e-a4a3-523defdfdcd1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:51.590119 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 964/1936] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:51 2022] PUT /identity/v3/projects/023f5a50e09740b3b1e9bbfb0acced8d/users/3fe401f89d3c4bd7820aadaa7bd0fd29/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:16:51.591765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343e817-35c9-4e0e-a4a3-523defdfdcd1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:51.610360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 973/1937] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:16:51.623178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d383c-88ff-454c-ae54-32dfd40637b2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:51.624925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d24d383c-88ff-454c-ae54-32dfd40637b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:51.675915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343e817-35c9-4e0e-a4a3-523defdfdcd1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:51.683022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e6a0e-d680-4ce3-8a77-f6f523cc6965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:51.683813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e6a0e-d680-4ce3-8a77-f6f523cc6965 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:51.684069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e6a0e-d680-4ce3-8a77-f6f523cc6965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:51.684368 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e6a0e-d680-4ce3-8a77-f6f523cc6965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:51.685465 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e6a0e-d680-4ce3-8a77-f6f523cc6965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:51.687142 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e6a0e-d680-4ce3-8a77-f6f523cc6965 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:51.699236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 965/1938] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:51.703923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e6a0e-d680-4ce3-8a77-f6f523cc6965 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:51.707889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d383c-88ff-454c-ae54-32dfd40637b2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:51.714612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e6a0e-d680-4ce3-8a77-f6f523cc6965 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:51.721077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a5db6-f521-48a4-b218-e624af7cc41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:51.722109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5db6-f521-48a4-b218-e624af7cc41f admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:51.722488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5db6-f521-48a4-b218-e624af7cc41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:51.723137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5db6-f521-48a4-b218-e624af7cc41f admin admin] PATH_INFO: `/v3/projects/023f5a50e09740b3b1e9bbfb0acced8d/users/3fe401f89d3c4bd7820aadaa7bd0fd29/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:51.725985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a5db6-f521-48a4-b218-e624af7cc41f admin admin] RBAC: Authorizing `identity:create_grant(project_id=023f5a50e09740b3b1e9bbfb0acced8d, user_id=3fe401f89d3c4bd7820aadaa7bd0fd29, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:51.729326 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a5db6-f521-48a4-b218-e624af7cc41f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:51.744431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 966/1939] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:51 2022] PUT /identity/v3/projects/023f5a50e09740b3b1e9bbfb0acced8d/users/3fe401f89d3c4bd7820aadaa7bd0fd29/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:51.762214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd5980-ddf6-4c1d-9e6d-ddef3681e829 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:51.762811 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd5980-ddf6-4c1d-9e6d-ddef3681e829 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:51.763202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd5980-ddf6-4c1d-9e6d-ddef3681e829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:51.773592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:51.794062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36df6e5-e6cd-40ea-aec1-d2278e3288e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:51.795056 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df6e5-e6cd-40ea-aec1-d2278e3288e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:51.795400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df6e5-e6cd-40ea-aec1-d2278e3288e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:51.795755 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df6e5-e6cd-40ea-aec1-d2278e3288e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:51.804116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:51.820742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-97dd5980-ddf6-4c1d-9e6d-ddef3681e829 None None] MFA Rules not processed for user `3fe401f89d3c4bd7820aadaa7bd0fd29`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:51.823011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-97dd5980-ddf6-4c1d-9e6d-ddef3681e829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:51.882457 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36df6e5-e6cd-40ea-aec1-d2278e3288e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:51.884822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36df6e5-e6cd-40ea-aec1-d2278e3288e4 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:51.899679 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 974/1940] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:16:51.922215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 967/1941] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:51.940496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36df6e5-e6cd-40ea-aec1-d2278e3288e4 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:51.943692 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b36df6e5-e6cd-40ea-aec1-d2278e3288e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:51.961680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36df6e5-e6cd-40ea-aec1-d2278e3288e4 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:52.044698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd5980-ddf6-4c1d-9e6d-ddef3681e829 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:52.065553 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b82bd-c260-451c-b897-4646cc122002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:52.066507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b82bd-c260-451c-b897-4646cc122002 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:52.069540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b82bd-c260-451c-b897-4646cc122002 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:52.069961 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b82bd-c260-451c-b897-4646cc122002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:52.159199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd5980-ddf6-4c1d-9e6d-ddef3681e829 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:52.166231 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890dda64-312d-4ded-8cff-b811a92f5a46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:52.167163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dda64-312d-4ded-8cff-b811a92f5a46 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:52.167618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dda64-312d-4ded-8cff-b811a92f5a46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:52.168111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dda64-312d-4ded-8cff-b811a92f5a46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:52.181891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b82bd-c260-451c-b897-4646cc122002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:52.184172 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b82bd-c260-451c-b897-4646cc122002 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:52.200374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 975/1942] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:52.276577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890dda64-312d-4ded-8cff-b811a92f5a46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:52.278437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890dda64-312d-4ded-8cff-b811a92f5a46 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:52.292803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 968/1943] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:53.248439 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b82bd-c260-451c-b897-4646cc122002 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:53.349977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:53.410430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b82bd-c260-451c-b897-4646cc122002 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:53.422976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8eb18e-4863-40a1-925d-106cfb338de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:53.424601 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eb18e-4863-40a1-925d-106cfb338de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:53.425375 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eb18e-4863-40a1-925d-106cfb338de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:53.425841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eb18e-4863-40a1-925d-106cfb338de8 admin admin] PATH_INFO: `/v3/users/e1b9a8ed3f97498cb424a36d3bdc597c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:53.429633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8eb18e-4863-40a1-925d-106cfb338de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b9a8ed3f97498cb424a36d3bdc597c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:53.433789 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8eb18e-4863-40a1-925d-106cfb338de8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:53.555834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ab8eb18e-4863-40a1-925d-106cfb338de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b9a8ed3f97498cb424a36d3bdc597c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:53.574482 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ab8eb18e-4863-40a1-925d-106cfb338de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b9a8ed3f97498cb424a36d3bdc597c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:53.575756 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ab8eb18e-4863-40a1-925d-106cfb338de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b9a8ed3f97498cb424a36d3bdc597c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:53.618943 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ab8eb18e-4863-40a1-925d-106cfb338de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b9a8ed3f97498cb424a36d3bdc597c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:53.619994 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ab8eb18e-4863-40a1-925d-106cfb338de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b9a8ed3f97498cb424a36d3bdc597c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:53.647026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 976/1944] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:53 2022] DELETE /identity/v3/users/e1b9a8ed3f97498cb424a36d3bdc597c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:16:53.654530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206c768-b711-4b08-a6b8-4bee51be8437 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:53.655423 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206c768-b711-4b08-a6b8-4bee51be8437 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:53.655832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206c768-b711-4b08-a6b8-4bee51be8437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:53.688051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2206c768-b711-4b08-a6b8-4bee51be8437 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:53.690324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2206c768-b711-4b08-a6b8-4bee51be8437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:53.787022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:53.816343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 969/1945] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:53.828601 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8eb18e-4863-40a1-925d-106cfb338de8 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:53.830484 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ab8eb18e-4863-40a1-925d-106cfb338de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:53.920287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8eb18e-4863-40a1-925d-106cfb338de8 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:53.927626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9d86f-0e79-4686-8eb7-8d88c508ce87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:53.929344 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9d86f-0e79-4686-8eb7-8d88c508ce87 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:53.929868 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9d86f-0e79-4686-8eb7-8d88c508ce87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:53.930589 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9d86f-0e79-4686-8eb7-8d88c508ce87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:53.947317 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9d86f-0e79-4686-8eb7-8d88c508ce87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:53.949464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9d86f-0e79-4686-8eb7-8d88c508ce87 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:53.962764 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 977/1946] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:54.421817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206c768-b711-4b08-a6b8-4bee51be8437 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:54.423404 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2206c768-b711-4b08-a6b8-4bee51be8437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:54.450790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206c768-b711-4b08-a6b8-4bee51be8437 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:54.475626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594eb364-07e2-4318-900d-09302e723678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:54.476594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eb364-07e2-4318-900d-09302e723678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:54.476957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eb364-07e2-4318-900d-09302e723678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:54.477141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eb364-07e2-4318-900d-09302e723678 admin admin] PATH_INFO: `/v3/users/6de0b0b0f59240ad9ab55a21ef78532f` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:54.478733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594eb364-07e2-4318-900d-09302e723678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de0b0b0f59240ad9ab55a21ef78532f)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:54.480623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594eb364-07e2-4318-900d-09302e723678 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:54.533461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9d86f-0e79-4686-8eb7-8d88c508ce87 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:54.535720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-63f9d86f-0e79-4686-8eb7-8d88c508ce87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:54.614929 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-594eb364-07e2-4318-900d-09302e723678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de0b0b0f59240ad9ab55a21ef78532f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:54.619079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-594eb364-07e2-4318-900d-09302e723678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de0b0b0f59240ad9ab55a21ef78532f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:54.667783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-594eb364-07e2-4318-900d-09302e723678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de0b0b0f59240ad9ab55a21ef78532f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:54.704078 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-594eb364-07e2-4318-900d-09302e723678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de0b0b0f59240ad9ab55a21ef78532f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:54.711875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9d86f-0e79-4686-8eb7-8d88c508ce87 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:54.720414 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7ba13-9468-4bce-8553-d5ae707c8ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:54.721483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7ba13-9468-4bce-8553-d5ae707c8ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:54.721780 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7ba13-9468-4bce-8553-d5ae707c8ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:54.722094 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-594eb364-07e2-4318-900d-09302e723678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de0b0b0f59240ad9ab55a21ef78532f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:54.722487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7ba13-9468-4bce-8553-d5ae707c8ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:54.726089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3bf7ba13-9468-4bce-8553-d5ae707c8ec0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:54.759254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 970/1947] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:54 2022] DELETE /identity/v3/users/6de0b0b0f59240ad9ab55a21ef78532f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:54.764025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594eb364-07e2-4318-900d-09302e723678 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:54.771058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-594eb364-07e2-4318-900d-09302e723678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:54.818516 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:54.945454 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7ba13-9468-4bce-8553-d5ae707c8ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:54.946984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7ba13-9468-4bce-8553-d5ae707c8ec0 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:54.962740 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594eb364-07e2-4318-900d-09302e723678 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:54.964899 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 978/1948] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:54.967670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454bd20-b649-43eb-9c82-5db023181bb7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:54.969134 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454bd20-b649-43eb-9c82-5db023181bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:54.969651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454bd20-b649-43eb-9c82-5db023181bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:54.970103 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:54.971520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:54.972143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:54.988273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] PATH_INFO: `/v3/projects/72ebe7d53d3340d6bf0a97478203df98` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:54.993683 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ebe7d53d3340d6bf0a97478203df98)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:54.997530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:55.008993 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a454bd20-b649-43eb-9c82-5db023181bb7 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:55.011359 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a454bd20-b649-43eb-9c82-5db023181bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:55.032718 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 979/1949] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:55.040981 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454bd20-b649-43eb-9c82-5db023181bb7 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:55.045547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a454bd20-b649-43eb-9c82-5db023181bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:55.110645 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ebe7d53d3340d6bf0a97478203df98', 'request_id': 'req-26051e1e-5830-4184-a7f8-986d2a00d273'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:55.125528 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ebe7d53d3340d6bf0a97478203df98', 'request_id': 'req-26051e1e-5830-4184-a7f8-986d2a00d273'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:55.142457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ebe7d53d3340d6bf0a97478203df98', 'request_id': 'req-26051e1e-5830-4184-a7f8-986d2a00d273'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:55.146083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:55.177559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] The token cache is being invalidate because project 72ebe7d53d3340d6bf0a97478203df98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:55.177994 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:55.181051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:55.186088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 971/1950] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:54 2022] DELETE /identity/v3/projects/72ebe7d53d3340d6bf0a97478203df98 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:55.191308 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:55.196761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:55.202382 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454bd20-b649-43eb-9c82-5db023181bb7 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:55.344766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a879d-b117-4b72-9d19-11330079f097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:55.347116 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a879d-b117-4b72-9d19-11330079f097 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:55.348143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a879d-b117-4b72-9d19-11330079f097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:55.349069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a879d-b117-4b72-9d19-11330079f097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:55.353785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26051e1e-5830-4184-a7f8-986d2a00d273 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:55.354720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4d3a879d-b117-4b72-9d19-11330079f097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:55.358390 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0d406-411e-417b-b4a6-24db61a0e08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:55.359450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0d406-411e-417b-b4a6-24db61a0e08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:55.359737 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0d406-411e-417b-b4a6-24db61a0e08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:55.360151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0d406-411e-417b-b4a6-24db61a0e08b admin admin] PATH_INFO: `/v3/users/5cc5145c238c43549a71a4e57b4ddabb` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:55.361762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0d406-411e-417b-b4a6-24db61a0e08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc5145c238c43549a71a4e57b4ddabb)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:55.365164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0d406-411e-417b-b4a6-24db61a0e08b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:55.389777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a879d-b117-4b72-9d19-11330079f097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:55.398238 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a879d-b117-4b72-9d19-11330079f097 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:55.424470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 980/1951] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:16:55.478996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5ca0d406-411e-417b-b4a6-24db61a0e08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc5145c238c43549a71a4e57b4ddabb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:55.479750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5ca0d406-411e-417b-b4a6-24db61a0e08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc5145c238c43549a71a4e57b4ddabb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:55.512014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5ca0d406-411e-417b-b4a6-24db61a0e08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc5145c238c43549a71a4e57b4ddabb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:55.526203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5ca0d406-411e-417b-b4a6-24db61a0e08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc5145c238c43549a71a4e57b4ddabb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:55.528015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5ca0d406-411e-417b-b4a6-24db61a0e08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc5145c238c43549a71a4e57b4ddabb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:55.551953 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 972/1952] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:16:55 2022] DELETE /identity/v3/users/5cc5145c238c43549a71a4e57b4ddabb => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:56.148494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a879d-b117-4b72-9d19-11330079f097 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:56.151661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4d3a879d-b117-4b72-9d19-11330079f097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:56.180864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a879d-b117-4b72-9d19-11330079f097 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:56.240083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0d406-411e-417b-b4a6-24db61a0e08b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:56.243489 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5ca0d406-411e-417b-b4a6-24db61a0e08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:56.302176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:56.303684 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:56.305157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:56.305852 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] PATH_INFO: `/v3/projects/350b83d4d1cd4ef1a25e429307bd8e4a` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:56.308851 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=350b83d4d1cd4ef1a25e429307bd8e4a)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:56.318453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:56.377634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:56.468221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350b83d4d1cd4ef1a25e429307bd8e4a', 'request_id': 'req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:56.486950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350b83d4d1cd4ef1a25e429307bd8e4a', 'request_id': 'req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:56.495793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350b83d4d1cd4ef1a25e429307bd8e4a', 'request_id': 'req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:56.514903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0d406-411e-417b-b4a6-24db61a0e08b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:56.518502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] The token cache is being invalidate because project 350b83d4d1cd4ef1a25e429307bd8e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:56.518998 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:56.519790 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:56.522015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 981/1953] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:56 2022] DELETE /identity/v3/projects/350b83d4d1cd4ef1a25e429307bd8e4a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:56.523303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:56.525840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:56.545306 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:56.614746 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea57e5-1acc-4564-a61a-ce8d6f169402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:56.618450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea57e5-1acc-4564-a61a-ce8d6f169402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:56.619591 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea57e5-1acc-4564-a61a-ce8d6f169402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:56.620425 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea57e5-1acc-4564-a61a-ce8d6f169402 admin admin] PATH_INFO: `/v3/projects/70f9296129974a0791bb0767fc9f43a8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:56.622046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea57e5-1acc-4564-a61a-ce8d6f169402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f9296129974a0791bb0767fc9f43a8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:56.629455 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea57e5-1acc-4564-a61a-ce8d6f169402 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:56.654049 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf471fa-53b4-4048-8ff1-32fb15ab5ab9 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:56.658516 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbaece4-dc55-49dc-9def-ae00561e6514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:56.659249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaece4-dc55-49dc-9def-ae00561e6514 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:56.659540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaece4-dc55-49dc-9def-ae00561e6514 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:56.659822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaece4-dc55-49dc-9def-ae00561e6514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:56.661838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0dbaece4-dc55-49dc-9def-ae00561e6514 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:56.735113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-08ea57e5-1acc-4564-a61a-ce8d6f169402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f9296129974a0791bb0767fc9f43a8', 'request_id': 'req-08ea57e5-1acc-4564-a61a-ce8d6f169402'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:56.748126 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-08ea57e5-1acc-4564-a61a-ce8d6f169402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f9296129974a0791bb0767fc9f43a8', 'request_id': 'req-08ea57e5-1acc-4564-a61a-ce8d6f169402'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:56.757203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-08ea57e5-1acc-4564-a61a-ce8d6f169402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f9296129974a0791bb0767fc9f43a8', 'request_id': 'req-08ea57e5-1acc-4564-a61a-ce8d6f169402'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:56.773696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-08ea57e5-1acc-4564-a61a-ce8d6f169402 admin admin] The token cache is being invalidate because project 70f9296129974a0791bb0767fc9f43a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:16:56.774150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-08ea57e5-1acc-4564-a61a-ce8d6f169402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:56.774898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-08ea57e5-1acc-4564-a61a-ce8d6f169402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:16:56.781355 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 973/1954] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:16:56 2022] DELETE /identity/v3/projects/70f9296129974a0791bb0767fc9f43a8 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:56.782754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbaece4-dc55-49dc-9def-ae00561e6514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:56.782975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19359ec0-5dc8-43f3-b475-1d3ca99f4493 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:56.784346 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbaece4-dc55-49dc-9def-ae00561e6514 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:56.787207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19359ec0-5dc8-43f3-b475-1d3ca99f4493 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:56.787905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19359ec0-5dc8-43f3-b475-1d3ca99f4493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:56.795951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 982/1955] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:56.797963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0586f-f02e-4c24-9c0d-e506e9d8bf31 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:56.798262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0586f-f02e-4c24-9c0d-e506e9d8bf31 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:56.798549 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0586f-f02e-4c24-9c0d-e506e9d8bf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:56.816092 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-19359ec0-5dc8-43f3-b475-1d3ca99f4493 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:56.817796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-19359ec0-5dc8-43f3-b475-1d3ca99f4493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:56.831283 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-edc0586f-f02e-4c24-9c0d-e506e9d8bf31 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:56.832879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-edc0586f-f02e-4c24-9c0d-e506e9d8bf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:56.904434 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 974/1956] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:56.918492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb6d03-553a-4501-81a1-13863b886cf6 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:56.918902 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb6d03-553a-4501-81a1-13863b886cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:56.919093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb6d03-553a-4501-81a1-13863b886cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:56.937028 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:56.962615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fefb6d03-553a-4501-81a1-13863b886cf6 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:56.964427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fefb6d03-553a-4501-81a1-13863b886cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:56.968872 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 983/1957] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:56.970405 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003525f-3fb1-4c52-ae41-3764d2a10bed None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:56.970884 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003525f-3fb1-4c52-ae41-3764d2a10bed None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:56.971305 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003525f-3fb1-4c52-ae41-3764d2a10bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:56.978767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 975/1958] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:56.980108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb6d03-553a-4501-81a1-13863b886cf6 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:56.991505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb6d03-553a-4501-81a1-13863b886cf6 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:56.994038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4003525f-3fb1-4c52-ae41-3764d2a10bed None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:56.995915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4003525f-3fb1-4c52-ae41-3764d2a10bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:56.998494 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687bdb2-c5bc-4242-9794-885da96291b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:56.999343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687bdb2-c5bc-4242-9794-885da96291b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:56.999621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687bdb2-c5bc-4242-9794-885da96291b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.000294 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687bdb2-c5bc-4242-9794-885da96291b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.001001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687bdb2-c5bc-4242-9794-885da96291b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:16:57.001439 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687bdb2-c5bc-4242-9794-885da96291b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:57.003174 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687bdb2-c5bc-4242-9794-885da96291b0 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:57.005718 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 984/1959] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:57.010260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003525f-3fb1-4c52-ae41-3764d2a10bed None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:57.022321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 976/1960] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:16:57.024823 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003525f-3fb1-4c52-ae41-3764d2a10bed None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:57.027923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687bdb2-c5bc-4242-9794-885da96291b0 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:57.033076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b52fdf-23cd-4cf4-8650-5036a81b377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:57.034844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b52fdf-23cd-4cf4-8650-5036a81b377f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:57.035400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b52fdf-23cd-4cf4-8650-5036a81b377f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.035955 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b52fdf-23cd-4cf4-8650-5036a81b377f admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.037300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b52fdf-23cd-4cf4-8650-5036a81b377f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:16:57.037905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b52fdf-23cd-4cf4-8650-5036a81b377f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:57.040830 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687bdb2-c5bc-4242-9794-885da96291b0 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:57.042147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b52fdf-23cd-4cf4-8650-5036a81b377f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:57.047668 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311f0c8-de45-43e5-98e9-c1236b01bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:57.048557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311f0c8-de45-43e5-98e9-c1236b01bf28 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:57.048729 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311f0c8-de45-43e5-98e9-c1236b01bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.048943 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311f0c8-de45-43e5-98e9-c1236b01bf28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.049654 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311f0c8-de45-43e5-98e9-c1236b01bf28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:57.052698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311f0c8-de45-43e5-98e9-c1236b01bf28 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:57.062796 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 985/1961] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:16:57.069909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b52fdf-23cd-4cf4-8650-5036a81b377f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:57.087067 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b52fdf-23cd-4cf4-8650-5036a81b377f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:57.104232 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64887b-967e-45c0-8374-10c9f1e7b8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:57.104933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64887b-967e-45c0-8374-10c9f1e7b8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:57.105209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64887b-967e-45c0-8374-10c9f1e7b8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.105547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64887b-967e-45c0-8374-10c9f1e7b8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.106227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64887b-967e-45c0-8374-10c9f1e7b8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:57.108340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64887b-967e-45c0-8374-10c9f1e7b8a6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:57.113569 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 977/1962] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:57 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:57.114579 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311f0c8-de45-43e5-98e9-c1236b01bf28 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:57.129229 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:57.173563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 986/1963] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:57 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:57.179919 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64887b-967e-45c0-8374-10c9f1e7b8a6 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:57.231711 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311f0c8-de45-43e5-98e9-c1236b01bf28 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:57.306798 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999888-2950-4a6c-bd00-0c80d0c58958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:57.308359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999888-2950-4a6c-bd00-0c80d0c58958 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:57.310492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999888-2950-4a6c-bd00-0c80d0c58958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.311175 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999888-2950-4a6c-bd00-0c80d0c58958 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.312217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64887b-967e-45c0-8374-10c9f1e7b8a6 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:57.312555 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab999888-2950-4a6c-bd00-0c80d0c58958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:57.318121 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab999888-2950-4a6c-bd00-0c80d0c58958 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:57.318330 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739daa9-87e2-4989-b83d-7f4c48d8f861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:57.318922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739daa9-87e2-4989-b83d-7f4c48d8f861 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:57.319210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739daa9-87e2-4989-b83d-7f4c48d8f861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.319491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739daa9-87e2-4989-b83d-7f4c48d8f861 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.320224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739daa9-87e2-4989-b83d-7f4c48d8f861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:57.322198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739daa9-87e2-4989-b83d-7f4c48d8f861 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:57.346226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 987/1964] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:57 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:57.350981 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739daa9-87e2-4989-b83d-7f4c48d8f861 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:57.367345 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 978/1965] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:57 2022] POST /identity/v3/users => generated 288 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:57.367651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739daa9-87e2-4989-b83d-7f4c48d8f861 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:57.369444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ef4d9-23e9-4052-a7cd-ce5ab357bfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:57.369725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999888-2950-4a6c-bd00-0c80d0c58958 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:57.370290 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ef4d9-23e9-4052-a7cd-ce5ab357bfcc admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:57.370625 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ef4d9-23e9-4052-a7cd-ce5ab357bfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.371017 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ef4d9-23e9-4052-a7cd-ce5ab357bfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.371856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ef4d9-23e9-4052-a7cd-ce5ab357bfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:57.373811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ef4d9-23e9-4052-a7cd-ce5ab357bfcc admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:57.386852 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 988/1966] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:16:57.391201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ef4d9-23e9-4052-a7cd-ce5ab357bfcc admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:57.392130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999888-2950-4a6c-bd00-0c80d0c58958 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:57.400970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea2131-d691-4351-b2cb-02fbd47c5008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:57.402338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ef4d9-23e9-4052-a7cd-ce5ab357bfcc admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:57.402548 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea2131-d691-4351-b2cb-02fbd47c5008 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:57.403137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea2131-d691-4351-b2cb-02fbd47c5008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.403536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea2131-d691-4351-b2cb-02fbd47c5008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.404836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea2131-d691-4351-b2cb-02fbd47c5008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:57.407764 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045893ba-0bd1-4ea0-ac5e-266cd48606fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:57.408007 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea2131-d691-4351-b2cb-02fbd47c5008 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:57.408462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045893ba-0bd1-4ea0-ac5e-266cd48606fc admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:57.408766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045893ba-0bd1-4ea0-ac5e-266cd48606fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.409007 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045893ba-0bd1-4ea0-ac5e-266cd48606fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.409776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045893ba-0bd1-4ea0-ac5e-266cd48606fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:57.411938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045893ba-0bd1-4ea0-ac5e-266cd48606fc admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:57.426081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 989/1967] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:16:57.434572 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 979/1968] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:57.434863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045893ba-0bd1-4ea0-ac5e-266cd48606fc admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:57.437151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea2131-d691-4351-b2cb-02fbd47c5008 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:57.447173 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045893ba-0bd1-4ea0-ac5e-266cd48606fc admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:57.449503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea2131-d691-4351-b2cb-02fbd47c5008 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:57.455579 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d27b4-3893-40ce-a206-68fb815558ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:57.462064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d27b4-3893-40ce-a206-68fb815558ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:57.462064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d27b4-3893-40ce-a206-68fb815558ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.462064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d27b4-3893-40ce-a206-68fb815558ce admin admin] PATH_INFO: `/v3/projects/a09d403b30974fc5b90c01d476e6fe10/users/77d716bd0385473a967f472215baec5b/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.467388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855685d-7e1d-443e-8fb5-70bdb3c2076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:57.469269 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855685d-7e1d-443e-8fb5-70bdb3c2076b admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:57.469878 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855685d-7e1d-443e-8fb5-70bdb3c2076b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.470395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855685d-7e1d-443e-8fb5-70bdb3c2076b admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.471876 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855685d-7e1d-443e-8fb5-70bdb3c2076b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:57.475335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855685d-7e1d-443e-8fb5-70bdb3c2076b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:57.483851 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d27b4-3893-40ce-a206-68fb815558ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09d403b30974fc5b90c01d476e6fe10, user_id=77d716bd0385473a967f472215baec5b, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:57.487935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d27b4-3893-40ce-a206-68fb815558ce admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:57.497128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 980/1969] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:16:57.504243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855685d-7e1d-443e-8fb5-70bdb3c2076b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:57.511989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 990/1970] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:57 2022] PUT /identity/v3/projects/a09d403b30974fc5b90c01d476e6fe10/users/77d716bd0385473a967f472215baec5b/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:16:57.514007 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483f240-1838-47cb-b746-b1bb2d9396cf None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:57.514456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483f240-1838-47cb-b746-b1bb2d9396cf None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.514760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483f240-1838-47cb-b746-b1bb2d9396cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.525170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855685d-7e1d-443e-8fb5-70bdb3c2076b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:57.537147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3483f240-1838-47cb-b746-b1bb2d9396cf None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:57.538400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3483f240-1838-47cb-b746-b1bb2d9396cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:57.610055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eca230-c50b-4b5c-b721-50baf818ae9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:57.611193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eca230-c50b-4b5c-b721-50baf818ae9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:57.611504 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eca230-c50b-4b5c-b721-50baf818ae9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.611832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eca230-c50b-4b5c-b721-50baf818ae9d admin admin] PATH_INFO: `/v3/projects/90aaad3874fe4457bbadecf5dc8be832/users/c8564d0929bf445e937ac4d58507f06e/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.628768 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:57.641374 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eca230-c50b-4b5c-b721-50baf818ae9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90aaad3874fe4457bbadecf5dc8be832, user_id=c8564d0929bf445e937ac4d58507f06e, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:57.644867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eca230-c50b-4b5c-b721-50baf818ae9d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:57.646337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 991/1971] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:16:57.661818 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483f240-1838-47cb-b746-b1bb2d9396cf None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:57.663332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3483f240-1838-47cb-b746-b1bb2d9396cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:57.664851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 981/1972] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:57 2022] PUT /identity/v3/projects/90aaad3874fe4457bbadecf5dc8be832/users/c8564d0929bf445e937ac4d58507f06e/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:16:57.677044 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716245f8-9809-4647-9c03-29f0ec794e57 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:57.677044 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716245f8-9809-4647-9c03-29f0ec794e57 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.677545 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716245f8-9809-4647-9c03-29f0ec794e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.692521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:57.737954 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-716245f8-9809-4647-9c03-29f0ec794e57 None None] MFA Rules not processed for user `c8564d0929bf445e937ac4d58507f06e`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:57.741263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-716245f8-9809-4647-9c03-29f0ec794e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:57.752564 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483f240-1838-47cb-b746-b1bb2d9396cf None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:57.830625 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea20df-3d75-4cbf-895e-71c0b178bcc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:57.831701 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea20df-3d75-4cbf-895e-71c0b178bcc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:57.832161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea20df-3d75-4cbf-895e-71c0b178bcc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:57.832750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea20df-3d75-4cbf-895e-71c0b178bcc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:57.873301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 982/1973] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:16:57.888939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716245f8-9809-4647-9c03-29f0ec794e57 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:57.891029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-716245f8-9809-4647-9c03-29f0ec794e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:57.932087 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea20df-3d75-4cbf-895e-71c0b178bcc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:57.935156 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea20df-3d75-4cbf-895e-71c0b178bcc2 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:57.953818 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 992/1974] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:16:58.032149 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716245f8-9809-4647-9c03-29f0ec794e57 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:58.047480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59188920-568c-4491-97e7-9f4f0e354a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:58.048880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59188920-568c-4491-97e7-9f4f0e354a85 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:58.049370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59188920-568c-4491-97e7-9f4f0e354a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:58.049849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59188920-568c-4491-97e7-9f4f0e354a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:58.072832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59188920-568c-4491-97e7-9f4f0e354a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:58.076340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59188920-568c-4491-97e7-9f4f0e354a85 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:58.097214 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 983/1975] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:16:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:16:59.531699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1358cef-f3e3-4513-8ba4-59d136b501ca None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:59.532424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1358cef-f3e3-4513-8ba4-59d136b501ca None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:59.532424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1358cef-f3e3-4513-8ba4-59d136b501ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:59.563426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a1358cef-f3e3-4513-8ba4-59d136b501ca None None] MFA Rules not processed for user `77d716bd0385473a967f472215baec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:16:59.564690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a1358cef-f3e3-4513-8ba4-59d136b501ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:16:59.640735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:16:59.664041 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 993/1976] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:16:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:16:59.668910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59188920-568c-4491-97e7-9f4f0e354a85 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:59.680279 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59188920-568c-4491-97e7-9f4f0e354a85 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:59.684781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c762eed-d04e-4c07-b39c-2530c08fb17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:59.685535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c762eed-d04e-4c07-b39c-2530c08fb17a admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:59.685818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c762eed-d04e-4c07-b39c-2530c08fb17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:59.686094 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c762eed-d04e-4c07-b39c-2530c08fb17a admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:59.686872 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c762eed-d04e-4c07-b39c-2530c08fb17a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:59.688839 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c762eed-d04e-4c07-b39c-2530c08fb17a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:59.730500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 984/1977] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:16:59 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:59.730698 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1358cef-f3e3-4513-8ba4-59d136b501ca None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:59.747243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1358cef-f3e3-4513-8ba4-59d136b501ca None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:59.855961 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5636c-8f8d-4270-b3cc-50b5750b71ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:59.856665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5636c-8f8d-4270-b3cc-50b5750b71ba admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:59.857217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5636c-8f8d-4270-b3cc-50b5750b71ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:59.857395 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5636c-8f8d-4270-b3cc-50b5750b71ba admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:59.858075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5636c-8f8d-4270-b3cc-50b5750b71ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:59.860409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5636c-8f8d-4270-b3cc-50b5750b71ba admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:59.906083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c762eed-d04e-4c07-b39c-2530c08fb17a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:59.916667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 994/1978] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:16:59 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:16:59.931606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c762eed-d04e-4c07-b39c-2530c08fb17a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:59.939058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46024015-b911-429d-b9c8-656d1e199fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:59.939935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46024015-b911-429d-b9c8-656d1e199fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:59.940341 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46024015-b911-429d-b9c8-656d1e199fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:59.940700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46024015-b911-429d-b9c8-656d1e199fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:16:59.942253 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46024015-b911-429d-b9c8-656d1e199fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:16:59.944385 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46024015-b911-429d-b9c8-656d1e199fc6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:16:59.967858 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 985/1979] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:16:59.969043 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5636c-8f8d-4270-b3cc-50b5750b71ba admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:16:59.980634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5636c-8f8d-4270-b3cc-50b5750b71ba admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:16:59.986353 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0862e4-350d-4b9f-a0e3-109b46058b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:16:59.987621 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0862e4-350d-4b9f-a0e3-109b46058b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:16:59.987871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0862e4-350d-4b9f-a0e3-109b46058b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:16:59.988222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0862e4-350d-4b9f-a0e3-109b46058b37 admin admin] PATH_INFO: `/v3/projects/09f8f034ac0e45b88ed1012ae94253fd/users/55bacdb07aa045d9aec11acff154ae57/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:00.028629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0862e4-350d-4b9f-a0e3-109b46058b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f8f034ac0e45b88ed1012ae94253fd, user_id=55bacdb07aa045d9aec11acff154ae57, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:00.036409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0862e4-350d-4b9f-a0e3-109b46058b37 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:00.081039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 995/1980] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:16:59 2022] PUT /identity/v3/projects/09f8f034ac0e45b88ed1012ae94253fd/users/55bacdb07aa045d9aec11acff154ae57/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:00.085391 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46024015-b911-429d-b9c8-656d1e199fc6 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:00.097383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd814ba-8af2-4129-a9ca-d265c38018aa None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:00.097675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd814ba-8af2-4129-a9ca-d265c38018aa None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:00.097967 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd814ba-8af2-4129-a9ca-d265c38018aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:00.106399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46024015-b911-429d-b9c8-656d1e199fc6 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:00.158842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-cbd814ba-8af2-4129-a9ca-d265c38018aa None None] MFA Rules not processed for user `c8564d0929bf445e937ac4d58507f06e`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:00.167055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-cbd814ba-8af2-4129-a9ca-d265c38018aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:00.206455 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa1b9e-8cfa-4b31-8130-1ac3f8f8b5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:00.207240 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa1b9e-8cfa-4b31-8130-1ac3f8f8b5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:00.207533 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa1b9e-8cfa-4b31-8130-1ac3f8f8b5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:00.207815 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa1b9e-8cfa-4b31-8130-1ac3f8f8b5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:00.208896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa1b9e-8cfa-4b31-8130-1ac3f8f8b5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:00.211036 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa1b9e-8cfa-4b31-8130-1ac3f8f8b5c7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:00.226944 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 986/1981] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:00.231206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa1b9e-8cfa-4b31-8130-1ac3f8f8b5c7 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:00.238116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:00.250282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa1b9e-8cfa-4b31-8130-1ac3f8f8b5c7 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:00.258959 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0cdae-c49a-4be3-9b96-1f2da88a67f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:00.260893 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0cdae-c49a-4be3-9b96-1f2da88a67f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:00.261650 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0cdae-c49a-4be3-9b96-1f2da88a67f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:00.262439 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0cdae-c49a-4be3-9b96-1f2da88a67f8 admin admin] PATH_INFO: `/v3/projects/09f8f034ac0e45b88ed1012ae94253fd/users/55bacdb07aa045d9aec11acff154ae57/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:00.266324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0cdae-c49a-4be3-9b96-1f2da88a67f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f8f034ac0e45b88ed1012ae94253fd, user_id=55bacdb07aa045d9aec11acff154ae57, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:00.271503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0cdae-c49a-4be3-9b96-1f2da88a67f8 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:00.289630 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 987/1982] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:00 2022] PUT /identity/v3/projects/09f8f034ac0e45b88ed1012ae94253fd/users/55bacdb07aa045d9aec11acff154ae57/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:00.294854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 996/1983] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:01.606390 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0cdae-c49a-4be3-9b96-1f2da88a67f8 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:01.608613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a4b0cdae-c49a-4be3-9b96-1f2da88a67f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:01.646225 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01dade-2ca8-498f-a5d5-df13c0c7201e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:01.646814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01dade-2ca8-498f-a5d5-df13c0c7201e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:01.646814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01dade-2ca8-498f-a5d5-df13c0c7201e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:01.709937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-fe01dade-2ca8-498f-a5d5-df13c0c7201e None None] MFA Rules not processed for user `55bacdb07aa045d9aec11acff154ae57`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:01.711420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-fe01dade-2ca8-498f-a5d5-df13c0c7201e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:01.740696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0cdae-c49a-4be3-9b96-1f2da88a67f8 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:01.748576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da89039-32fc-431c-a8ff-1b7f746cdfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:01.749727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da89039-32fc-431c-a8ff-1b7f746cdfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:01.750004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da89039-32fc-431c-a8ff-1b7f746cdfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:01.750315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da89039-32fc-431c-a8ff-1b7f746cdfb4 admin admin] PATH_INFO: `/v3/users/9264f5ddbafd40488ff810c87739330e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:01.752926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da89039-32fc-431c-a8ff-1b7f746cdfb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9264f5ddbafd40488ff810c87739330e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:01.755667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da89039-32fc-431c-a8ff-1b7f746cdfb4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:01.777121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:01.808182 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 997/1984] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:01.822057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22952fb8-6abc-4036-83db-bbfb474c975c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:01.822484 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22952fb8-6abc-4036-83db-bbfb474c975c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:01.822860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22952fb8-6abc-4036-83db-bbfb474c975c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:01.848015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-22952fb8-6abc-4036-83db-bbfb474c975c None None] MFA Rules not processed for user `77d716bd0385473a967f472215baec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:01.849373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-22952fb8-6abc-4036-83db-bbfb474c975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:01.863922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5da89039-32fc-431c-a8ff-1b7f746cdfb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9264f5ddbafd40488ff810c87739330e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:01.865523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5da89039-32fc-431c-a8ff-1b7f746cdfb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9264f5ddbafd40488ff810c87739330e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:01.900463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5da89039-32fc-431c-a8ff-1b7f746cdfb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9264f5ddbafd40488ff810c87739330e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:01.913562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5da89039-32fc-431c-a8ff-1b7f746cdfb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9264f5ddbafd40488ff810c87739330e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:01.918075 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5da89039-32fc-431c-a8ff-1b7f746cdfb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9264f5ddbafd40488ff810c87739330e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:01.946064 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 988/1985] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:01 2022] DELETE /identity/v3/users/9264f5ddbafd40488ff810c87739330e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:01.955259 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d0a44-c677-43dd-96ce-35d85cad67d8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:01.955259 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d0a44-c677-43dd-96ce-35d85cad67d8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:01.955259 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d0a44-c677-43dd-96ce-35d85cad67d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:01.978302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4b1d0a44-c677-43dd-96ce-35d85cad67d8 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:01.979502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4b1d0a44-c677-43dd-96ce-35d85cad67d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:02.000364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 998/1986] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:02.011567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22952fb8-6abc-4036-83db-bbfb474c975c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:02.017027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-22952fb8-6abc-4036-83db-bbfb474c975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:02.154404 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 989/1987] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:02.171442 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d0a44-c677-43dd-96ce-35d85cad67d8 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:02.173842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4b1d0a44-c677-43dd-96ce-35d85cad67d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:02.194455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22952fb8-6abc-4036-83db-bbfb474c975c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:02.198558 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:02.299233 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d0a44-c677-43dd-96ce-35d85cad67d8 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:02.305249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06371593-31eb-429e-ac40-9a2964ffa022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:02.306705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06371593-31eb-429e-ac40-9a2964ffa022 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:02.307145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06371593-31eb-429e-ac40-9a2964ffa022 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:02.307416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06371593-31eb-429e-ac40-9a2964ffa022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:02.322121 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06371593-31eb-429e-ac40-9a2964ffa022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:02.324487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06371593-31eb-429e-ac40-9a2964ffa022 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:02.336489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694aabb-49ac-4d3f-8cd3-0251c2268369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:02.337705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694aabb-49ac-4d3f-8cd3-0251c2268369 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:02.338442 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694aabb-49ac-4d3f-8cd3-0251c2268369 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:02.338994 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694aabb-49ac-4d3f-8cd3-0251c2268369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:02.343313 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8694aabb-49ac-4d3f-8cd3-0251c2268369 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:02.354427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 990/1988] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:02.411328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:02.466083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694aabb-49ac-4d3f-8cd3-0251c2268369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:02.468211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694aabb-49ac-4d3f-8cd3-0251c2268369 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:02.481426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 999/1989] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:03.436721 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06371593-31eb-429e-ac40-9a2964ffa022 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:03.439038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-06371593-31eb-429e-ac40-9a2964ffa022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:03.462217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06371593-31eb-429e-ac40-9a2964ffa022 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:03.467884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:03.468802 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:03.469076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:03.470795 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] PATH_INFO: `/v3/projects/2762e4fd6a6b48eeb14e019dee362250` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:03.472227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2762e4fd6a6b48eeb14e019dee362250)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:03.474205 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:03.546345 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2762e4fd6a6b48eeb14e019dee362250', 'request_id': 'req-ea1ec6f3-62e9-4678-b7a0-238612d5b539'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:03.562080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2762e4fd6a6b48eeb14e019dee362250', 'request_id': 'req-ea1ec6f3-62e9-4678-b7a0-238612d5b539'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:03.581383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2762e4fd6a6b48eeb14e019dee362250', 'request_id': 'req-ea1ec6f3-62e9-4678-b7a0-238612d5b539'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:03.621935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] The token cache is being invalidate because project 2762e4fd6a6b48eeb14e019dee362250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:03.622284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:03.624113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:03.629696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 991/1990] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:03 2022] DELETE /identity/v3/projects/2762e4fd6a6b48eeb14e019dee362250 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:03.630845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694aabb-49ac-4d3f-8cd3-0251c2268369 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:03.646296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694aabb-49ac-4d3f-8cd3-0251c2268369 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:03.741492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c697b1-12ec-4ef3-8cc7-b0055c75a3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:03.741492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c697b1-12ec-4ef3-8cc7-b0055c75a3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:03.741492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c697b1-12ec-4ef3-8cc7-b0055c75a3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:03.741492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c697b1-12ec-4ef3-8cc7-b0055c75a3ea admin admin] PATH_INFO: `/v3/users/4f524cf368804af5a4c290bdcef1bd91` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:03.742183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c697b1-12ec-4ef3-8cc7-b0055c75a3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f524cf368804af5a4c290bdcef1bd91)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:03.744533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c697b1-12ec-4ef3-8cc7-b0055c75a3ea admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:03.827268 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f9c697b1-12ec-4ef3-8cc7-b0055c75a3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f524cf368804af5a4c290bdcef1bd91'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:03.843484 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f9c697b1-12ec-4ef3-8cc7-b0055c75a3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f524cf368804af5a4c290bdcef1bd91'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:03.844835 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f9c697b1-12ec-4ef3-8cc7-b0055c75a3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f524cf368804af5a4c290bdcef1bd91'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:03.885097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f9c697b1-12ec-4ef3-8cc7-b0055c75a3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f524cf368804af5a4c290bdcef1bd91'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:03.886072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f9c697b1-12ec-4ef3-8cc7-b0055c75a3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f524cf368804af5a4c290bdcef1bd91'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:03.929362 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1000/1991] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:03 2022] DELETE /identity/v3/users/4f524cf368804af5a4c290bdcef1bd91 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:04.910190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:04.913474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:04.990355 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ec6f3-62e9-4678-b7a0-238612d5b539 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:05.138106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:05.141586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:05.141989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:05.142295 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] PATH_INFO: `/v3/projects/f59bdc25fed3462680935f67b58ca13b` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:05.146047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59bdc25fed3462680935f67b58ca13b)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:05.152204 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:05.268606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:05.287256 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59bdc25fed3462680935f67b58ca13b', 'request_id': 'req-60ce74f6-5867-4766-870e-3bddc9b71f29'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:05.297612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59bdc25fed3462680935f67b58ca13b', 'request_id': 'req-60ce74f6-5867-4766-870e-3bddc9b71f29'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:05.307234 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59bdc25fed3462680935f67b58ca13b', 'request_id': 'req-60ce74f6-5867-4766-870e-3bddc9b71f29'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:05.325529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] The token cache is being invalidate because project f59bdc25fed3462680935f67b58ca13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:05.326163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:05.330879 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:05.333431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 992/1992] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:04 2022] DELETE /identity/v3/projects/f59bdc25fed3462680935f67b58ca13b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:05.337663 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c697b1-12ec-4ef3-8cc7-b0055c75a3ea admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:05.341422 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f9c697b1-12ec-4ef3-8cc7-b0055c75a3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:05.382312 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c697b1-12ec-4ef3-8cc7-b0055c75a3ea admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:05.541508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:05.576443 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a0d9d-9600-4c1d-9198-17e113a0ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:05.579580 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a0d9d-9600-4c1d-9198-17e113a0ef56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:05.580085 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a0d9d-9600-4c1d-9198-17e113a0ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:05.580569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a0d9d-9600-4c1d-9198-17e113a0ef56 admin admin] PATH_INFO: `/v3/users/3fe401f89d3c4bd7820aadaa7bd0fd29` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:05.585575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a0d9d-9600-4c1d-9198-17e113a0ef56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe401f89d3c4bd7820aadaa7bd0fd29)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:05.588093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a0d9d-9600-4c1d-9198-17e113a0ef56 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:05.730384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-042a0d9d-9600-4c1d-9198-17e113a0ef56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe401f89d3c4bd7820aadaa7bd0fd29'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:05.759793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-042a0d9d-9600-4c1d-9198-17e113a0ef56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe401f89d3c4bd7820aadaa7bd0fd29'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:05.760660 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-042a0d9d-9600-4c1d-9198-17e113a0ef56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe401f89d3c4bd7820aadaa7bd0fd29'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:05.779645 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-042a0d9d-9600-4c1d-9198-17e113a0ef56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe401f89d3c4bd7820aadaa7bd0fd29'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:05.780574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-042a0d9d-9600-4c1d-9198-17e113a0ef56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe401f89d3c4bd7820aadaa7bd0fd29'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:05.804334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1001/1993] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:05 2022] DELETE /identity/v3/users/3fe401f89d3c4bd7820aadaa7bd0fd29 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:06.805565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:06.807986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:06.828689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce74f6-5867-4766-870e-3bddc9b71f29 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:07.016941 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f2576-e4bf-46e2-92de-4336b5b28124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:07.018382 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f2576-e4bf-46e2-92de-4336b5b28124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:07.018871 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f2576-e4bf-46e2-92de-4336b5b28124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:07.019465 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f2576-e4bf-46e2-92de-4336b5b28124 admin admin] PATH_INFO: `/v3/projects/023f5a50e09740b3b1e9bbfb0acced8d` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:07.021051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f2576-e4bf-46e2-92de-4336b5b28124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=023f5a50e09740b3b1e9bbfb0acced8d)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:07.023320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f2576-e4bf-46e2-92de-4336b5b28124 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:07.154487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-658f2576-e4bf-46e2-92de-4336b5b28124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023f5a50e09740b3b1e9bbfb0acced8d', 'request_id': 'req-658f2576-e4bf-46e2-92de-4336b5b28124'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:07.165904 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-658f2576-e4bf-46e2-92de-4336b5b28124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023f5a50e09740b3b1e9bbfb0acced8d', 'request_id': 'req-658f2576-e4bf-46e2-92de-4336b5b28124'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:07.173851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-658f2576-e4bf-46e2-92de-4336b5b28124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023f5a50e09740b3b1e9bbfb0acced8d', 'request_id': 'req-658f2576-e4bf-46e2-92de-4336b5b28124'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:07.188813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-658f2576-e4bf-46e2-92de-4336b5b28124 admin admin] The token cache is being invalidate because project 023f5a50e09740b3b1e9bbfb0acced8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:07.189462 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-658f2576-e4bf-46e2-92de-4336b5b28124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:07.190378 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-658f2576-e4bf-46e2-92de-4336b5b28124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:07.192805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 993/1994] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:06 2022] DELETE /identity/v3/projects/023f5a50e09740b3b1e9bbfb0acced8d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:07.204925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169131b-aec6-493d-9e3b-642694af0de0 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:07.205543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169131b-aec6-493d-9e3b-642694af0de0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:07.206132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169131b-aec6-493d-9e3b-642694af0de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:07.241754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8169131b-aec6-493d-9e3b-642694af0de0 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:07.250989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8169131b-aec6-493d-9e3b-642694af0de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:07.348385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1002/1995] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:07.358978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d0e0-d67e-4b03-afb1-89fd0db52d36 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:07.360201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d0e0-d67e-4b03-afb1-89fd0db52d36 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:07.360882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d0e0-d67e-4b03-afb1-89fd0db52d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:07.405564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b843d0e0-d67e-4b03-afb1-89fd0db52d36 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:07.408168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b843d0e0-d67e-4b03-afb1-89fd0db52d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:07.428418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 994/1996] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:07.433192 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169131b-aec6-493d-9e3b-642694af0de0 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:07.461809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169131b-aec6-493d-9e3b-642694af0de0 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:07.476241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9d1be-da93-46f1-a402-2bfa54d0382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:07.478399 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9d1be-da93-46f1-a402-2bfa54d0382a admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:07.479148 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9d1be-da93-46f1-a402-2bfa54d0382a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:07.479798 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9d1be-da93-46f1-a402-2bfa54d0382a admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:07.485187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9d1be-da93-46f1-a402-2bfa54d0382a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:17:07.486671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9d1be-da93-46f1-a402-2bfa54d0382a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:07.492134 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9d1be-da93-46f1-a402-2bfa54d0382a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:07.537151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1003/1997] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:17:07.543019 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843d0e0-d67e-4b03-afb1-89fd0db52d36 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:07.567843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843d0e0-d67e-4b03-afb1-89fd0db52d36 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:07.585780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b105b0-f474-44af-b532-1cf26251538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:07.587013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b105b0-f474-44af-b532-1cf26251538c admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:07.587523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b105b0-f474-44af-b532-1cf26251538c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:07.588764 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b105b0-f474-44af-b532-1cf26251538c admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:07.590420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b105b0-f474-44af-b532-1cf26251538c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:07.614589 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b105b0-f474-44af-b532-1cf26251538c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:07.737640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 995/1998] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:07 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:07.738117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9d1be-da93-46f1-a402-2bfa54d0382a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:07.763069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9d1be-da93-46f1-a402-2bfa54d0382a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:07.857303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:07.875484 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757409b-505f-4085-aaa1-a2220c759dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:07.877244 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757409b-505f-4085-aaa1-a2220c759dfe admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:07.877541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757409b-505f-4085-aaa1-a2220c759dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:07.877826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757409b-505f-4085-aaa1-a2220c759dfe admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:07.878575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757409b-505f-4085-aaa1-a2220c759dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:07.880713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757409b-505f-4085-aaa1-a2220c759dfe admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:07.918732 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1004/1999] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:07 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:17:07.923197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b105b0-f474-44af-b532-1cf26251538c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:07.938882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b105b0-f474-44af-b532-1cf26251538c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:07.949303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3ad9b-9606-43d7-85de-71cf7f6adafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:07.950810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3ad9b-9606-43d7-85de-71cf7f6adafb admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:07.951084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3ad9b-9606-43d7-85de-71cf7f6adafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:07.951364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3ad9b-9606-43d7-85de-71cf7f6adafb admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:07.952497 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3ad9b-9606-43d7-85de-71cf7f6adafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:07.954196 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3ad9b-9606-43d7-85de-71cf7f6adafb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:07.968850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 996/2000] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:17:07.974064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757409b-505f-4085-aaa1-a2220c759dfe admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:07.996673 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757409b-505f-4085-aaa1-a2220c759dfe admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:08.007707 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600eca37-6e59-413d-b80f-8de23f0c5452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:08.009202 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eca37-6e59-413d-b80f-8de23f0c5452 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:08.013274 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eca37-6e59-413d-b80f-8de23f0c5452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:08.013696 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eca37-6e59-413d-b80f-8de23f0c5452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:08.015174 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600eca37-6e59-413d-b80f-8de23f0c5452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:08.018261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600eca37-6e59-413d-b80f-8de23f0c5452 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:08.046847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1005/2001] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:17:08.051419 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3ad9b-9606-43d7-85de-71cf7f6adafb admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:08.069418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3ad9b-9606-43d7-85de-71cf7f6adafb admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:08.076030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaec26f-9a95-4aba-9f19-096638ba136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:08.077056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaec26f-9a95-4aba-9f19-096638ba136f admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:08.077492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaec26f-9a95-4aba-9f19-096638ba136f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:08.078277 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaec26f-9a95-4aba-9f19-096638ba136f admin admin] PATH_INFO: `/v3/projects/0cfe8c2a973e4787829efadd588b2f70/users/79e46a80c74b4248a8a403fdbccb32dc/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:08.098775 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:08.101222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaec26f-9a95-4aba-9f19-096638ba136f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cfe8c2a973e4787829efadd588b2f70, user_id=79e46a80c74b4248a8a403fdbccb32dc, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:08.105105 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaec26f-9a95-4aba-9f19-096638ba136f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:08.141111 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167b234-b8c3-4814-8b43-aa7b058132cc None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:08.141541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 997/2002] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:08 2022] PUT /identity/v3/projects/0cfe8c2a973e4787829efadd588b2f70/users/79e46a80c74b4248a8a403fdbccb32dc/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:08.142767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167b234-b8c3-4814-8b43-aa7b058132cc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:08.143319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167b234-b8c3-4814-8b43-aa7b058132cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:08.210491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0167b234-b8c3-4814-8b43-aa7b058132cc None None] MFA Rules not processed for user `79e46a80c74b4248a8a403fdbccb32dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:08.213942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0167b234-b8c3-4814-8b43-aa7b058132cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:08.418005 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1006/2003] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:08.428281 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaec26f-9a95-4aba-9f19-096638ba136f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:08.431128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cdaec26f-9a95-4aba-9f19-096638ba136f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:08.591914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaec26f-9a95-4aba-9f19-096638ba136f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:08.616101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd78df-8d1f-4ff7-8451-8a76218a0c56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:08.617251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd78df-8d1f-4ff7-8451-8a76218a0c56 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:08.617742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd78df-8d1f-4ff7-8451-8a76218a0c56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:08.618256 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd78df-8d1f-4ff7-8451-8a76218a0c56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:08.643938 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd78df-8d1f-4ff7-8451-8a76218a0c56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:08.646153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd78df-8d1f-4ff7-8451-8a76218a0c56 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:08.674244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 998/2004] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:09.756068 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167b234-b8c3-4814-8b43-aa7b058132cc None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:09.759745 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0167b234-b8c3-4814-8b43-aa7b058132cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:09.890821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167b234-b8c3-4814-8b43-aa7b058132cc None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:09.897485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42203b-eb74-4dc8-9043-24afc4a1d3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:09.898841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42203b-eb74-4dc8-9043-24afc4a1d3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:09.899258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42203b-eb74-4dc8-9043-24afc4a1d3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:09.899645 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42203b-eb74-4dc8-9043-24afc4a1d3a0 admin admin] PATH_INFO: `/v3/users/5a6cf4855b754111826284c3c6f43d98` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:09.901425 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42203b-eb74-4dc8-9043-24afc4a1d3a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6cf4855b754111826284c3c6f43d98)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:09.904246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42203b-eb74-4dc8-9043-24afc4a1d3a0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:09.969706 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ef42203b-eb74-4dc8-9043-24afc4a1d3a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6cf4855b754111826284c3c6f43d98'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:09.979263 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ef42203b-eb74-4dc8-9043-24afc4a1d3a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6cf4855b754111826284c3c6f43d98'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:09.980026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ef42203b-eb74-4dc8-9043-24afc4a1d3a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6cf4855b754111826284c3c6f43d98'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:09.989454 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:10.000872 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ef42203b-eb74-4dc8-9043-24afc4a1d3a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6cf4855b754111826284c3c6f43d98'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:10.001728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ef42203b-eb74-4dc8-9043-24afc4a1d3a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6cf4855b754111826284c3c6f43d98'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:10.018392 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1007/2005] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:09 2022] DELETE /identity/v3/users/5a6cf4855b754111826284c3c6f43d98 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:10.277687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd78df-8d1f-4ff7-8451-8a76218a0c56 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:10.309578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd78df-8d1f-4ff7-8451-8a76218a0c56 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:10.447750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:10.449376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:10.450130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:10.450964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60 admin admin] PATH_INFO: `/v3/projects/a5be9596ebb94c2dbfb09d5a23698773` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:10.455473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5be9596ebb94c2dbfb09d5a23698773)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:10.460609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:10.598684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5be9596ebb94c2dbfb09d5a23698773', 'request_id': 'req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:10.612774 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5be9596ebb94c2dbfb09d5a23698773', 'request_id': 'req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:10.628486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5be9596ebb94c2dbfb09d5a23698773', 'request_id': 'req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:10.643926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60 admin admin] The token cache is being invalidate because project a5be9596ebb94c2dbfb09d5a23698773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:10.644233 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:10.645326 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f4d9020-86e6-4530-83af-7d7f3f1d2e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:10.647273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 999/2006] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:10 2022] DELETE /identity/v3/projects/a5be9596ebb94c2dbfb09d5a23698773 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:10.654243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b3bd-d82d-49f7-be3d-9a423fc9481e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:10.654535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b3bd-d82d-49f7-be3d-9a423fc9481e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:10.654815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b3bd-d82d-49f7-be3d-9a423fc9481e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:10.678800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4077b3bd-d82d-49f7-be3d-9a423fc9481e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:10.680104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4077b3bd-d82d-49f7-be3d-9a423fc9481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:10.798085 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1008/2007] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:10.812881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7048904-ce02-4996-a297-80070ce2f6dc None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:10.813494 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7048904-ce02-4996-a297-80070ce2f6dc None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:10.813914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7048904-ce02-4996-a297-80070ce2f6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:10.842158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c7048904-ce02-4996-a297-80070ce2f6dc None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:10.844595 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c7048904-ce02-4996-a297-80070ce2f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:10.857366 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1000/2008] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:10.863013 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077b3bd-d82d-49f7-be3d-9a423fc9481e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:10.878906 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077b3bd-d82d-49f7-be3d-9a423fc9481e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:10.884960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b8f92-0cab-4d72-98c6-f9c95b1ca213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:10.885726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b8f92-0cab-4d72-98c6-f9c95b1ca213 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:10.886239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b8f92-0cab-4d72-98c6-f9c95b1ca213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:10.886604 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b8f92-0cab-4d72-98c6-f9c95b1ca213 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:10.887434 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b8f92-0cab-4d72-98c6-f9c95b1ca213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:17:10.887784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b8f92-0cab-4d72-98c6-f9c95b1ca213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:10.890863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b8f92-0cab-4d72-98c6-f9c95b1ca213 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:10.912771 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1009/2009] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:17:10.919200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7048904-ce02-4996-a297-80070ce2f6dc None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:10.932101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7048904-ce02-4996-a297-80070ce2f6dc None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:10.940660 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21774c5e-3e81-4ce2-8355-fc8903e474d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:10.941823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21774c5e-3e81-4ce2-8355-fc8903e474d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:10.942369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21774c5e-3e81-4ce2-8355-fc8903e474d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:10.942931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21774c5e-3e81-4ce2-8355-fc8903e474d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:10.944247 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21774c5e-3e81-4ce2-8355-fc8903e474d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:10.948339 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21774c5e-3e81-4ce2-8355-fc8903e474d4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:10.975992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:10.998170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1001/2010] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:10 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:11.004113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b8f92-0cab-4d72-98c6-f9c95b1ca213 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:11.017785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b8f92-0cab-4d72-98c6-f9c95b1ca213 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:11.091306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfceed-06e9-4fdb-8da5-09b0a1605664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:11.092015 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfceed-06e9-4fdb-8da5-09b0a1605664 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:11.092305 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfceed-06e9-4fdb-8da5-09b0a1605664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:11.092560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfceed-06e9-4fdb-8da5-09b0a1605664 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:11.093307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfceed-06e9-4fdb-8da5-09b0a1605664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:11.095467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfceed-06e9-4fdb-8da5-09b0a1605664 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:11.119377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1010/2011] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:11 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:11.126001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21774c5e-3e81-4ce2-8355-fc8903e474d4 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:11.144436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21774c5e-3e81-4ce2-8355-fc8903e474d4 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:11.153923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d7a2f-85ec-47bd-8939-e65b71276792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:11.155031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d7a2f-85ec-47bd-8939-e65b71276792 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:11.155549 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d7a2f-85ec-47bd-8939-e65b71276792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:11.155968 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d7a2f-85ec-47bd-8939-e65b71276792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:11.157143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d7a2f-85ec-47bd-8939-e65b71276792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:11.159380 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d7a2f-85ec-47bd-8939-e65b71276792 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:11.172469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1002/2012] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:11.177196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfceed-06e9-4fdb-8da5-09b0a1605664 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:11.189028 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfceed-06e9-4fdb-8da5-09b0a1605664 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:11.195166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bb152-0bc1-45ce-bf81-700a2331ef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:11.195881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bb152-0bc1-45ce-bf81-700a2331ef3b admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:11.196164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bb152-0bc1-45ce-bf81-700a2331ef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:11.196431 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bb152-0bc1-45ce-bf81-700a2331ef3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:11.197184 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bb152-0bc1-45ce-bf81-700a2331ef3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:11.198877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bb152-0bc1-45ce-bf81-700a2331ef3b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:11.211684 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1011/2013] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:11.219459 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d7a2f-85ec-47bd-8939-e65b71276792 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:11.238964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d7a2f-85ec-47bd-8939-e65b71276792 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:11.249666 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf215ae2-ea0e-4cfe-a1dc-2cbb292f1fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:11.251780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf215ae2-ea0e-4cfe-a1dc-2cbb292f1fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:11.252467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf215ae2-ea0e-4cfe-a1dc-2cbb292f1fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:11.253211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf215ae2-ea0e-4cfe-a1dc-2cbb292f1fb1 admin admin] PATH_INFO: `/v3/projects/f9dce459b46b4c3982527da585a7ee34/users/11a1d909045d49508185f97d1f1c9549/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:11.289664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf215ae2-ea0e-4cfe-a1dc-2cbb292f1fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9dce459b46b4c3982527da585a7ee34, user_id=11a1d909045d49508185f97d1f1c9549, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:11.295789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf215ae2-ea0e-4cfe-a1dc-2cbb292f1fb1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:11.327013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1003/2014] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:11 2022] PUT /identity/v3/projects/f9dce459b46b4c3982527da585a7ee34/users/11a1d909045d49508185f97d1f1c9549/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:11.346453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36071e11-0c42-4896-ba1d-8a28cb03c024 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:11.346783 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36071e11-0c42-4896-ba1d-8a28cb03c024 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:11.347089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36071e11-0c42-4896-ba1d-8a28cb03c024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:11.386237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-36071e11-0c42-4896-ba1d-8a28cb03c024 None None] MFA Rules not processed for user `11a1d909045d49508185f97d1f1c9549`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:11.387612 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-36071e11-0c42-4896-ba1d-8a28cb03c024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:11.432936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:11.477339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1012/2015] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:11.482187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf215ae2-ea0e-4cfe-a1dc-2cbb292f1fb1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:11.558790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf215ae2-ea0e-4cfe-a1dc-2cbb292f1fb1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:11.563732 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48905b-665e-4665-a5b8-e67bfe2771e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:11.564426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48905b-665e-4665-a5b8-e67bfe2771e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:11.564708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48905b-665e-4665-a5b8-e67bfe2771e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:11.565008 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48905b-665e-4665-a5b8-e67bfe2771e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:11.565740 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48905b-665e-4665-a5b8-e67bfe2771e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:11.567738 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48905b-665e-4665-a5b8-e67bfe2771e5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:11.604475 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1004/2016] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:11 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:17:11.606801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36071e11-0c42-4896-ba1d-8a28cb03c024 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:11.625385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36071e11-0c42-4896-ba1d-8a28cb03c024 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:11.695873 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4600a56-ea0f-4e05-837e-9f688ea49136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:11.696584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600a56-ea0f-4e05-837e-9f688ea49136 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:11.696867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600a56-ea0f-4e05-837e-9f688ea49136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:11.697143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600a56-ea0f-4e05-837e-9f688ea49136 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:11.697848 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4600a56-ea0f-4e05-837e-9f688ea49136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:11.699843 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4600a56-ea0f-4e05-837e-9f688ea49136 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:11.727563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1013/2017] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:11 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:11.729082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48905b-665e-4665-a5b8-e67bfe2771e5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:11.748133 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48905b-665e-4665-a5b8-e67bfe2771e5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:11.757383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e0199-64c1-47ff-9e15-cb87a5fc821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:11.758483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e0199-64c1-47ff-9e15-cb87a5fc821a admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:11.760162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e0199-64c1-47ff-9e15-cb87a5fc821a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:11.760294 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e0199-64c1-47ff-9e15-cb87a5fc821a admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:11.761564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e0199-64c1-47ff-9e15-cb87a5fc821a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:11.764688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e0199-64c1-47ff-9e15-cb87a5fc821a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:11.773029 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4600a56-ea0f-4e05-837e-9f688ea49136 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:11.776536 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b4600a56-ea0f-4e05-837e-9f688ea49136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:11.790747 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1005/2018] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:11.792592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e0199-64c1-47ff-9e15-cb87a5fc821a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:11.800213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4600a56-ea0f-4e05-837e-9f688ea49136 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:11.808645 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c7e4a-f2b5-4a4c-81f2-d805ed074ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:11.809922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c7e4a-f2b5-4a4c-81f2-d805ed074ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:11.810146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e0199-64c1-47ff-9e15-cb87a5fc821a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:11.810300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c7e4a-f2b5-4a4c-81f2-d805ed074ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:11.810629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c7e4a-f2b5-4a4c-81f2-d805ed074ef2 admin admin] PATH_INFO: `/v3/users/79e46a80c74b4248a8a403fdbccb32dc` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:11.812185 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c7e4a-f2b5-4a4c-81f2-d805ed074ef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e46a80c74b4248a8a403fdbccb32dc)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:11.814383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c7e4a-f2b5-4a4c-81f2-d805ed074ef2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:11.816718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ca717-e1c6-4317-a6f3-f22d7e907a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:11.818063 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ca717-e1c6-4317-a6f3-f22d7e907a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:11.818863 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ca717-e1c6-4317-a6f3-f22d7e907a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:11.819064 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ca717-e1c6-4317-a6f3-f22d7e907a7a admin admin] PATH_INFO: `/v3/projects/779a2a87ebb74c11b6e33ad1e637bd86/users/3a8b96640b494d48a15eb69eef765f79/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:11.843417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ca717-e1c6-4317-a6f3-f22d7e907a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=779a2a87ebb74c11b6e33ad1e637bd86, user_id=3a8b96640b494d48a15eb69eef765f79, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:11.863612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ca717-e1c6-4317-a6f3-f22d7e907a7a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:11.882938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0c5c7e4a-f2b5-4a4c-81f2-d805ed074ef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e46a80c74b4248a8a403fdbccb32dc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:11.906568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1006/2019] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:11 2022] PUT /identity/v3/projects/779a2a87ebb74c11b6e33ad1e637bd86/users/3a8b96640b494d48a15eb69eef765f79/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:11.907980 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ca717-e1c6-4317-a6f3-f22d7e907a7a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:11.910130 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0c5c7e4a-f2b5-4a4c-81f2-d805ed074ef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e46a80c74b4248a8a403fdbccb32dc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:11.912152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0c5c7e4a-f2b5-4a4c-81f2-d805ed074ef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e46a80c74b4248a8a403fdbccb32dc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:11.960794 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0c5c7e4a-f2b5-4a4c-81f2-d805ed074ef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e46a80c74b4248a8a403fdbccb32dc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:11.963033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0c5c7e4a-f2b5-4a4c-81f2-d805ed074ef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e46a80c74b4248a8a403fdbccb32dc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:11.997250 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ca717-e1c6-4317-a6f3-f22d7e907a7a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:11.998224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1014/2020] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:11 2022] DELETE /identity/v3/users/79e46a80c74b4248a8a403fdbccb32dc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:12.004352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dac92-ace9-49b8-807d-3c7d2ef1ca6a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:12.004902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dac92-ace9-49b8-807d-3c7d2ef1ca6a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:12.005604 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dac92-ace9-49b8-807d-3c7d2ef1ca6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:12.024160 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:12.031662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-141dac92-ace9-49b8-807d-3c7d2ef1ca6a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:12.034308 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-141dac92-ace9-49b8-807d-3c7d2ef1ca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:12.088455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:12.095414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06fd4f-364b-4fa1-8345-7b707c6aa796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:12.096123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06fd4f-364b-4fa1-8345-7b707c6aa796 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:12.096413 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06fd4f-364b-4fa1-8345-7b707c6aa796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:12.096796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06fd4f-364b-4fa1-8345-7b707c6aa796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:12.097790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06fd4f-364b-4fa1-8345-7b707c6aa796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:12.100266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06fd4f-364b-4fa1-8345-7b707c6aa796 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:12.116664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1007/2021] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:12.122044 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06fd4f-364b-4fa1-8345-7b707c6aa796 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:12.125220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8a06fd4f-364b-4fa1-8345-7b707c6aa796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:12.135857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1015/2022] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:12.143842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06fd4f-364b-4fa1-8345-7b707c6aa796 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:12.146727 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dac92-ace9-49b8-807d-3c7d2ef1ca6a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:12.148286 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-141dac92-ace9-49b8-807d-3c7d2ef1ca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:12.156901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7465c2-74e3-4d3e-a54c-7f6326b265b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:12.158570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7465c2-74e3-4d3e-a54c-7f6326b265b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:12.159322 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7465c2-74e3-4d3e-a54c-7f6326b265b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:12.159863 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7465c2-74e3-4d3e-a54c-7f6326b265b6 admin admin] PATH_INFO: `/v3/projects/779a2a87ebb74c11b6e33ad1e637bd86/users/3a8b96640b494d48a15eb69eef765f79/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:12.163574 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7465c2-74e3-4d3e-a54c-7f6326b265b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779a2a87ebb74c11b6e33ad1e637bd86, user_id=3a8b96640b494d48a15eb69eef765f79, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:12.167980 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7465c2-74e3-4d3e-a54c-7f6326b265b6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:12.186454 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1008/2023] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:12 2022] PUT /identity/v3/projects/779a2a87ebb74c11b6e33ad1e637bd86/users/3a8b96640b494d48a15eb69eef765f79/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:12.198420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627db2c9-c245-4c27-842d-e55c2ae21e3c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:12.198731 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627db2c9-c245-4c27-842d-e55c2ae21e3c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:12.199011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627db2c9-c245-4c27-842d-e55c2ae21e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:12.236471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-627db2c9-c245-4c27-842d-e55c2ae21e3c None None] MFA Rules not processed for user `3a8b96640b494d48a15eb69eef765f79`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:12.237820 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-627db2c9-c245-4c27-842d-e55c2ae21e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:12.242639 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dac92-ace9-49b8-807d-3c7d2ef1ca6a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:12.324196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add9f7-7cb8-4677-ba21-a8dca8d8418f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:12.325664 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add9f7-7cb8-4677-ba21-a8dca8d8418f service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:12.325948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add9f7-7cb8-4677-ba21-a8dca8d8418f service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:12.326262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add9f7-7cb8-4677-ba21-a8dca8d8418f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:12.370969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1009/2024] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:12.390938 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627db2c9-c245-4c27-842d-e55c2ae21e3c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:12.394526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-627db2c9-c245-4c27-842d-e55c2ae21e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:12.456895 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42add9f7-7cb8-4677-ba21-a8dca8d8418f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:12.460462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42add9f7-7cb8-4677-ba21-a8dca8d8418f service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:12.488531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1016/2025] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:17:12.522999 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627db2c9-c245-4c27-842d-e55c2ae21e3c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:12.530637 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9058e-2fc4-4c12-a659-42685ef5d8bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:12.531980 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9058e-2fc4-4c12-a659-42685ef5d8bd service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:12.532881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9058e-2fc4-4c12-a659-42685ef5d8bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:12.532881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9058e-2fc4-4c12-a659-42685ef5d8bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:12.537004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-82b9058e-2fc4-4c12-a659-42685ef5d8bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:12.625031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:12.665846 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9058e-2fc4-4c12-a659-42685ef5d8bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:12.668921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9058e-2fc4-4c12-a659-42685ef5d8bd service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:12.693944 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1010/2026] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:17:13.000049 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add9f7-7cb8-4677-ba21-a8dca8d8418f service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:13.003166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-42add9f7-7cb8-4677-ba21-a8dca8d8418f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:13.060264 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add9f7-7cb8-4677-ba21-a8dca8d8418f service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:13.089036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:13.090032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:13.093273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:13.093649 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0 admin admin] PATH_INFO: `/v3/projects/0cfe8c2a973e4787829efadd588b2f70` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:13.095432 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cfe8c2a973e4787829efadd588b2f70)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:13.097742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:13.194456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:13.219644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cfe8c2a973e4787829efadd588b2f70', 'request_id': 'req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:13.233224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cfe8c2a973e4787829efadd588b2f70', 'request_id': 'req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:13.247307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cfe8c2a973e4787829efadd588b2f70', 'request_id': 'req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:13.272336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0 admin admin] The token cache is being invalidate because project 0cfe8c2a973e4787829efadd588b2f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:13.272856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:13.274211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7ebf6497-18c9-4fb7-aa13-a12b7781d1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:13.278299 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1017/2027] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:12 2022] DELETE /identity/v3/projects/0cfe8c2a973e4787829efadd588b2f70 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:13.285786 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e5c67-232f-4047-9f1c-91aa3ca2cbf3 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:13.287362 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e5c67-232f-4047-9f1c-91aa3ca2cbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:13.288602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e5c67-232f-4047-9f1c-91aa3ca2cbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:13.324891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e42e5c67-232f-4047-9f1c-91aa3ca2cbf3 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:13.326552 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e42e5c67-232f-4047-9f1c-91aa3ca2cbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:13.405544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1011/2028] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:13.415280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ae742-d86c-4e7c-8c32-559ed0cd72e7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:13.415573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ae742-d86c-4e7c-8c32-559ed0cd72e7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:13.415858 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ae742-d86c-4e7c-8c32-559ed0cd72e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:13.437373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-749ae742-d86c-4e7c-8c32-559ed0cd72e7 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:13.438637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-749ae742-d86c-4e7c-8c32-559ed0cd72e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:13.449657 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1018/2029] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:13.455106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e5c67-232f-4047-9f1c-91aa3ca2cbf3 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:13.473616 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e5c67-232f-4047-9f1c-91aa3ca2cbf3 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:13.478948 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2c7a1-15d7-4ccc-a246-7d616818ad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:13.479916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2c7a1-15d7-4ccc-a246-7d616818ad37 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:13.480255 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2c7a1-15d7-4ccc-a246-7d616818ad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:13.480609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2c7a1-15d7-4ccc-a246-7d616818ad37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:13.481431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2c7a1-15d7-4ccc-a246-7d616818ad37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:17:13.481751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2c7a1-15d7-4ccc-a246-7d616818ad37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:13.483485 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2c7a1-15d7-4ccc-a246-7d616818ad37 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:13.498990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1012/2030] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:17:13.503507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ae742-d86c-4e7c-8c32-559ed0cd72e7 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:13.513460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ae742-d86c-4e7c-8c32-559ed0cd72e7 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:13.518580 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adb384-8ab5-43b1-aecf-07bf2666792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:13.519331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb384-8ab5-43b1-aecf-07bf2666792f admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:13.519616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb384-8ab5-43b1-aecf-07bf2666792f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:13.519896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb384-8ab5-43b1-aecf-07bf2666792f admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:13.520633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adb384-8ab5-43b1-aecf-07bf2666792f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:13.522639 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adb384-8ab5-43b1-aecf-07bf2666792f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:13.553108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1019/2031] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:13 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:13.558081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2c7a1-15d7-4ccc-a246-7d616818ad37 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:13.570054 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2c7a1-15d7-4ccc-a246-7d616818ad37 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:13.638359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c2b01-bfbb-496c-a6f6-574f64cdc00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:13.639326 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c2b01-bfbb-496c-a6f6-574f64cdc00b admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:13.639607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c2b01-bfbb-496c-a6f6-574f64cdc00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:13.639887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c2b01-bfbb-496c-a6f6-574f64cdc00b admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:13.640636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c2b01-bfbb-496c-a6f6-574f64cdc00b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:13.642633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c2b01-bfbb-496c-a6f6-574f64cdc00b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:13.664492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1013/2032] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:13 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:13.669177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adb384-8ab5-43b1-aecf-07bf2666792f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:13.686005 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adb384-8ab5-43b1-aecf-07bf2666792f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:13.693586 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e1a72-ca9d-48d3-b3d0-801047707dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:13.694841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e1a72-ca9d-48d3-b3d0-801047707dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:13.695349 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e1a72-ca9d-48d3-b3d0-801047707dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:13.695870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e1a72-ca9d-48d3-b3d0-801047707dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:13.697252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e1a72-ca9d-48d3-b3d0-801047707dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:13.700445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e1a72-ca9d-48d3-b3d0-801047707dd3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:13.712824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1020/2033] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:13.717395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c2b01-bfbb-496c-a6f6-574f64cdc00b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:13.729050 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c2b01-bfbb-496c-a6f6-574f64cdc00b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:13.735287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03e0a0-8ad1-406b-b8aa-4ccfe8ec0496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:13.736581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03e0a0-8ad1-406b-b8aa-4ccfe8ec0496 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:13.737142 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03e0a0-8ad1-406b-b8aa-4ccfe8ec0496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:13.737610 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03e0a0-8ad1-406b-b8aa-4ccfe8ec0496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:13.739208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03e0a0-8ad1-406b-b8aa-4ccfe8ec0496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:13.742130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03e0a0-8ad1-406b-b8aa-4ccfe8ec0496 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:13.762381 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1014/2034] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:13.767461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e1a72-ca9d-48d3-b3d0-801047707dd3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:13.781877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e1a72-ca9d-48d3-b3d0-801047707dd3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:13.787495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4ad1e-7d3c-45b0-9f00-6d514f8df645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:13.788446 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4ad1e-7d3c-45b0-9f00-6d514f8df645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:13.788734 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4ad1e-7d3c-45b0-9f00-6d514f8df645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:13.789009 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4ad1e-7d3c-45b0-9f00-6d514f8df645 admin admin] PATH_INFO: `/v3/projects/767caa74e71f4053950b576a6b91566f/users/b4cf347f1689407c96235188db1c03d7/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:13.807527 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4ad1e-7d3c-45b0-9f00-6d514f8df645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767caa74e71f4053950b576a6b91566f, user_id=b4cf347f1689407c96235188db1c03d7, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:13.810436 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4ad1e-7d3c-45b0-9f00-6d514f8df645 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:13.831565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1021/2035] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:13 2022] PUT /identity/v3/projects/767caa74e71f4053950b576a6b91566f/users/b4cf347f1689407c96235188db1c03d7/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:13.846719 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeff8d7-7257-4e49-ac2e-03dced5a555e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:13.847011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeff8d7-7257-4e49-ac2e-03dced5a555e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:13.847291 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeff8d7-7257-4e49-ac2e-03dced5a555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:13.877127 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7eeff8d7-7257-4e49-ac2e-03dced5a555e None None] MFA Rules not processed for user `b4cf347f1689407c96235188db1c03d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:13.878336 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7eeff8d7-7257-4e49-ac2e-03dced5a555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:13.919063 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:13.963015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1015/2036] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:13.982304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4ad1e-7d3c-45b0-9f00-6d514f8df645 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:13.984834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e2e4ad1e-7d3c-45b0-9f00-6d514f8df645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:14.070950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4ad1e-7d3c-45b0-9f00-6d514f8df645 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:14.075279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5dddb-c80d-4bc9-ab91-920a110e7ea1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10611bf25b9e4604ad769a6902f7f457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:14.075949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5dddb-c80d-4bc9-ab91-920a110e7ea1 service glance] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:14.076230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5dddb-c80d-4bc9-ab91-920a110e7ea1 service glance] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:14.076503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5dddb-c80d-4bc9-ab91-920a110e7ea1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:14.088318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5dddb-c80d-4bc9-ab91-920a110e7ea1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:14.089790 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5dddb-c80d-4bc9-ab91-920a110e7ea1 service glance] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:14.100233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1022/2037] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:15.605599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeff8d7-7257-4e49-ac2e-03dced5a555e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:15.607132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7eeff8d7-7257-4e49-ac2e-03dced5a555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:15.677403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeff8d7-7257-4e49-ac2e-03dced5a555e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:15.683447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d88aa-f723-40f0-acb0-9095951ded3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:15.684339 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d88aa-f723-40f0-acb0-9095951ded3e service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:15.684776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d88aa-f723-40f0-acb0-9095951ded3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:15.685180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d88aa-f723-40f0-acb0-9095951ded3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:15.687684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-af2d88aa-f723-40f0-acb0-9095951ded3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:15.808773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d88aa-f723-40f0-acb0-9095951ded3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:15.812885 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d88aa-f723-40f0-acb0-9095951ded3e service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:15.831339 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1016/2038] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:24.095452 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=72,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:25.825482 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=61 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:26.304338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5dddb-c80d-4bc9-ab91-920a110e7ea1 service glance] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:26.315685 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5dddb-c80d-4bc9-ab91-920a110e7ea1 service glance] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:26.319886 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca8551-daa1-4c91-84a5-c846a125d56e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:26.320577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca8551-daa1-4c91-84a5-c846a125d56e service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:26.320868 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca8551-daa1-4c91-84a5-c846a125d56e service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:26.321139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca8551-daa1-4c91-84a5-c846a125d56e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:26.323150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c0ca8551-daa1-4c91-84a5-c846a125d56e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:26.400552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca8551-daa1-4c91-84a5-c846a125d56e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:26.402198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca8551-daa1-4c91-84a5-c846a125d56e service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:26.414035 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1023/2039] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:27.000272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95061a-16c1-41e8-95da-a0c1e0c4bb3e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:27.000809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95061a-16c1-41e8-95da-a0c1e0c4bb3e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:27.000886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95061a-16c1-41e8-95da-a0c1e0c4bb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:27.030054 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8a95061a-16c1-41e8-95da-a0c1e0c4bb3e None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:27.031450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8a95061a-16c1-41e8-95da-a0c1e0c4bb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:27.136820 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1017/2040] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:17:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:27.217070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca8551-daa1-4c91-84a5-c846a125d56e service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:27.225493 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c0ca8551-daa1-4c91-84a5-c846a125d56e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:27.358718 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca8551-daa1-4c91-84a5-c846a125d56e service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:27.368975 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafd16c-9ddb-4a10-ba18-3cf216cc6b76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:27.369881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd16c-9ddb-4a10-ba18-3cf216cc6b76 service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:27.370340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd16c-9ddb-4a10-ba18-3cf216cc6b76 service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:27.370821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd16c-9ddb-4a10-ba18-3cf216cc6b76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:27.387170 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafd16c-9ddb-4a10-ba18-3cf216cc6b76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:27.388803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafd16c-9ddb-4a10-ba18-3cf216cc6b76 service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:27.398996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1024/2041] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:17:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:17:28.218078 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff704e-092e-4991-9d83-a0b347da483e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:28.218765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff704e-092e-4991-9d83-a0b347da483e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:28.218765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff704e-092e-4991-9d83-a0b347da483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:28.239030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c7ff704e-092e-4991-9d83-a0b347da483e None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:28.240301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c7ff704e-092e-4991-9d83-a0b347da483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:28.248245 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1018/2042] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jul 21 12:17:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:28.266327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafd16c-9ddb-4a10-ba18-3cf216cc6b76 service swift] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:28.278340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafd16c-9ddb-4a10-ba18-3cf216cc6b76 service swift] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:28.284924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee43d2a-0190-4ea7-a54b-c6e2867e4bf8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:28.285786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee43d2a-0190-4ea7-a54b-c6e2867e4bf8 service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:28.286206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee43d2a-0190-4ea7-a54b-c6e2867e4bf8 service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:28.286629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee43d2a-0190-4ea7-a54b-c6e2867e4bf8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:28.299833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee43d2a-0190-4ea7-a54b-c6e2867e4bf8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:28.301626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee43d2a-0190-4ea7-a54b-c6e2867e4bf8 service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:28.312069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1025/2043] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:17:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:17:28.658307 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d6026-14c1-4dbe-90b5-73e00d6d80a7 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:28.658854 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d6026-14c1-4dbe-90b5-73e00d6d80a7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:28.659354 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d6026-14c1-4dbe-90b5-73e00d6d80a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:28.681037 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d32d6026-14c1-4dbe-90b5-73e00d6d80a7 None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:28.682373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d32d6026-14c1-4dbe-90b5-73e00d6d80a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:28.690462 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1019/2044] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:17:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:28.704347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee43d2a-0190-4ea7-a54b-c6e2867e4bf8 service swift] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:28.722006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee43d2a-0190-4ea7-a54b-c6e2867e4bf8 service swift] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:28.728079 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc31a-a4ea-4aff-a495-fc0d26718e3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:28.728760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc31a-a4ea-4aff-a495-fc0d26718e3d service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:28.729042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc31a-a4ea-4aff-a495-fc0d26718e3d service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:28.729321 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc31a-a4ea-4aff-a495-fc0d26718e3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:28.742959 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcc31a-a4ea-4aff-a495-fc0d26718e3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:28.744980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcc31a-a4ea-4aff-a495-fc0d26718e3d service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:28.756265 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1026/2045] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:17:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 12:17:29.228745 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7263a7e-3ffc-4a19-b0f4-a580f16f5982 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:29.229383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7263a7e-3ffc-4a19-b0f4-a580f16f5982 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:29.229626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7263a7e-3ffc-4a19-b0f4-a580f16f5982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:29.254938 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d7263a7e-3ffc-4a19-b0f4-a580f16f5982 None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:29.256554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d7263a7e-3ffc-4a19-b0f4-a580f16f5982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:29.265097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1020/2046] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jul 21 12:17:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:29.288893 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc31a-a4ea-4aff-a495-fc0d26718e3d service swift] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:29.306937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc31a-a4ea-4aff-a495-fc0d26718e3d service swift] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:29.313135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996927e-2810-43a8-a6ae-f2cc2c840d78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:29.313820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996927e-2810-43a8-a6ae-f2cc2c840d78 service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:29.314299 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996927e-2810-43a8-a6ae-f2cc2c840d78 service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:29.314584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996927e-2810-43a8-a6ae-f2cc2c840d78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:29.327924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996927e-2810-43a8-a6ae-f2cc2c840d78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:29.329556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996927e-2810-43a8-a6ae-f2cc2c840d78 service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:29.343826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1027/2047] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:17:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:17:29.688945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7263a7e-3ffc-4a19-b0f4-a580f16f5982 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:29.691410 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d7263a7e-3ffc-4a19-b0f4-a580f16f5982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:29.811101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7263a7e-3ffc-4a19-b0f4-a580f16f5982 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:29.816432 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ce31-c656-4a99-94ca-1d344508a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:29.817361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ce31-c656-4a99-94ca-1d344508a154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:29.817644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ce31-c656-4a99-94ca-1d344508a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:29.817921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ce31-c656-4a99-94ca-1d344508a154 admin admin] PATH_INFO: `/v3/users/11a1d909045d49508185f97d1f1c9549` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:29.820576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4ce31-c656-4a99-94ca-1d344508a154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a1d909045d49508185f97d1f1c9549)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:29.822698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4ce31-c656-4a99-94ca-1d344508a154 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:29.894203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bff4ce31-c656-4a99-94ca-1d344508a154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a1d909045d49508185f97d1f1c9549'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:29.895091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bff4ce31-c656-4a99-94ca-1d344508a154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a1d909045d49508185f97d1f1c9549'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:29.912700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bff4ce31-c656-4a99-94ca-1d344508a154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a1d909045d49508185f97d1f1c9549'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:29.922091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bff4ce31-c656-4a99-94ca-1d344508a154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a1d909045d49508185f97d1f1c9549'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:29.923876 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bff4ce31-c656-4a99-94ca-1d344508a154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a1d909045d49508185f97d1f1c9549'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:29.943050 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1021/2048] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:29 2022] DELETE /identity/v3/users/11a1d909045d49508185f97d1f1c9549 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:29.949302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040cc1-5735-4ea5-861b-6125df1af497 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:29.950077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040cc1-5735-4ea5-861b-6125df1af497 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:29.951079 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040cc1-5735-4ea5-861b-6125df1af497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:29.976157 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-53040cc1-5735-4ea5-861b-6125df1af497 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:29.986543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-53040cc1-5735-4ea5-861b-6125df1af497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:30.061280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:30.098536 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1028/2049] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:30.113167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ce31-c656-4a99-94ca-1d344508a154 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:30.115050 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bff4ce31-c656-4a99-94ca-1d344508a154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:30.126796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:30.233635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ce31-c656-4a99-94ca-1d344508a154 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:30.247949 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329be4f0-a7cb-4bc3-b280-530fbb824a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:30.248824 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329be4f0-a7cb-4bc3-b280-530fbb824a13 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:30.249203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329be4f0-a7cb-4bc3-b280-530fbb824a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:30.249922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329be4f0-a7cb-4bc3-b280-530fbb824a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:30.274114 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329be4f0-a7cb-4bc3-b280-530fbb824a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:30.276032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329be4f0-a7cb-4bc3-b280-530fbb824a13 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:30.288840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1022/2050] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:30.888694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53040cc1-5735-4ea5-861b-6125df1af497 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:30.891417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-53040cc1-5735-4ea5-861b-6125df1af497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:30.934013 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53040cc1-5735-4ea5-861b-6125df1af497 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:30.951810 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:30.953314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:30.953642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:30.954180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] PATH_INFO: `/v3/projects/f9dce459b46b4c3982527da585a7ee34` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:30.955884 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9dce459b46b4c3982527da585a7ee34)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:30.971288 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:31.043513 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9dce459b46b4c3982527da585a7ee34', 'request_id': 'req-efc48245-638c-41b5-8002-9485e1a9e8d6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.053872 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9dce459b46b4c3982527da585a7ee34', 'request_id': 'req-efc48245-638c-41b5-8002-9485e1a9e8d6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.062096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9dce459b46b4c3982527da585a7ee34', 'request_id': 'req-efc48245-638c-41b5-8002-9485e1a9e8d6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.080333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] The token cache is being invalidate because project f9dce459b46b4c3982527da585a7ee34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:31.080632 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.081437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.083237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1029/2051] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:30 2022] DELETE /identity/v3/projects/f9dce459b46b4c3982527da585a7ee34 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:31.088016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329be4f0-a7cb-4bc3-b280-530fbb824a13 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:31.100900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329be4f0-a7cb-4bc3-b280-530fbb824a13 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:31.196498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb00a0-e368-4bfd-9efd-99959dcebb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:31.198077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb00a0-e368-4bfd-9efd-99959dcebb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:31.198588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb00a0-e368-4bfd-9efd-99959dcebb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:31.199122 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb00a0-e368-4bfd-9efd-99959dcebb71 admin admin] PATH_INFO: `/v3/users/3a8b96640b494d48a15eb69eef765f79` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:31.201443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb00a0-e368-4bfd-9efd-99959dcebb71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8b96640b494d48a15eb69eef765f79)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:31.205071 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb00a0-e368-4bfd-9efd-99959dcebb71 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:31.266092 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c0fb00a0-e368-4bfd-9efd-99959dcebb71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8b96640b494d48a15eb69eef765f79'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.266885 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c0fb00a0-e368-4bfd-9efd-99959dcebb71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8b96640b494d48a15eb69eef765f79'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.280877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c0fb00a0-e368-4bfd-9efd-99959dcebb71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8b96640b494d48a15eb69eef765f79'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.288964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c0fb00a0-e368-4bfd-9efd-99959dcebb71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8b96640b494d48a15eb69eef765f79'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.289736 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c0fb00a0-e368-4bfd-9efd-99959dcebb71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8b96640b494d48a15eb69eef765f79'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.304892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1023/2052] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:31 2022] DELETE /identity/v3/users/3a8b96640b494d48a15eb69eef765f79 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:31.767179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:31.769243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:31.782854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc48245-638c-41b5-8002-9485e1a9e8d6 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:31.855990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:31.857144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:31.857436 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:31.857722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3 admin admin] PATH_INFO: `/v3/projects/779a2a87ebb74c11b6e33ad1e637bd86` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:31.859016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=779a2a87ebb74c11b6e33ad1e637bd86)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:31.861004 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:31.919597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779a2a87ebb74c11b6e33ad1e637bd86', 'request_id': 'req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.930808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779a2a87ebb74c11b6e33ad1e637bd86', 'request_id': 'req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.939227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779a2a87ebb74c11b6e33ad1e637bd86', 'request_id': 'req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.947000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:31.952914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3 admin admin] The token cache is being invalidate because project 779a2a87ebb74c11b6e33ad1e637bd86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:31.953631 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.954717 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c582907e-21c7-4b0e-916f-ab6ae3b34fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:31.956678 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1030/2053] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:31 2022] DELETE /identity/v3/projects/779a2a87ebb74c11b6e33ad1e637bd86 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:31.963978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b9fe1-a609-465a-a9cb-7c6a61112afb None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:31.964346 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b9fe1-a609-465a-a9cb-7c6a61112afb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:31.965820 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b9fe1-a609-465a-a9cb-7c6a61112afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:31.985789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-6f7b9fe1-a609-465a-a9cb-7c6a61112afb None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:31.987331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6f7b9fe1-a609-465a-a9cb-7c6a61112afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:32.014624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:32.059528 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1024/2054] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:32.067479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30cf8d-d5b6-4f0c-8355-332af646330f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:32.067869 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30cf8d-d5b6-4f0c-8355-332af646330f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:32.068160 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30cf8d-d5b6-4f0c-8355-332af646330f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:32.098548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4d30cf8d-d5b6-4f0c-8355-332af646330f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:32.099803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4d30cf8d-d5b6-4f0c-8355-332af646330f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:32.107975 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1031/2055] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:32.112563 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b9fe1-a609-465a-a9cb-7c6a61112afb None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:32.122687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b9fe1-a609-465a-a9cb-7c6a61112afb None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:32.127407 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f609cfd-705a-4ebf-a3f5-434c34aec311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:32.128078 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f609cfd-705a-4ebf-a3f5-434c34aec311 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:32.128360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f609cfd-705a-4ebf-a3f5-434c34aec311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:32.128642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f609cfd-705a-4ebf-a3f5-434c34aec311 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:32.129375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f609cfd-705a-4ebf-a3f5-434c34aec311 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:17:32.129681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f609cfd-705a-4ebf-a3f5-434c34aec311 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:32.131384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f609cfd-705a-4ebf-a3f5-434c34aec311 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:32.145099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1025/2056] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:17:32.152846 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30cf8d-d5b6-4f0c-8355-332af646330f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:32.164348 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30cf8d-d5b6-4f0c-8355-332af646330f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:32.169375 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ae1e6-f672-456b-9a3e-c3c484835f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:32.170158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ae1e6-f672-456b-9a3e-c3c484835f21 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:32.170447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ae1e6-f672-456b-9a3e-c3c484835f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:32.170827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ae1e6-f672-456b-9a3e-c3c484835f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:32.171636 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ae1e6-f672-456b-9a3e-c3c484835f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:32.174213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ae1e6-f672-456b-9a3e-c3c484835f21 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:32.174785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f609cfd-705a-4ebf-a3f5-434c34aec311 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:32.176988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0f609cfd-705a-4ebf-a3f5-434c34aec311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:32.201318 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f609cfd-705a-4ebf-a3f5-434c34aec311 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:32.206328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1032/2057] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:32 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:32.208035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca79bbd-b54d-4a80-a1eb-1a3b0fc2a38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:32.209182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca79bbd-b54d-4a80-a1eb-1a3b0fc2a38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:32.209695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca79bbd-b54d-4a80-a1eb-1a3b0fc2a38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:32.209800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca79bbd-b54d-4a80-a1eb-1a3b0fc2a38c admin admin] PATH_INFO: `/v3/users/c8564d0929bf445e937ac4d58507f06e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:32.210592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ae1e6-f672-456b-9a3e-c3c484835f21 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:32.211209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca79bbd-b54d-4a80-a1eb-1a3b0fc2a38c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8564d0929bf445e937ac4d58507f06e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:32.213412 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca79bbd-b54d-4a80-a1eb-1a3b0fc2a38c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:32.277594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3ca79bbd-b54d-4a80-a1eb-1a3b0fc2a38c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8564d0929bf445e937ac4d58507f06e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:32.278638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3ca79bbd-b54d-4a80-a1eb-1a3b0fc2a38c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8564d0929bf445e937ac4d58507f06e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:32.285466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ae1e6-f672-456b-9a3e-c3c484835f21 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:32.291348 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e411bd7-784f-4a1f-8b09-55f87717f042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:32.292039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e411bd7-784f-4a1f-8b09-55f87717f042 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:32.292324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e411bd7-784f-4a1f-8b09-55f87717f042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:32.292627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e411bd7-784f-4a1f-8b09-55f87717f042 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:32.293377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e411bd7-784f-4a1f-8b09-55f87717f042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:32.295467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e411bd7-784f-4a1f-8b09-55f87717f042 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:32.300421 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3ca79bbd-b54d-4a80-a1eb-1a3b0fc2a38c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8564d0929bf445e937ac4d58507f06e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:32.317737 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3ca79bbd-b54d-4a80-a1eb-1a3b0fc2a38c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8564d0929bf445e937ac4d58507f06e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:32.318816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3ca79bbd-b54d-4a80-a1eb-1a3b0fc2a38c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8564d0929bf445e937ac4d58507f06e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:32.322810 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1033/2058] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:32 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:17:32.324372 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e411bd7-784f-4a1f-8b09-55f87717f042 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:32.326817 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6e411bd7-784f-4a1f-8b09-55f87717f042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:32.340641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1026/2059] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:32 2022] DELETE /identity/v3/users/c8564d0929bf445e937ac4d58507f06e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:32.342327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e411bd7-784f-4a1f-8b09-55f87717f042 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:32.347709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7d921-719d-49a2-b380-44f36ff6eb09 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:32.348112 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7d921-719d-49a2-b380-44f36ff6eb09 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:32.348475 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7d921-719d-49a2-b380-44f36ff6eb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:32.369485 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-31e7d921-719d-49a2-b380-44f36ff6eb09 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:32.370742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-31e7d921-719d-49a2-b380-44f36ff6eb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:32.413630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864547ce-560b-4dd4-a61c-6f492aec6a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:32.414690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864547ce-560b-4dd4-a61c-6f492aec6a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:32.415141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864547ce-560b-4dd4-a61c-6f492aec6a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:32.415576 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864547ce-560b-4dd4-a61c-6f492aec6a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:32.416832 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864547ce-560b-4dd4-a61c-6f492aec6a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:32.419579 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864547ce-560b-4dd4-a61c-6f492aec6a7e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:32.434155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1034/2060] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:32.440522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864547ce-560b-4dd4-a61c-6f492aec6a7e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:32.451465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864547ce-560b-4dd4-a61c-6f492aec6a7e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:32.457649 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1027/2061] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:32.467741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba695a-be68-44b6-998c-68fe5db1c360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:32.468778 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba695a-be68-44b6-998c-68fe5db1c360 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:32.469440 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba695a-be68-44b6-998c-68fe5db1c360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:32.469770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba695a-be68-44b6-998c-68fe5db1c360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:32.470770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba695a-be68-44b6-998c-68fe5db1c360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:32.472650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba695a-be68-44b6-998c-68fe5db1c360 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:32.474160 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7d921-719d-49a2-b380-44f36ff6eb09 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:32.475852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-31e7d921-719d-49a2-b380-44f36ff6eb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:32.496740 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1035/2062] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:32.498219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba695a-be68-44b6-998c-68fe5db1c360 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:32.509704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba695a-be68-44b6-998c-68fe5db1c360 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:32.512466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:32.516807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1749a-39c5-4949-99bb-44f2f1c8379e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:32.517767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1749a-39c5-4949-99bb-44f2f1c8379e admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:32.518093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1749a-39c5-4949-99bb-44f2f1c8379e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:32.518416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1749a-39c5-4949-99bb-44f2f1c8379e admin admin] PATH_INFO: `/v3/projects/946b5a3e95164e61abe7aa1aa16ba5a8/users/a0a0a521bf05492cbdddde6d9f9743d8/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:32.538949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1749a-39c5-4949-99bb-44f2f1c8379e admin admin] RBAC: Authorizing `identity:create_grant(project_id=946b5a3e95164e61abe7aa1aa16ba5a8, user_id=a0a0a521bf05492cbdddde6d9f9743d8, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:32.541646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1749a-39c5-4949-99bb-44f2f1c8379e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:32.550167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7d921-719d-49a2-b380-44f36ff6eb09 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:32.556409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1036/2063] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:32 2022] PUT /identity/v3/projects/946b5a3e95164e61abe7aa1aa16ba5a8/users/a0a0a521bf05492cbdddde6d9f9743d8/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:32.567016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d927dd6-03f7-40bf-b0ab-630060b8e10d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:32.567434 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d927dd6-03f7-40bf-b0ab-630060b8e10d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:32.567840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d927dd6-03f7-40bf-b0ab-630060b8e10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:32.597514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3d927dd6-03f7-40bf-b0ab-630060b8e10d None None] MFA Rules not processed for user `a0a0a521bf05492cbdddde6d9f9743d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:32.598782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3d927dd6-03f7-40bf-b0ab-630060b8e10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:32.608592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:32.623657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e5f82-9e57-464a-a3a4-7158c076b6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:32.625030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e5f82-9e57-464a-a3a4-7158c076b6af service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:32.625544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e5f82-9e57-464a-a3a4-7158c076b6af service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:32.626019 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e5f82-9e57-464a-a3a4-7158c076b6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:32.672442 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1037/2064] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:32.678320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d927dd6-03f7-40bf-b0ab-630060b8e10d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:32.719359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e5f82-9e57-464a-a3a4-7158c076b6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:32.720426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e5f82-9e57-464a-a3a4-7158c076b6af service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:32.741040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1028/2065] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:17:32.776265 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d927dd6-03f7-40bf-b0ab-630060b8e10d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:32.782409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d16103-32be-4235-a972-8621cc730806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:32.783195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d16103-32be-4235-a972-8621cc730806 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:32.783559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d16103-32be-4235-a972-8621cc730806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:32.784074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d16103-32be-4235-a972-8621cc730806 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:32.784860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d16103-32be-4235-a972-8621cc730806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:32.789017 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d16103-32be-4235-a972-8621cc730806 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:32.860277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1038/2066] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:32 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:17:32.867404 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e5f82-9e57-464a-a3a4-7158c076b6af service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:32.898074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e5f82-9e57-464a-a3a4-7158c076b6af service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:32.988886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568d11e-9a6e-4e66-993d-c3cbacc34264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:32.989808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568d11e-9a6e-4e66-993d-c3cbacc34264 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:32.990189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568d11e-9a6e-4e66-993d-c3cbacc34264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:32.990560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568d11e-9a6e-4e66-993d-c3cbacc34264 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:32.991778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568d11e-9a6e-4e66-993d-c3cbacc34264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:32.995872 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568d11e-9a6e-4e66-993d-c3cbacc34264 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:33.038625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1029/2067] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:32 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:33.043993 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d16103-32be-4235-a972-8621cc730806 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:33.058973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d16103-32be-4235-a972-8621cc730806 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:33.069275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54849ec-1e3d-4612-8e04-5ae498fbcde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:33.070366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54849ec-1e3d-4612-8e04-5ae498fbcde0 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.071005 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54849ec-1e3d-4612-8e04-5ae498fbcde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.071491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54849ec-1e3d-4612-8e04-5ae498fbcde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.072732 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54849ec-1e3d-4612-8e04-5ae498fbcde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:33.075722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54849ec-1e3d-4612-8e04-5ae498fbcde0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:33.096338 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568d11e-9a6e-4e66-993d-c3cbacc34264 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:33.105222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d568d11e-9a6e-4e66-993d-c3cbacc34264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:33.107498 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1039/2068] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:33.122361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54849ec-1e3d-4612-8e04-5ae498fbcde0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:33.165554 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54849ec-1e3d-4612-8e04-5ae498fbcde0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:33.175375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568d11e-9a6e-4e66-993d-c3cbacc34264 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:33.184529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e9872-6ae2-4877-8f5f-2f371b044982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:33.186584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e9872-6ae2-4877-8f5f-2f371b044982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.188741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e9872-6ae2-4877-8f5f-2f371b044982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.189299 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e9872-6ae2-4877-8f5f-2f371b044982 admin admin] PATH_INFO: `/v3/projects/d73dcff74c5c4f4bad9e96bdf8d791a3/users/c4d4b6c5330f451a88207803be270754/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.193691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5de6a2-306a-4075-b176-af7e23d6ae75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:33.195215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de6a2-306a-4075-b176-af7e23d6ae75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.195665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de6a2-306a-4075-b176-af7e23d6ae75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.196085 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de6a2-306a-4075-b176-af7e23d6ae75 admin admin] PATH_INFO: `/v3/projects/90aaad3874fe4457bbadecf5dc8be832` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.197874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5de6a2-306a-4075-b176-af7e23d6ae75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90aaad3874fe4457bbadecf5dc8be832)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:33.200267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5de6a2-306a-4075-b176-af7e23d6ae75 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:33.233484 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e9872-6ae2-4877-8f5f-2f371b044982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73dcff74c5c4f4bad9e96bdf8d791a3, user_id=c4d4b6c5330f451a88207803be270754, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:33.233703 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:33.236291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e9872-6ae2-4877-8f5f-2f371b044982 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:33.278056 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1040/2069] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:33 2022] PUT /identity/v3/projects/d73dcff74c5c4f4bad9e96bdf8d791a3/users/c4d4b6c5330f451a88207803be270754/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:33.279637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e9872-6ae2-4877-8f5f-2f371b044982 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:33.299452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5d5de6a2-306a-4075-b176-af7e23d6ae75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90aaad3874fe4457bbadecf5dc8be832', 'request_id': 'req-5d5de6a2-306a-4075-b176-af7e23d6ae75'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:33.312300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5d5de6a2-306a-4075-b176-af7e23d6ae75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90aaad3874fe4457bbadecf5dc8be832', 'request_id': 'req-5d5de6a2-306a-4075-b176-af7e23d6ae75'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:33.320277 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5d5de6a2-306a-4075-b176-af7e23d6ae75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90aaad3874fe4457bbadecf5dc8be832', 'request_id': 'req-5d5de6a2-306a-4075-b176-af7e23d6ae75'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:33.347060 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5d5de6a2-306a-4075-b176-af7e23d6ae75 admin admin] The token cache is being invalidate because project 90aaad3874fe4457bbadecf5dc8be832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:33.347060 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5d5de6a2-306a-4075-b176-af7e23d6ae75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:33.348208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5d5de6a2-306a-4075-b176-af7e23d6ae75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:33.350071 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1030/2070] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:33 2022] DELETE /identity/v3/projects/90aaad3874fe4457bbadecf5dc8be832 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:33.359616 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb87c0e-01a5-4358-a0b2-b25bee734b20 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.360251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb87c0e-01a5-4358-a0b2-b25bee734b20 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.360673 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb87c0e-01a5-4358-a0b2-b25bee734b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.383809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fdb87c0e-01a5-4358-a0b2-b25bee734b20 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:33.385392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fdb87c0e-01a5-4358-a0b2-b25bee734b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:33.394555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e9872-6ae2-4877-8f5f-2f371b044982 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:33.398943 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:33.473407 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f63f4b-aa54-46ac-98d4-e949f036117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:33.474466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63f4b-aa54-46ac-98d4-e949f036117c admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.475051 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63f4b-aa54-46ac-98d4-e949f036117c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.475623 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63f4b-aa54-46ac-98d4-e949f036117c admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.476797 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f63f4b-aa54-46ac-98d4-e949f036117c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:33.480309 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f63f4b-aa54-46ac-98d4-e949f036117c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:33.488083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1031/2071] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:33.491671 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9b8c9-e802-41f0-922a-563d4eef1047 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.491994 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9b8c9-e802-41f0-922a-563d4eef1047 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.492272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9b8c9-e802-41f0-922a-563d4eef1047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.501442 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1041/2072] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:33.502703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f63f4b-aa54-46ac-98d4-e949f036117c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:33.504533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-80f63f4b-aa54-46ac-98d4-e949f036117c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:33.512799 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-89c9b8c9-e802-41f0-922a-563d4eef1047 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:33.514049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-89c9b8c9-e802-41f0-922a-563d4eef1047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:33.517747 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f63f4b-aa54-46ac-98d4-e949f036117c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:33.522157 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1032/2073] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:33.522500 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c7f4e-a36b-4644-a629-62687b3095cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:33.523449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7f4e-a36b-4644-a629-62687b3095cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.523738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7f4e-a36b-4644-a629-62687b3095cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.524013 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7f4e-a36b-4644-a629-62687b3095cc admin admin] PATH_INFO: `/v3/projects/d73dcff74c5c4f4bad9e96bdf8d791a3/users/c4d4b6c5330f451a88207803be270754/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.526082 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c7f4e-a36b-4644-a629-62687b3095cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73dcff74c5c4f4bad9e96bdf8d791a3, user_id=c4d4b6c5330f451a88207803be270754, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:33.526737 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9b8c9-e802-41f0-922a-563d4eef1047 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:33.528810 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c7f4e-a36b-4644-a629-62687b3095cc admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:33.536878 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9b8c9-e802-41f0-922a-563d4eef1047 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:33.541426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1042/2074] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:33 2022] PUT /identity/v3/projects/d73dcff74c5c4f4bad9e96bdf8d791a3/users/c4d4b6c5330f451a88207803be270754/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:33.554008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f1220-4aec-40fc-8293-25d2c45bd983 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.554302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f1220-4aec-40fc-8293-25d2c45bd983 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.554536 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f1220-4aec-40fc-8293-25d2c45bd983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.592438 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4e0f1220-4aec-40fc-8293-25d2c45bd983 None None] MFA Rules not processed for user `c4d4b6c5330f451a88207803be270754`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:33.593749 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4e0f1220-4aec-40fc-8293-25d2c45bd983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:33.613032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e54fc-9eaa-49c6-be74-da936d9f6f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:33.614220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e54fc-9eaa-49c6-be74-da936d9f6f27 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.614220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e54fc-9eaa-49c6-be74-da936d9f6f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.614515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e54fc-9eaa-49c6-be74-da936d9f6f27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.615454 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e54fc-9eaa-49c6-be74-da936d9f6f27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:17:33.615907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e54fc-9eaa-49c6-be74-da936d9f6f27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:33.617583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e54fc-9eaa-49c6-be74-da936d9f6f27 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:33.638990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1033/2075] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:17:33.640116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e54fc-9eaa-49c6-be74-da936d9f6f27 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:33.650812 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e54fc-9eaa-49c6-be74-da936d9f6f27 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:33.656080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98779c-07d5-4036-879e-58fb6b41d743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:33.656784 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98779c-07d5-4036-879e-58fb6b41d743 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.657075 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98779c-07d5-4036-879e-58fb6b41d743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.657347 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98779c-07d5-4036-879e-58fb6b41d743 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.658052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98779c-07d5-4036-879e-58fb6b41d743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:33.660240 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98779c-07d5-4036-879e-58fb6b41d743 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:33.683256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1043/2076] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:33.696566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f1220-4aec-40fc-8293-25d2c45bd983 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:33.698859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4e0f1220-4aec-40fc-8293-25d2c45bd983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:33.700007 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1034/2077] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:33 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:33.704463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98779c-07d5-4036-879e-58fb6b41d743 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:33.718770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:33.771368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f1220-4aec-40fc-8293-25d2c45bd983 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:33.785762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98779c-07d5-4036-879e-58fb6b41d743 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:33.791283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed080384-3ff5-45dd-a615-3e3bdc63ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:33.792087 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed080384-3ff5-45dd-a615-3e3bdc63ee70 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.792368 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed080384-3ff5-45dd-a615-3e3bdc63ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.792762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed080384-3ff5-45dd-a615-3e3bdc63ee70 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.793470 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed080384-3ff5-45dd-a615-3e3bdc63ee70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:33.795904 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed080384-3ff5-45dd-a615-3e3bdc63ee70 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:33.824091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:33.832638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1035/2078] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:33 2022] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:17:33.838595 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed080384-3ff5-45dd-a615-3e3bdc63ee70 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:33.861187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed080384-3ff5-45dd-a615-3e3bdc63ee70 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:33.861647 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f838b-b7b4-417d-b58a-b395a7ef6267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:33.862562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f838b-b7b4-417d-b58a-b395a7ef6267 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.862891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f838b-b7b4-417d-b58a-b395a7ef6267 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.863601 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f838b-b7b4-417d-b58a-b395a7ef6267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.869781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436c000-5336-43aa-a3ca-e7c868eca657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:33.870600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436c000-5336-43aa-a3ca-e7c868eca657 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.870946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436c000-5336-43aa-a3ca-e7c868eca657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.872074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436c000-5336-43aa-a3ca-e7c868eca657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.872913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436c000-5336-43aa-a3ca-e7c868eca657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:33.874678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436c000-5336-43aa-a3ca-e7c868eca657 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:33.895927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1036/2079] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:33.900201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436c000-5336-43aa-a3ca-e7c868eca657 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:33.910756 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436c000-5336-43aa-a3ca-e7c868eca657 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:33.915789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bf433-cf81-4e43-8956-3bbc167e2c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:33.916487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bf433-cf81-4e43-8956-3bbc167e2c14 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.916768 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bf433-cf81-4e43-8956-3bbc167e2c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.917042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bf433-cf81-4e43-8956-3bbc167e2c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.917790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bf433-cf81-4e43-8956-3bbc167e2c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:33.919636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bf433-cf81-4e43-8956-3bbc167e2c14 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:33.938871 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1037/2080] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:17:33.941322 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bf433-cf81-4e43-8956-3bbc167e2c14 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:33.966684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bf433-cf81-4e43-8956-3bbc167e2c14 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:33.977859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc91bdd-33ae-450d-abd5-4a3fccb4efa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:33.980753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc91bdd-33ae-450d-abd5-4a3fccb4efa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:33.981843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc91bdd-33ae-450d-abd5-4a3fccb4efa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:33.982452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc91bdd-33ae-450d-abd5-4a3fccb4efa6 admin admin] PATH_INFO: `/v3/projects/5add293a58ed4980909cbd21ae33e1dd/users/3179681fb9ba425da540c21f0f4c9c1f/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:33.986001 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f838b-b7b4-417d-b58a-b395a7ef6267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:33.988550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f838b-b7b4-417d-b58a-b395a7ef6267 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:34.007670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1044/2081] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:34.023239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc91bdd-33ae-450d-abd5-4a3fccb4efa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5add293a58ed4980909cbd21ae33e1dd, user_id=3179681fb9ba425da540c21f0f4c9c1f, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:34.028656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc91bdd-33ae-450d-abd5-4a3fccb4efa6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:34.059022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1038/2082] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:33 2022] PUT /identity/v3/projects/5add293a58ed4980909cbd21ae33e1dd/users/3179681fb9ba425da540c21f0f4c9c1f/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:34.069492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca91e8-494c-4d4d-99ac-acba317cf8f9 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:34.070034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca91e8-494c-4d4d-99ac-acba317cf8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:34.070034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca91e8-494c-4d4d-99ac-acba317cf8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:34.103468 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d4ca91e8-494c-4d4d-99ac-acba317cf8f9 None None] MFA Rules not processed for user `3179681fb9ba425da540c21f0f4c9c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:34.104788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d4ca91e8-494c-4d4d-99ac-acba317cf8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:34.192240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1045/2083] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:34.288272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc91bdd-33ae-450d-abd5-4a3fccb4efa6 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:34.408124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc91bdd-33ae-450d-abd5-4a3fccb4efa6 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:34.430068 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a48c65-c1ae-4318-8fe2-c1b0df955037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:34.431421 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a48c65-c1ae-4318-8fe2-c1b0df955037 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:34.432078 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a48c65-c1ae-4318-8fe2-c1b0df955037 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:34.432663 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a48c65-c1ae-4318-8fe2-c1b0df955037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:34.468727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a48c65-c1ae-4318-8fe2-c1b0df955037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:34.470990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a48c65-c1ae-4318-8fe2-c1b0df955037 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:34.515164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1039/2084] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:35.636036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca91e8-494c-4d4d-99ac-acba317cf8f9 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:35.727318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca91e8-494c-4d4d-99ac-acba317cf8f9 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:35.738331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed86572-3b2d-4cae-8a01-ca4819ff9a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:35.738331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed86572-3b2d-4cae-8a01-ca4819ff9a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:35.739360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed86572-3b2d-4cae-8a01-ca4819ff9a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:35.739779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed86572-3b2d-4cae-8a01-ca4819ff9a6d admin admin] PATH_INFO: `/v3/users/a0a0a521bf05492cbdddde6d9f9743d8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:35.742430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed86572-3b2d-4cae-8a01-ca4819ff9a6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a0a521bf05492cbdddde6d9f9743d8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:35.746093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed86572-3b2d-4cae-8a01-ca4819ff9a6d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:35.774409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:35.826571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3ed86572-3b2d-4cae-8a01-ca4819ff9a6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a0a521bf05492cbdddde6d9f9743d8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:35.838945 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3ed86572-3b2d-4cae-8a01-ca4819ff9a6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a0a521bf05492cbdddde6d9f9743d8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:35.840578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3ed86572-3b2d-4cae-8a01-ca4819ff9a6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a0a521bf05492cbdddde6d9f9743d8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:35.859692 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3ed86572-3b2d-4cae-8a01-ca4819ff9a6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a0a521bf05492cbdddde6d9f9743d8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:35.860681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3ed86572-3b2d-4cae-8a01-ca4819ff9a6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a0a521bf05492cbdddde6d9f9743d8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:35.879387 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1046/2085] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:35 2022] DELETE /identity/v3/users/a0a0a521bf05492cbdddde6d9f9743d8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:35.884653 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5e6f6-818e-432d-9477-01bc3a8c95bf None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:35.885468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5e6f6-818e-432d-9477-01bc3a8c95bf None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:35.885468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5e6f6-818e-432d-9477-01bc3a8c95bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:35.905567 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b5d5e6f6-818e-432d-9477-01bc3a8c95bf None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:35.906961 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b5d5e6f6-818e-432d-9477-01bc3a8c95bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:36.000328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:36.015004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1040/2086] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:36.027501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed86572-3b2d-4cae-8a01-ca4819ff9a6d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:36.042251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3ed86572-3b2d-4cae-8a01-ca4819ff9a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:36.148540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed86572-3b2d-4cae-8a01-ca4819ff9a6d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:36.156679 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44606f78-c09b-4e5e-b4b2-20fbc7fc948e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:36.158201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44606f78-c09b-4e5e-b4b2-20fbc7fc948e service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:36.159574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44606f78-c09b-4e5e-b4b2-20fbc7fc948e service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:36.159704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44606f78-c09b-4e5e-b4b2-20fbc7fc948e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:36.179098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44606f78-c09b-4e5e-b4b2-20fbc7fc948e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:36.182270 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44606f78-c09b-4e5e-b4b2-20fbc7fc948e service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:36.201033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1047/2087] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:36.685276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5e6f6-818e-432d-9477-01bc3a8c95bf None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:36.687345 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b5d5e6f6-818e-432d-9477-01bc3a8c95bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:36.702249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5e6f6-818e-432d-9477-01bc3a8c95bf None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:36.708082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:36.709334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:36.709807 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:36.710236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] PATH_INFO: `/v3/projects/946b5a3e95164e61abe7aa1aa16ba5a8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:36.711836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=946b5a3e95164e61abe7aa1aa16ba5a8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:36.714039 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:36.791811 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '946b5a3e95164e61abe7aa1aa16ba5a8', 'request_id': 'req-4f9ba7e7-325a-4590-821b-6b4a67caef12'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:36.804205 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '946b5a3e95164e61abe7aa1aa16ba5a8', 'request_id': 'req-4f9ba7e7-325a-4590-821b-6b4a67caef12'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:36.814207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '946b5a3e95164e61abe7aa1aa16ba5a8', 'request_id': 'req-4f9ba7e7-325a-4590-821b-6b4a67caef12'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:36.830441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] The token cache is being invalidate because project 946b5a3e95164e61abe7aa1aa16ba5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:36.831033 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:36.831769 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:36.845028 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1041/2088] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:36 2022] DELETE /identity/v3/projects/946b5a3e95164e61abe7aa1aa16ba5a8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:36.846233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44606f78-c09b-4e5e-b4b2-20fbc7fc948e service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:36.859804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44606f78-c09b-4e5e-b4b2-20fbc7fc948e service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:36.935183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f01f50-0e55-49c7-b050-1f51df6ba8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:36.936388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f01f50-0e55-49c7-b050-1f51df6ba8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:36.936831 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f01f50-0e55-49c7-b050-1f51df6ba8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:36.937568 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f01f50-0e55-49c7-b050-1f51df6ba8d7 admin admin] PATH_INFO: `/v3/users/c4d4b6c5330f451a88207803be270754` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:36.939622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f01f50-0e55-49c7-b050-1f51df6ba8d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d4b6c5330f451a88207803be270754)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:36.942355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f01f50-0e55-49c7-b050-1f51df6ba8d7 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:37.011783 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:37.028171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-59f01f50-0e55-49c7-b050-1f51df6ba8d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d4b6c5330f451a88207803be270754'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:37.038820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-59f01f50-0e55-49c7-b050-1f51df6ba8d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d4b6c5330f451a88207803be270754'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:37.039782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-59f01f50-0e55-49c7-b050-1f51df6ba8d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d4b6c5330f451a88207803be270754'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:37.058580 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-59f01f50-0e55-49c7-b050-1f51df6ba8d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d4b6c5330f451a88207803be270754'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:37.059694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-59f01f50-0e55-49c7-b050-1f51df6ba8d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d4b6c5330f451a88207803be270754'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:37.095566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1048/2089] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:36 2022] DELETE /identity/v3/users/c4d4b6c5330f451a88207803be270754 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:37.773353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:37.778418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:37.820005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ba7e7-325a-4590-821b-6b4a67caef12 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:37.910619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c522f96-0c44-4a33-8474-7d2912d8592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:37.911699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c522f96-0c44-4a33-8474-7d2912d8592e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:37.912194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c522f96-0c44-4a33-8474-7d2912d8592e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:37.912576 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c522f96-0c44-4a33-8474-7d2912d8592e admin admin] PATH_INFO: `/v3/projects/d73dcff74c5c4f4bad9e96bdf8d791a3` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:37.914303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c522f96-0c44-4a33-8474-7d2912d8592e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73dcff74c5c4f4bad9e96bdf8d791a3)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:37.916964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c522f96-0c44-4a33-8474-7d2912d8592e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:37.993019 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6c522f96-0c44-4a33-8474-7d2912d8592e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73dcff74c5c4f4bad9e96bdf8d791a3', 'request_id': 'req-6c522f96-0c44-4a33-8474-7d2912d8592e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:38.006995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6c522f96-0c44-4a33-8474-7d2912d8592e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73dcff74c5c4f4bad9e96bdf8d791a3', 'request_id': 'req-6c522f96-0c44-4a33-8474-7d2912d8592e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:38.023457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6c522f96-0c44-4a33-8474-7d2912d8592e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73dcff74c5c4f4bad9e96bdf8d791a3', 'request_id': 'req-6c522f96-0c44-4a33-8474-7d2912d8592e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:38.044799 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6c522f96-0c44-4a33-8474-7d2912d8592e admin admin] The token cache is being invalidate because project d73dcff74c5c4f4bad9e96bdf8d791a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:38.045232 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6c522f96-0c44-4a33-8474-7d2912d8592e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:38.046821 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6c522f96-0c44-4a33-8474-7d2912d8592e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:38.049470 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1042/2090] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:37 2022] DELETE /identity/v3/projects/d73dcff74c5c4f4bad9e96bdf8d791a3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:38.056829 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78b56b-a7cd-4448-af8e-6407d824772b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:38.057723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78b56b-a7cd-4448-af8e-6407d824772b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:38.057723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78b56b-a7cd-4448-af8e-6407d824772b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:38.085948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ed78b56b-a7cd-4448-af8e-6407d824772b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:38.088443 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ed78b56b-a7cd-4448-af8e-6407d824772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:38.209073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1049/2091] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:38.221818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f502a38-588d-4c45-a629-ac66644d06d8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:38.222282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f502a38-588d-4c45-a629-ac66644d06d8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:38.225145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f502a38-588d-4c45-a629-ac66644d06d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:38.247864 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4f502a38-588d-4c45-a629-ac66644d06d8 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:38.249526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4f502a38-588d-4c45-a629-ac66644d06d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:38.261159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1043/2092] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:38.266298 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78b56b-a7cd-4448-af8e-6407d824772b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:38.280433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78b56b-a7cd-4448-af8e-6407d824772b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:38.289841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c7563-6746-46e5-afda-c80d03d07400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:38.291024 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c7563-6746-46e5-afda-c80d03d07400 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:38.291517 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c7563-6746-46e5-afda-c80d03d07400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:38.292003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c7563-6746-46e5-afda-c80d03d07400 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:38.293386 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c7563-6746-46e5-afda-c80d03d07400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:17:38.294480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c7563-6746-46e5-afda-c80d03d07400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:38.298077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c7563-6746-46e5-afda-c80d03d07400 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:38.324774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1050/2093] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:17:38.329810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f502a38-588d-4c45-a629-ac66644d06d8 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:38.340241 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:38.360692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f502a38-588d-4c45-a629-ac66644d06d8 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:38.369945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c8cb2-afab-469d-8b51-849484ebd6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:38.371083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c8cb2-afab-469d-8b51-849484ebd6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:38.371578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c8cb2-afab-469d-8b51-849484ebd6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:38.372067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c8cb2-afab-469d-8b51-849484ebd6e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:38.373438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c8cb2-afab-469d-8b51-849484ebd6e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:38.377293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c8cb2-afab-469d-8b51-849484ebd6e7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:38.424027 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1044/2094] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:38 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:38.424792 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c7563-6746-46e5-afda-c80d03d07400 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:38.436082 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c7563-6746-46e5-afda-c80d03d07400 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:38.523543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c58b2-5efe-4f95-8188-c481105679c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:38.524244 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c58b2-5efe-4f95-8188-c481105679c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:38.524528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c58b2-5efe-4f95-8188-c481105679c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:38.524809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c58b2-5efe-4f95-8188-c481105679c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:38.525521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c58b2-5efe-4f95-8188-c481105679c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:38.527518 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c58b2-5efe-4f95-8188-c481105679c8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:38.550169 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1051/2095] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:38 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:17:38.555253 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c8cb2-afab-469d-8b51-849484ebd6e7 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:38.571355 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c8cb2-afab-469d-8b51-849484ebd6e7 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:38.579227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba797a-0cf6-451f-887a-135da6f8acce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:38.580332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba797a-0cf6-451f-887a-135da6f8acce admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:38.580783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba797a-0cf6-451f-887a-135da6f8acce admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:38.581233 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba797a-0cf6-451f-887a-135da6f8acce admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:38.582600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba797a-0cf6-451f-887a-135da6f8acce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:38.585597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba797a-0cf6-451f-887a-135da6f8acce admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:38.606845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1045/2096] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:38.608303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c58b2-5efe-4f95-8188-c481105679c8 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:38.622147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c58b2-5efe-4f95-8188-c481105679c8 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:38.631045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023882d5-bd90-44fa-8396-57817cc1f618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:38.632227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023882d5-bd90-44fa-8396-57817cc1f618 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:38.632748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023882d5-bd90-44fa-8396-57817cc1f618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:38.633196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023882d5-bd90-44fa-8396-57817cc1f618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:38.634349 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023882d5-bd90-44fa-8396-57817cc1f618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:38.636809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023882d5-bd90-44fa-8396-57817cc1f618 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:38.651730 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1052/2097] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:38.657106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba797a-0cf6-451f-887a-135da6f8acce admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:38.669442 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba797a-0cf6-451f-887a-135da6f8acce admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:38.674977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c936a7c-9d2f-49d7-9dc9-561db578a769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:38.676152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c936a7c-9d2f-49d7-9dc9-561db578a769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:38.676692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c936a7c-9d2f-49d7-9dc9-561db578a769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:38.677500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c936a7c-9d2f-49d7-9dc9-561db578a769 admin admin] PATH_INFO: `/v3/projects/a2a89a4d454e4fada5354fbd0244c943/users/8017ef47ae2048fb8c4ff12467255ccc/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:38.696265 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c936a7c-9d2f-49d7-9dc9-561db578a769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a89a4d454e4fada5354fbd0244c943, user_id=8017ef47ae2048fb8c4ff12467255ccc, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:38.699149 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c936a7c-9d2f-49d7-9dc9-561db578a769 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:38.715558 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1046/2098] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:38 2022] PUT /identity/v3/projects/a2a89a4d454e4fada5354fbd0244c943/users/8017ef47ae2048fb8c4ff12467255ccc/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:38.727803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e45ad-df11-48e4-9bfe-ec33a0678a17 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:38.728289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e45ad-df11-48e4-9bfe-ec33a0678a17 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:38.729033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e45ad-df11-48e4-9bfe-ec33a0678a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:38.779765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-221e45ad-df11-48e4-9bfe-ec33a0678a17 None None] MFA Rules not processed for user `8017ef47ae2048fb8c4ff12467255ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:38.781650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-221e45ad-df11-48e4-9bfe-ec33a0678a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:38.791208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:38.962775 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1053/2099] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:38.967600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c936a7c-9d2f-49d7-9dc9-561db578a769 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:39.082777 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c936a7c-9d2f-49d7-9dc9-561db578a769 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:39.090106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34b22f-092a-4fea-bc66-f158da4dc4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:39.090832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34b22f-092a-4fea-bc66-f158da4dc4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:39.091148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34b22f-092a-4fea-bc66-f158da4dc4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:39.091429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34b22f-092a-4fea-bc66-f158da4dc4b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:39.092149 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34b22f-092a-4fea-bc66-f158da4dc4b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:39.094340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34b22f-092a-4fea-bc66-f158da4dc4b1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:39.156546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1047/2100] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:38 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:39.156921 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e45ad-df11-48e4-9bfe-ec33a0678a17 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:39.191846 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e45ad-df11-48e4-9bfe-ec33a0678a17 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:39.326628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226c8ee-011a-450a-8586-f07d8c2db1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:39.327890 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226c8ee-011a-450a-8586-f07d8c2db1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:39.328971 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226c8ee-011a-450a-8586-f07d8c2db1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:39.330090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226c8ee-011a-450a-8586-f07d8c2db1e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:39.331495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226c8ee-011a-450a-8586-f07d8c2db1e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:39.336333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226c8ee-011a-450a-8586-f07d8c2db1e2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:39.377586 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1054/2101] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:39 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:17:39.384129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34b22f-092a-4fea-bc66-f158da4dc4b1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:39.403290 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34b22f-092a-4fea-bc66-f158da4dc4b1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:39.417823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71404c38-9c8a-483d-ad0d-1976b71332e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:39.420225 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71404c38-9c8a-483d-ad0d-1976b71332e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:39.421103 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71404c38-9c8a-483d-ad0d-1976b71332e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:39.421505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71404c38-9c8a-483d-ad0d-1976b71332e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:39.422684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71404c38-9c8a-483d-ad0d-1976b71332e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:39.425586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71404c38-9c8a-483d-ad0d-1976b71332e4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:39.441216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1048/2102] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:39.447199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226c8ee-011a-450a-8586-f07d8c2db1e2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:39.460716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226c8ee-011a-450a-8586-f07d8c2db1e2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:39.472694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6bd12-fe77-426c-8aa7-78c1fb8d3e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:39.475063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6bd12-fe77-426c-8aa7-78c1fb8d3e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:39.476032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6bd12-fe77-426c-8aa7-78c1fb8d3e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:39.476778 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6bd12-fe77-426c-8aa7-78c1fb8d3e6b admin admin] PATH_INFO: `/v3/projects/ed3f2d0cff7e4a8f91711851082c6eee/users/e2203987061d4cc6aa43176c58591b36/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:39.519090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6bd12-fe77-426c-8aa7-78c1fb8d3e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3f2d0cff7e4a8f91711851082c6eee, user_id=e2203987061d4cc6aa43176c58591b36, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:39.523256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6bd12-fe77-426c-8aa7-78c1fb8d3e6b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:39.548863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1055/2103] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:39 2022] PUT /identity/v3/projects/ed3f2d0cff7e4a8f91711851082c6eee/users/e2203987061d4cc6aa43176c58591b36/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:39.556042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71404c38-9c8a-483d-ad0d-1976b71332e4 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:39.578232 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71404c38-9c8a-483d-ad0d-1976b71332e4 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:39.692227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd78276-026d-4760-9c61-7f97da06fcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:39.693402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd78276-026d-4760-9c61-7f97da06fcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:39.693967 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd78276-026d-4760-9c61-7f97da06fcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:39.694464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd78276-026d-4760-9c61-7f97da06fcf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:39.695829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd78276-026d-4760-9c61-7f97da06fcf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:39.698380 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd78276-026d-4760-9c61-7f97da06fcf1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:39.717639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1049/2104] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:39.719357 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6bd12-fe77-426c-8aa7-78c1fb8d3e6b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:39.733041 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6bd12-fe77-426c-8aa7-78c1fb8d3e6b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:39.739094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e259c4-20c6-4cf3-a8da-36217b99b83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:39.740463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e259c4-20c6-4cf3-a8da-36217b99b83d admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:39.740858 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e259c4-20c6-4cf3-a8da-36217b99b83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:39.741252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e259c4-20c6-4cf3-a8da-36217b99b83d admin admin] PATH_INFO: `/v3/projects/ed3f2d0cff7e4a8f91711851082c6eee/users/e2203987061d4cc6aa43176c58591b36/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:39.744097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e259c4-20c6-4cf3-a8da-36217b99b83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3f2d0cff7e4a8f91711851082c6eee, user_id=e2203987061d4cc6aa43176c58591b36, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:39.747384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e259c4-20c6-4cf3-a8da-36217b99b83d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:39.763212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1056/2105] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:39 2022] PUT /identity/v3/projects/ed3f2d0cff7e4a8f91711851082c6eee/users/e2203987061d4cc6aa43176c58591b36/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:39.780163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca41612-7499-468b-935d-a1b6a1d20fe2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:39.780757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca41612-7499-468b-935d-a1b6a1d20fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:39.781237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca41612-7499-468b-935d-a1b6a1d20fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:39.822813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2ca41612-7499-468b-935d-a1b6a1d20fe2 None None] MFA Rules not processed for user `e2203987061d4cc6aa43176c58591b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:39.824067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2ca41612-7499-468b-935d-a1b6a1d20fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:39.832677 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:39.974750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1050/2106] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:39.993340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e259c4-20c6-4cf3-a8da-36217b99b83d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:39.995441 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-85e259c4-20c6-4cf3-a8da-36217b99b83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:40.076587 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e259c4-20c6-4cf3-a8da-36217b99b83d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:40.081707 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f27d2d-eeb1-4290-a710-caa70346ad7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:40.082388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f27d2d-eeb1-4290-a710-caa70346ad7d service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:40.082706 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f27d2d-eeb1-4290-a710-caa70346ad7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:40.082975 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f27d2d-eeb1-4290-a710-caa70346ad7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:40.094940 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f27d2d-eeb1-4290-a710-caa70346ad7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:40.096697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f27d2d-eeb1-4290-a710-caa70346ad7d service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:40.114742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1057/2107] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:40.737347 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca41612-7499-468b-935d-a1b6a1d20fe2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:40.831606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca41612-7499-468b-935d-a1b6a1d20fe2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:40.840035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb905e6-eb38-4925-9be1-63f6ea0c028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:40.840328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb905e6-eb38-4925-9be1-63f6ea0c028c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:40.840474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb905e6-eb38-4925-9be1-63f6ea0c028c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:40.840928 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb905e6-eb38-4925-9be1-63f6ea0c028c admin admin] PATH_INFO: `/v3/users/8017ef47ae2048fb8c4ff12467255ccc` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:40.842781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb905e6-eb38-4925-9be1-63f6ea0c028c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8017ef47ae2048fb8c4ff12467255ccc)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:40.844900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb905e6-eb38-4925-9be1-63f6ea0c028c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:40.919527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3cb905e6-eb38-4925-9be1-63f6ea0c028c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8017ef47ae2048fb8c4ff12467255ccc'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:40.922906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3cb905e6-eb38-4925-9be1-63f6ea0c028c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8017ef47ae2048fb8c4ff12467255ccc'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:40.940035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3cb905e6-eb38-4925-9be1-63f6ea0c028c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8017ef47ae2048fb8c4ff12467255ccc'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:40.954528 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3cb905e6-eb38-4925-9be1-63f6ea0c028c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8017ef47ae2048fb8c4ff12467255ccc'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:40.955885 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3cb905e6-eb38-4925-9be1-63f6ea0c028c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8017ef47ae2048fb8c4ff12467255ccc'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:40.982542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1051/2108] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:40 2022] DELETE /identity/v3/users/8017ef47ae2048fb8c4ff12467255ccc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:40.990552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d46a7-4f46-4fcf-933a-7ba9d6d2de76 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:40.991311 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d46a7-4f46-4fcf-933a-7ba9d6d2de76 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:40.991311 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d46a7-4f46-4fcf-933a-7ba9d6d2de76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:40.997146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:41.016135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-652d46a7-4f46-4fcf-933a-7ba9d6d2de76 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:41.017519 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-652d46a7-4f46-4fcf-933a-7ba9d6d2de76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:41.121773 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1058/2109] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:41.145375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb905e6-eb38-4925-9be1-63f6ea0c028c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:41.147509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3cb905e6-eb38-4925-9be1-63f6ea0c028c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:41.182640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:41.203761 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397e34e-88cb-4d4c-ae8e-bce2a7892af5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:41.204057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397e34e-88cb-4d4c-ae8e-bce2a7892af5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:41.204343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397e34e-88cb-4d4c-ae8e-bce2a7892af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:41.224517 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb905e6-eb38-4925-9be1-63f6ea0c028c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:41.229910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2428d8c-9d0e-4785-b90e-6ef4e1d0a06f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:41.230707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2428d8c-9d0e-4785-b90e-6ef4e1d0a06f service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:41.231147 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2428d8c-9d0e-4785-b90e-6ef4e1d0a06f service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:41.231497 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2428d8c-9d0e-4785-b90e-6ef4e1d0a06f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:41.239236 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8397e34e-88cb-4d4c-ae8e-bce2a7892af5 None None] MFA Rules not processed for user `491d61d97e114e5988bab922a0f366bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:41.240824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8397e34e-88cb-4d4c-ae8e-bce2a7892af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:41.244454 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2428d8c-9d0e-4785-b90e-6ef4e1d0a06f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:41.247880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2428d8c-9d0e-4785-b90e-6ef4e1d0a06f service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:41.269054 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1052/2110] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:41.376375 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1059/2111] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:41.784462 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2428d8c-9d0e-4785-b90e-6ef4e1d0a06f service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:41.785949 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c2428d8c-9d0e-4785-b90e-6ef4e1d0a06f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:41.836044 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2428d8c-9d0e-4785-b90e-6ef4e1d0a06f service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:41.846217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:41.847144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:41.847433 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:41.847694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] PATH_INFO: `/v3/projects/a2a89a4d454e4fada5354fbd0244c943` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:41.848986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a89a4d454e4fada5354fbd0244c943)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:41.851082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:41.920855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a89a4d454e4fada5354fbd0244c943', 'request_id': 'req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:41.941739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a89a4d454e4fada5354fbd0244c943', 'request_id': 'req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:41.950428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a89a4d454e4fada5354fbd0244c943', 'request_id': 'req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:41.978879 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] The token cache is being invalidate because project a2a89a4d454e4fada5354fbd0244c943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:41.979197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:41.980231 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:41.982349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1053/2112] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:41 2022] DELETE /identity/v3/projects/a2a89a4d454e4fada5354fbd0244c943 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:41.986845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397e34e-88cb-4d4c-ae8e-bce2a7892af5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:42.003072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397e34e-88cb-4d4c-ae8e-bce2a7892af5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:42.077130 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebe244-bd54-4852-8fee-d92dbb01e6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:42.078032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebe244-bd54-4852-8fee-d92dbb01e6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:42.078494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebe244-bd54-4852-8fee-d92dbb01e6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:42.078971 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebe244-bd54-4852-8fee-d92dbb01e6fa admin admin] PATH_INFO: `/v3/users/e2203987061d4cc6aa43176c58591b36` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:42.080436 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebe244-bd54-4852-8fee-d92dbb01e6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2203987061d4cc6aa43176c58591b36)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:42.082567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebe244-bd54-4852-8fee-d92dbb01e6fa admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:42.145647 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a2ebe244-bd54-4852-8fee-d92dbb01e6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2203987061d4cc6aa43176c58591b36'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:42.150205 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:42.163048 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a2ebe244-bd54-4852-8fee-d92dbb01e6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2203987061d4cc6aa43176c58591b36'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:42.164641 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a2ebe244-bd54-4852-8fee-d92dbb01e6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2203987061d4cc6aa43176c58591b36'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:42.182485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a2ebe244-bd54-4852-8fee-d92dbb01e6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2203987061d4cc6aa43176c58591b36'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:42.183538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a2ebe244-bd54-4852-8fee-d92dbb01e6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2203987061d4cc6aa43176c58591b36'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:42.203276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1060/2113] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:41 2022] DELETE /identity/v3/users/e2203987061d4cc6aa43176c58591b36 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:42.714425 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:42.716873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:42.749688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda6efd-4ce1-4ab9-94e0-58ae5b43856d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:42.890048 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:42.890976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:42.891420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:42.891870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf admin admin] PATH_INFO: `/v3/projects/ed3f2d0cff7e4a8f91711851082c6eee` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:42.893621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3f2d0cff7e4a8f91711851082c6eee)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:42.897685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:42.967721 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3f2d0cff7e4a8f91711851082c6eee', 'request_id': 'req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:42.970286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:42.978697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3f2d0cff7e4a8f91711851082c6eee', 'request_id': 'req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:42.987671 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3f2d0cff7e4a8f91711851082c6eee', 'request_id': 'req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:43.001238 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf admin admin] The token cache is being invalidate because project ed3f2d0cff7e4a8f91711851082c6eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:43.001717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:43.002818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cc0e64a8-0cd5-46e9-ba9f-759ae7afb3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:43.004683 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1054/2114] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:42 2022] DELETE /identity/v3/projects/ed3f2d0cff7e4a8f91711851082c6eee => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:43.011779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1874a1-7a25-4eab-8154-70d3a7bb261e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:43.012719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1874a1-7a25-4eab-8154-70d3a7bb261e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:43.013284 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1874a1-7a25-4eab-8154-70d3a7bb261e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:43.033294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7e1874a1-7a25-4eab-8154-70d3a7bb261e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:43.034857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7e1874a1-7a25-4eab-8154-70d3a7bb261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:43.108845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1061/2115] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:43.118148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5aefe-b676-4759-9d41-509612dbea8e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:43.118441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5aefe-b676-4759-9d41-509612dbea8e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:43.118751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5aefe-b676-4759-9d41-509612dbea8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:43.139466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-36c5aefe-b676-4759-9d41-509612dbea8e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:43.140979 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-36c5aefe-b676-4759-9d41-509612dbea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:43.149962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1055/2116] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:43.155297 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1874a1-7a25-4eab-8154-70d3a7bb261e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:43.165580 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1874a1-7a25-4eab-8154-70d3a7bb261e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:43.170327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee5f24-a4b5-4090-85c1-9ceb1aaba35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:43.171038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee5f24-a4b5-4090-85c1-9ceb1aaba35e admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:43.171319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee5f24-a4b5-4090-85c1-9ceb1aaba35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:43.171595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee5f24-a4b5-4090-85c1-9ceb1aaba35e admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:43.172345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee5f24-a4b5-4090-85c1-9ceb1aaba35e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:17:43.172685 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee5f24-a4b5-4090-85c1-9ceb1aaba35e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:43.174272 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee5f24-a4b5-4090-85c1-9ceb1aaba35e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:43.187116 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1062/2117] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:17:43.191841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5aefe-b676-4759-9d41-509612dbea8e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:43.201444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5aefe-b676-4759-9d41-509612dbea8e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:43.206500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3495e7-950a-4f1d-9030-b5670d4e0e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:43.207195 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3495e7-950a-4f1d-9030-b5670d4e0e2b admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:43.207483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3495e7-950a-4f1d-9030-b5670d4e0e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:43.207759 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3495e7-950a-4f1d-9030-b5670d4e0e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:43.208472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3495e7-950a-4f1d-9030-b5670d4e0e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:43.210368 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3495e7-950a-4f1d-9030-b5670d4e0e2b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:43.237667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1056/2118] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:43 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:43.242597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee5f24-a4b5-4090-85c1-9ceb1aaba35e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:43.255305 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee5f24-a4b5-4090-85c1-9ceb1aaba35e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:43.329648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3fa1c-cdfb-49bd-8291-9184d4a4e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:43.330723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3fa1c-cdfb-49bd-8291-9184d4a4e1ef admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:43.331240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3fa1c-cdfb-49bd-8291-9184d4a4e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:43.331712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3fa1c-cdfb-49bd-8291-9184d4a4e1ef admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:43.332789 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3fa1c-cdfb-49bd-8291-9184d4a4e1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:43.336462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3fa1c-cdfb-49bd-8291-9184d4a4e1ef admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:43.363309 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1063/2119] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:43 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:17:43.367872 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3495e7-950a-4f1d-9030-b5670d4e0e2b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:43.378929 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3495e7-950a-4f1d-9030-b5670d4e0e2b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:43.385160 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf653dd-d2b0-4fe1-ab97-1cae8176073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:43.385651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf653dd-d2b0-4fe1-ab97-1cae8176073e admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:43.385938 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf653dd-d2b0-4fe1-ab97-1cae8176073e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:43.386360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf653dd-d2b0-4fe1-ab97-1cae8176073e admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:43.387485 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf653dd-d2b0-4fe1-ab97-1cae8176073e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:43.389140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf653dd-d2b0-4fe1-ab97-1cae8176073e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:43.415197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1057/2120] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:17:43.419608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3fa1c-cdfb-49bd-8291-9184d4a4e1ef admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:43.430593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3fa1c-cdfb-49bd-8291-9184d4a4e1ef admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:43.435631 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d1b43-60c2-4c7c-95f5-48da0f4d4259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:43.436362 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d1b43-60c2-4c7c-95f5-48da0f4d4259 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:43.436665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d1b43-60c2-4c7c-95f5-48da0f4d4259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:43.436946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d1b43-60c2-4c7c-95f5-48da0f4d4259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:43.437696 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d1b43-60c2-4c7c-95f5-48da0f4d4259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:43.439414 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d1b43-60c2-4c7c-95f5-48da0f4d4259 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:43.454331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1064/2121] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:43.460557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf653dd-d2b0-4fe1-ab97-1cae8176073e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:43.475304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf653dd-d2b0-4fe1-ab97-1cae8176073e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:43.480714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb775ff-bbb8-4015-9a05-3ee2a789e626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:43.482384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb775ff-bbb8-4015-9a05-3ee2a789e626 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:43.482972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb775ff-bbb8-4015-9a05-3ee2a789e626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:43.483317 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb775ff-bbb8-4015-9a05-3ee2a789e626 admin admin] PATH_INFO: `/v3/projects/3b8124a716d743e3b46a6c4d498312ca/users/fca5d9445c6c4fd5b3704462bfdb234b/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:43.501877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb775ff-bbb8-4015-9a05-3ee2a789e626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8124a716d743e3b46a6c4d498312ca, user_id=fca5d9445c6c4fd5b3704462bfdb234b, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:43.505707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb775ff-bbb8-4015-9a05-3ee2a789e626 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:43.523020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1058/2122] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:43 2022] PUT /identity/v3/projects/3b8124a716d743e3b46a6c4d498312ca/users/fca5d9445c6c4fd5b3704462bfdb234b/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:43.534898 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72927870-fb4a-4fc1-8e2f-011a7314452b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:43.535182 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72927870-fb4a-4fc1-8e2f-011a7314452b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:43.535492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72927870-fb4a-4fc1-8e2f-011a7314452b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:43.567286 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-72927870-fb4a-4fc1-8e2f-011a7314452b None None] MFA Rules not processed for user `fca5d9445c6c4fd5b3704462bfdb234b`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:43.568533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-72927870-fb4a-4fc1-8e2f-011a7314452b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:43.591871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:43.674704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1065/2123] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:43.687152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb775ff-bbb8-4015-9a05-3ee2a789e626 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:43.689581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2bb775ff-bbb8-4015-9a05-3ee2a789e626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:43.792348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb775ff-bbb8-4015-9a05-3ee2a789e626 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:43.797017 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b3227-f011-4818-87d0-6f66736c8a5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:43.797820 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3227-f011-4818-87d0-6f66736c8a5a service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:43.798300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3227-f011-4818-87d0-6f66736c8a5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:43.798939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3227-f011-4818-87d0-6f66736c8a5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:43.810042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b3227-f011-4818-87d0-6f66736c8a5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:43.812677 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b3227-f011-4818-87d0-6f66736c8a5a service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:43.827841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1059/2124] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:43.851018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72927870-fb4a-4fc1-8e2f-011a7314452b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:43.950091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72927870-fb4a-4fc1-8e2f-011a7314452b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:43.957148 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb50b4-0a47-4669-8fe1-0b357d705d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:43.958879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb50b4-0a47-4669-8fe1-0b357d705d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:43.959161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb50b4-0a47-4669-8fe1-0b357d705d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:43.959438 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb50b4-0a47-4669-8fe1-0b357d705d72 admin admin] PATH_INFO: `/v3/users/fca5d9445c6c4fd5b3704462bfdb234b` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:43.960728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb50b4-0a47-4669-8fe1-0b357d705d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fca5d9445c6c4fd5b3704462bfdb234b)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:43.963201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb50b4-0a47-4669-8fe1-0b357d705d72 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:44.048085 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-88cb50b4-0a47-4669-8fe1-0b357d705d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fca5d9445c6c4fd5b3704462bfdb234b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:44.059337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-88cb50b4-0a47-4669-8fe1-0b357d705d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fca5d9445c6c4fd5b3704462bfdb234b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:44.060546 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-88cb50b4-0a47-4669-8fe1-0b357d705d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fca5d9445c6c4fd5b3704462bfdb234b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:44.075163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-88cb50b4-0a47-4669-8fe1-0b357d705d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fca5d9445c6c4fd5b3704462bfdb234b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:44.075992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-88cb50b4-0a47-4669-8fe1-0b357d705d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fca5d9445c6c4fd5b3704462bfdb234b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:44.099005 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1066/2125] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:43 2022] DELETE /identity/v3/users/fca5d9445c6c4fd5b3704462bfdb234b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:44.106676 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605084cb-4b3e-4f16-9bb4-7b6c9512599e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:44.107005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605084cb-4b3e-4f16-9bb4-7b6c9512599e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:44.107646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605084cb-4b3e-4f16-9bb4-7b6c9512599e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:44.109172 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb50b4-0a47-4669-8fe1-0b357d705d72 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:44.112032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-88cb50b4-0a47-4669-8fe1-0b357d705d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:44.147207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-605084cb-4b3e-4f16-9bb4-7b6c9512599e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:44.149144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-605084cb-4b3e-4f16-9bb4-7b6c9512599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:44.207656 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:44.236014 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb50b4-0a47-4669-8fe1-0b357d705d72 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:44.241533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4e715-bf3e-40bb-9497-98cc49f5498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:44.242402 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4e715-bf3e-40bb-9497-98cc49f5498b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:44.242574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4e715-bf3e-40bb-9497-98cc49f5498b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:44.242869 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4e715-bf3e-40bb-9497-98cc49f5498b admin admin] PATH_INFO: `/v3/users/b4cf347f1689407c96235188db1c03d7` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:44.244116 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4e715-bf3e-40bb-9497-98cc49f5498b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4cf347f1689407c96235188db1c03d7)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:44.248322 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1060/2126] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:44.248569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4e715-bf3e-40bb-9497-98cc49f5498b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:44.267443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605084cb-4b3e-4f16-9bb4-7b6c9512599e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:44.268953 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-605084cb-4b3e-4f16-9bb4-7b6c9512599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:44.302859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:44.327615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c1f4e715-bf3e-40bb-9497-98cc49f5498b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4cf347f1689407c96235188db1c03d7'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:44.341722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c1f4e715-bf3e-40bb-9497-98cc49f5498b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4cf347f1689407c96235188db1c03d7'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:44.342085 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c1f4e715-bf3e-40bb-9497-98cc49f5498b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4cf347f1689407c96235188db1c03d7'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:44.365803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605084cb-4b3e-4f16-9bb4-7b6c9512599e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:44.368995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5e621-0ea9-423f-8513-3b91ed10e29e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:44.369679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5e621-0ea9-423f-8513-3b91ed10e29e service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:44.369963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5e621-0ea9-423f-8513-3b91ed10e29e service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:44.370239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5e621-0ea9-423f-8513-3b91ed10e29e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:44.378832 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c1f4e715-bf3e-40bb-9497-98cc49f5498b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4cf347f1689407c96235188db1c03d7'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:44.379655 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c1f4e715-bf3e-40bb-9497-98cc49f5498b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4cf347f1689407c96235188db1c03d7'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:44.385302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5e621-0ea9-423f-8513-3b91ed10e29e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:44.388318 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5e621-0ea9-423f-8513-3b91ed10e29e service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:44.401160 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1061/2127] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:44.403113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1067/2128] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:44 2022] DELETE /identity/v3/users/b4cf347f1689407c96235188db1c03d7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:44.411231 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca78b64-74ef-42ce-b61d-e47e7b119afe None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:44.412203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca78b64-74ef-42ce-b61d-e47e7b119afe None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:44.412397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca78b64-74ef-42ce-b61d-e47e7b119afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:44.448618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-6ca78b64-74ef-42ce-b61d-e47e7b119afe None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:44.451199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6ca78b64-74ef-42ce-b61d-e47e7b119afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:44.593372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1062/2129] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:44.652036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4e715-bf3e-40bb-9497-98cc49f5498b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:44.655834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c1f4e715-bf3e-40bb-9497-98cc49f5498b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:44.736290 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4e715-bf3e-40bb-9497-98cc49f5498b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:44.740274 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10920e42-94e6-46e5-835a-8f76c0555a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:44.741120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10920e42-94e6-46e5-835a-8f76c0555a9e service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:44.741398 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10920e42-94e6-46e5-835a-8f76c0555a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:44.742089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10920e42-94e6-46e5-835a-8f76c0555a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:44.753396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10920e42-94e6-46e5-835a-8f76c0555a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:44.755305 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10920e42-94e6-46e5-835a-8f76c0555a9e service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:44.767179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1068/2130] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:44.902766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca78b64-74ef-42ce-b61d-e47e7b119afe None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:44.905072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6ca78b64-74ef-42ce-b61d-e47e7b119afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:44.928315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca78b64-74ef-42ce-b61d-e47e7b119afe None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:44.958629 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:44.961816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:44.962168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:44.962522 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8 admin admin] PATH_INFO: `/v3/projects/3b8124a716d743e3b46a6c4d498312ca` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:44.967673 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8124a716d743e3b46a6c4d498312ca)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:44.980024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:45.168738 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8124a716d743e3b46a6c4d498312ca', 'request_id': 'req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:45.188004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8124a716d743e3b46a6c4d498312ca', 'request_id': 'req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:45.214164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8124a716d743e3b46a6c4d498312ca', 'request_id': 'req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:45.253742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8 admin admin] The token cache is being invalidate because project 3b8124a716d743e3b46a6c4d498312ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:45.256124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:45.258925 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8b3905e8-7f70-45df-b05d-bf5e70ad64f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:45.263619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1063/2131] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:44 2022] DELETE /identity/v3/projects/3b8124a716d743e3b46a6c4d498312ca => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:45.269629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222076d-9475-4959-b457-650e7da4f4d8 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:45.270090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222076d-9475-4959-b457-650e7da4f4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:45.270201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222076d-9475-4959-b457-650e7da4f4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:45.294426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9222076d-9475-4959-b457-650e7da4f4d8 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:45.295714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9222076d-9475-4959-b457-650e7da4f4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:45.398552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1069/2132] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:45.406146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a535571-4bdd-416b-ad56-41c8c7a45c9c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:45.406625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a535571-4bdd-416b-ad56-41c8c7a45c9c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:45.407894 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a535571-4bdd-416b-ad56-41c8c7a45c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:45.473726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7a535571-4bdd-416b-ad56-41c8c7a45c9c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:45.480573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7a535571-4bdd-416b-ad56-41c8c7a45c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:45.500770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1064/2133] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:45.505699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222076d-9475-4959-b457-650e7da4f4d8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:45.511189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a535571-4bdd-416b-ad56-41c8c7a45c9c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:45.512674 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7a535571-4bdd-416b-ad56-41c8c7a45c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:45.513261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:45.519718 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222076d-9475-4959-b457-650e7da4f4d8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:45.525764 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564cd4-93d7-4073-9881-57db41124054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:45.527131 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564cd4-93d7-4073-9881-57db41124054 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:45.527525 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564cd4-93d7-4073-9881-57db41124054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:45.528177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564cd4-93d7-4073-9881-57db41124054 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:45.529309 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6564cd4-93d7-4073-9881-57db41124054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:17:45.530832 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6564cd4-93d7-4073-9881-57db41124054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:45.533205 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6564cd4-93d7-4073-9881-57db41124054 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:45.536624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a535571-4bdd-416b-ad56-41c8c7a45c9c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:45.545602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:45.546697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:45.547146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:45.547605 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a admin admin] PATH_INFO: `/v3/projects/767caa74e71f4053950b576a6b91566f` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:45.549370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=767caa74e71f4053950b576a6b91566f)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:45.552512 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:45.558795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1070/2134] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:17:45.560021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564cd4-93d7-4073-9881-57db41124054 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:45.589302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564cd4-93d7-4073-9881-57db41124054 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:45.603458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd3502-fa3c-458e-b889-2ff43c8f917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:45.604140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd3502-fa3c-458e-b889-2ff43c8f917a admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:45.604908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd3502-fa3c-458e-b889-2ff43c8f917a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:45.605194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd3502-fa3c-458e-b889-2ff43c8f917a admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:45.605934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd3502-fa3c-458e-b889-2ff43c8f917a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:45.609414 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd3502-fa3c-458e-b889-2ff43c8f917a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:45.695687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:45.706280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1071/2135] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:45 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:45.712054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd3502-fa3c-458e-b889-2ff43c8f917a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:45.745035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767caa74e71f4053950b576a6b91566f', 'request_id': 'req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:45.770423 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767caa74e71f4053950b576a6b91566f', 'request_id': 'req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:45.792993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767caa74e71f4053950b576a6b91566f', 'request_id': 'req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:45.824138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a admin admin] The token cache is being invalidate because project 767caa74e71f4053950b576a6b91566f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:45.824527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:45.825410 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c7bf04ad-29fb-4d5b-aa42-8106f40b6d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:45.827526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1065/2136] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:45 2022] DELETE /identity/v3/projects/767caa74e71f4053950b576a6b91566f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:45.832630 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37202a-730e-41f6-974c-b83cde34cbd2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:45.833185 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37202a-730e-41f6-974c-b83cde34cbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:45.833588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37202a-730e-41f6-974c-b83cde34cbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:45.856903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-bd37202a-730e-41f6-974c-b83cde34cbd2 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:45.858783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bd37202a-730e-41f6-974c-b83cde34cbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:45.897176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd3502-fa3c-458e-b889-2ff43c8f917a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:45.902249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329bebb-117f-43c7-b0e8-f0604b1de57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:45.902965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329bebb-117f-43c7-b0e8-f0604b1de57b admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:45.903325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329bebb-117f-43c7-b0e8-f0604b1de57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:45.903563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329bebb-117f-43c7-b0e8-f0604b1de57b admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:45.904274 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329bebb-117f-43c7-b0e8-f0604b1de57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:45.906975 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329bebb-117f-43c7-b0e8-f0604b1de57b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:45.937769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1072/2137] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:45 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:45.942397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329bebb-117f-43c7-b0e8-f0604b1de57b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:45.944206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c329bebb-117f-43c7-b0e8-f0604b1de57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:45.946343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1066/2138] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:45.958437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f936a8c-1a76-4e60-ba17-829093de1cde None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:45.958902 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f936a8c-1a76-4e60-ba17-829093de1cde None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:45.959172 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329bebb-117f-43c7-b0e8-f0604b1de57b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:45.959359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f936a8c-1a76-4e60-ba17-829093de1cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:45.964449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58399e32-9b32-4f13-aa7f-3af1ae033768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:45.965133 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58399e32-9b32-4f13-aa7f-3af1ae033768 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:45.965410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58399e32-9b32-4f13-aa7f-3af1ae033768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:45.965685 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58399e32-9b32-4f13-aa7f-3af1ae033768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:45.966780 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58399e32-9b32-4f13-aa7f-3af1ae033768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:45.969913 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58399e32-9b32-4f13-aa7f-3af1ae033768 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:45.983716 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4f936a8c-1a76-4e60-ba17-829093de1cde None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:45.984547 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4f936a8c-1a76-4e60-ba17-829093de1cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:45.987489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1073/2139] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:45.988340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58399e32-9b32-4f13-aa7f-3af1ae033768 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:45.994802 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1067/2140] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:45.998992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f936a8c-1a76-4e60-ba17-829093de1cde None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:46.000733 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58399e32-9b32-4f13-aa7f-3af1ae033768 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:46.007087 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f004dc-4e71-468f-aac7-a5b9399a00de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:46.007896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f004dc-4e71-468f-aac7-a5b9399a00de admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.008189 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f004dc-4e71-468f-aac7-a5b9399a00de admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.008466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f004dc-4e71-468f-aac7-a5b9399a00de admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.009218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f004dc-4e71-468f-aac7-a5b9399a00de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:46.010493 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f936a8c-1a76-4e60-ba17-829093de1cde None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:46.010855 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f004dc-4e71-468f-aac7-a5b9399a00de admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:46.016181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb272e01-8c80-4a03-997e-ddb7f53f236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:46.016951 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb272e01-8c80-4a03-997e-ddb7f53f236e admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.017902 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb272e01-8c80-4a03-997e-ddb7f53f236e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.018319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb272e01-8c80-4a03-997e-ddb7f53f236e admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.019548 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb272e01-8c80-4a03-997e-ddb7f53f236e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:17:46.021370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb272e01-8c80-4a03-997e-ddb7f53f236e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:46.024766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb272e01-8c80-4a03-997e-ddb7f53f236e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:46.025712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1074/2141] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:46.031635 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f004dc-4e71-468f-aac7-a5b9399a00de admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:46.044319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f004dc-4e71-468f-aac7-a5b9399a00de admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:46.051478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ed42-9759-49a1-a99b-048c50cc222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:46.052578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ed42-9759-49a1-a99b-048c50cc222a admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.052858 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ed42-9759-49a1-a99b-048c50cc222a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.053412 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ed42-9759-49a1-a99b-048c50cc222a admin admin] PATH_INFO: `/v3/projects/d3237e3093f74f85a263807e97d1ec37/users/5e758636d2a0444d97a6622ff717ff59/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.054118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1068/2142] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:17:46.060185 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb272e01-8c80-4a03-997e-ddb7f53f236e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:46.062640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-eb272e01-8c80-4a03-997e-ddb7f53f236e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:46.077035 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ed42-9759-49a1-a99b-048c50cc222a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3237e3093f74f85a263807e97d1ec37, user_id=5e758636d2a0444d97a6622ff717ff59, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:46.079584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb272e01-8c80-4a03-997e-ddb7f53f236e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:46.079890 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ed42-9759-49a1-a99b-048c50cc222a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:46.087278 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88863b9-7a0b-4b00-9ef7-efa16783bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:46.088566 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88863b9-7a0b-4b00-9ef7-efa16783bd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.089060 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88863b9-7a0b-4b00-9ef7-efa16783bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.089485 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88863b9-7a0b-4b00-9ef7-efa16783bd52 admin admin] PATH_INFO: `/v3/users/3179681fb9ba425da540c21f0f4c9c1f` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.091364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88863b9-7a0b-4b00-9ef7-efa16783bd52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3179681fb9ba425da540c21f0f4c9c1f)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:46.093660 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88863b9-7a0b-4b00-9ef7-efa16783bd52 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:46.122750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1075/2143] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:46 2022] PUT /identity/v3/projects/d3237e3093f74f85a263807e97d1ec37/users/5e758636d2a0444d97a6622ff717ff59/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:46.124089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ed42-9759-49a1-a99b-048c50cc222a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:46.163787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b88863b9-7a0b-4b00-9ef7-efa16783bd52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3179681fb9ba425da540c21f0f4c9c1f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:46.164466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b88863b9-7a0b-4b00-9ef7-efa16783bd52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3179681fb9ba425da540c21f0f4c9c1f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:46.177586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b88863b9-7a0b-4b00-9ef7-efa16783bd52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3179681fb9ba425da540c21f0f4c9c1f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:46.185993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b88863b9-7a0b-4b00-9ef7-efa16783bd52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3179681fb9ba425da540c21f0f4c9c1f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:46.186803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b88863b9-7a0b-4b00-9ef7-efa16783bd52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3179681fb9ba425da540c21f0f4c9c1f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:46.202766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ed42-9759-49a1-a99b-048c50cc222a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:46.203038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1069/2144] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:46 2022] DELETE /identity/v3/users/3179681fb9ba425da540c21f0f4c9c1f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:46.204372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e017b-ad81-4e13-bc9f-c6aaf791118c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.204652 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e017b-ad81-4e13-bc9f-c6aaf791118c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.204932 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e017b-ad81-4e13-bc9f-c6aaf791118c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.222272 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:46.240806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:46.244584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d99e017b-ad81-4e13-bc9f-c6aaf791118c None None] MFA Rules not processed for user `5e758636d2a0444d97a6622ff717ff59`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:46.247033 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d99e017b-ad81-4e13-bc9f-c6aaf791118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:46.274069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc5a2b-1155-47b2-81ab-8983369d4560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:46.274862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc5a2b-1155-47b2-81ab-8983369d4560 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.275144 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc5a2b-1155-47b2-81ab-8983369d4560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.275412 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc5a2b-1155-47b2-81ab-8983369d4560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.276300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc5a2b-1155-47b2-81ab-8983369d4560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:46.278922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc5a2b-1155-47b2-81ab-8983369d4560 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:46.319347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1076/2145] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:46 2022] POST /identity/v3/projects => generated 371 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:46.321333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0782e-6125-419d-8524-22e67c38e01d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.321826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0782e-6125-419d-8524-22e67c38e01d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.322327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0782e-6125-419d-8524-22e67c38e01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.345439 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b5f0782e-6125-419d-8524-22e67c38e01d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:46.350320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1070/2146] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:46.350320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e017b-ad81-4e13-bc9f-c6aaf791118c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:46.350320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d99e017b-ad81-4e13-bc9f-c6aaf791118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:46.351505 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b5f0782e-6125-419d-8524-22e67c38e01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:46.370413 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e017b-ad81-4e13-bc9f-c6aaf791118c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:46.461757 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1077/2147] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:46.462922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0782e-6125-419d-8524-22e67c38e01d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:46.464974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b5f0782e-6125-419d-8524-22e67c38e01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:46.484311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c416ecf-ad42-43ff-93da-98d50bf36bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:46.486533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0782e-6125-419d-8524-22e67c38e01d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:46.487033 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c416ecf-ad42-43ff-93da-98d50bf36bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.487588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c416ecf-ad42-43ff-93da-98d50bf36bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.488073 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c416ecf-ad42-43ff-93da-98d50bf36bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.489317 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c416ecf-ad42-43ff-93da-98d50bf36bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:46.492845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8cfa8-8101-4ce5-b982-857babc1008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:46.493650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8cfa8-8101-4ce5-b982-857babc1008c admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.494618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8cfa8-8101-4ce5-b982-857babc1008c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.494618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8cfa8-8101-4ce5-b982-857babc1008c admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.495670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8cfa8-8101-4ce5-b982-857babc1008c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:46.495990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c416ecf-ad42-43ff-93da-98d50bf36bb0 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:46.498069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8cfa8-8101-4ce5-b982-857babc1008c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:46.530249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1071/2148] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:46 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:46.532158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c416ecf-ad42-43ff-93da-98d50bf36bb0 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:46.534725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1c416ecf-ad42-43ff-93da-98d50bf36bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:46.540705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1078/2149] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:46 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:46.544039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8cfa8-8101-4ce5-b982-857babc1008c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:46.650958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8cfa8-8101-4ce5-b982-857babc1008c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:46.657311 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3535c-cb93-4a17-b1c7-5aaf6b4ad16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:46.660492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c416ecf-ad42-43ff-93da-98d50bf36bb0 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:46.667058 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3535c-cb93-4a17-b1c7-5aaf6b4ad16b admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.667427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3535c-cb93-4a17-b1c7-5aaf6b4ad16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.667790 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3535c-cb93-4a17-b1c7-5aaf6b4ad16b admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.668514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3535c-cb93-4a17-b1c7-5aaf6b4ad16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:46.670481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3535c-cb93-4a17-b1c7-5aaf6b4ad16b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:46.699235 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1079/2150] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:46.700721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3535c-cb93-4a17-b1c7-5aaf6b4ad16b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:46.731406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3535c-cb93-4a17-b1c7-5aaf6b4ad16b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:46.737960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5d3c3-93fa-4dbe-a033-1b72baf5d5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:46.739169 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5d3c3-93fa-4dbe-a033-1b72baf5d5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.739909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5d3c3-93fa-4dbe-a033-1b72baf5d5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.740345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5d3c3-93fa-4dbe-a033-1b72baf5d5a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.742063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5d3c3-93fa-4dbe-a033-1b72baf5d5a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:46.745531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5d3c3-93fa-4dbe-a033-1b72baf5d5a0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:46.774156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:46.783430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1080/2151] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:46 2022] POST /identity/v3/users => generated 292 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:46.785036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5d3c3-93fa-4dbe-a033-1b72baf5d5a0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:46.790773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f6fc7-63fc-43d4-a1de-204f44afc031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:46.791470 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f6fc7-63fc-43d4-a1de-204f44afc031 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.791756 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f6fc7-63fc-43d4-a1de-204f44afc031 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.792032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f6fc7-63fc-43d4-a1de-204f44afc031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.795333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:46.805279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5d3c3-93fa-4dbe-a033-1b72baf5d5a0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:46.806208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f6fc7-63fc-43d4-a1de-204f44afc031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:46.808939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f6fc7-63fc-43d4-a1de-204f44afc031 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:46.814034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cc4b4-3ea3-4340-8f3b-97678da41eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:46.815125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cc4b4-3ea3-4340-8f3b-97678da41eda admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.815566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cc4b4-3ea3-4340-8f3b-97678da41eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.816561 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cc4b4-3ea3-4340-8f3b-97678da41eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.817685 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cc4b4-3ea3-4340-8f3b-97678da41eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:46.821280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cc4b4-3ea3-4340-8f3b-97678da41eda admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:46.827702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1072/2152] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:46.838014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f6fc7-63fc-43d4-a1de-204f44afc031 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:46.844873 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1081/2153] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:46.851251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cc4b4-3ea3-4340-8f3b-97678da41eda admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:46.868739 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cc4b4-3ea3-4340-8f3b-97678da41eda admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:46.871732 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f6fc7-63fc-43d4-a1de-204f44afc031 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:46.876205 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb86d2-17a7-4b43-ab79-83cd80a8df28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:46.878868 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb86d2-17a7-4b43-ab79-83cd80a8df28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.879590 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb86d2-17a7-4b43-ab79-83cd80a8df28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.880180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb86d2-17a7-4b43-ab79-83cd80a8df28 admin admin] PATH_INFO: `/v3/projects/1474cbcd333b494682f25d30ba455b50/users/a0e5b8eaad5e47db98c50f16187dd1f0/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.882534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6c336-e1cc-47c1-b12d-a513e74dffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:46.883610 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6c336-e1cc-47c1-b12d-a513e74dffa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.884309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6c336-e1cc-47c1-b12d-a513e74dffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.884729 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6c336-e1cc-47c1-b12d-a513e74dffa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.886411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6c336-e1cc-47c1-b12d-a513e74dffa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:46.890686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6c336-e1cc-47c1-b12d-a513e74dffa9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:46.906221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb86d2-17a7-4b43-ab79-83cd80a8df28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1474cbcd333b494682f25d30ba455b50, user_id=a0e5b8eaad5e47db98c50f16187dd1f0, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:46.909613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb86d2-17a7-4b43-ab79-83cd80a8df28 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:46.913265 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1073/2154] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:46.920520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6c336-e1cc-47c1-b12d-a513e74dffa9 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:46.931874 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1082/2155] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:46 2022] PUT /identity/v3/projects/1474cbcd333b494682f25d30ba455b50/users/a0e5b8eaad5e47db98c50f16187dd1f0/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:46.944619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca4451-1421-4b92-bb4f-ac928d87deda None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:46.944980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca4451-1421-4b92-bb4f-ac928d87deda None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:46.945184 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca4451-1421-4b92-bb4f-ac928d87deda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:46.946797 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6c336-e1cc-47c1-b12d-a513e74dffa9 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:47.010187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-48ca4451-1421-4b92-bb4f-ac928d87deda None None] MFA Rules not processed for user `a0e5b8eaad5e47db98c50f16187dd1f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:47.012224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-48ca4451-1421-4b92-bb4f-ac928d87deda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:47.093735 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b1efb-9be2-4698-a057-abf6f43ac97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:47.096110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b1efb-9be2-4698-a057-abf6f43ac97b admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:47.096800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b1efb-9be2-4698-a057-abf6f43ac97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:47.097284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b1efb-9be2-4698-a057-abf6f43ac97b admin admin] PATH_INFO: `/v3/projects/28a7e8bdeffe462e96441485bad5e45b/users/cbc29701d8924ca9a0c6763d01fcbec4/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:47.147328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b1efb-9be2-4698-a057-abf6f43ac97b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a7e8bdeffe462e96441485bad5e45b, user_id=cbc29701d8924ca9a0c6763d01fcbec4, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:47.158934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b1efb-9be2-4698-a057-abf6f43ac97b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:47.202210 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1074/2156] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:46 2022] PUT /identity/v3/projects/28a7e8bdeffe462e96441485bad5e45b/users/cbc29701d8924ca9a0c6763d01fcbec4/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:47.209653 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b1efb-9be2-4698-a057-abf6f43ac97b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:47.217607 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1083/2157] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:47.245812 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca4451-1421-4b92-bb4f-ac928d87deda None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:47.248667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-48ca4451-1421-4b92-bb4f-ac928d87deda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:47.375661 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b1efb-9be2-4698-a057-abf6f43ac97b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:47.382297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea66a70-46fa-44a3-bb3d-3c4d075932d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:47.383292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea66a70-46fa-44a3-bb3d-3c4d075932d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:47.383473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea66a70-46fa-44a3-bb3d-3c4d075932d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:47.384051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea66a70-46fa-44a3-bb3d-3c4d075932d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:47.384797 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea66a70-46fa-44a3-bb3d-3c4d075932d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:47.387498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea66a70-46fa-44a3-bb3d-3c4d075932d2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:47.422158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1075/2158] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:47.425466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea66a70-46fa-44a3-bb3d-3c4d075932d2 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:47.461012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca4451-1421-4b92-bb4f-ac928d87deda None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:47.470573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea66a70-46fa-44a3-bb3d-3c4d075932d2 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:47.516841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe0755-121b-4670-a924-089363d2544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:47.518105 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe0755-121b-4670-a924-089363d2544e admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:47.519549 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe0755-121b-4670-a924-089363d2544e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:47.519910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe0755-121b-4670-a924-089363d2544e admin admin] PATH_INFO: `/v3/projects/28a7e8bdeffe462e96441485bad5e45b/users/cbc29701d8924ca9a0c6763d01fcbec4/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:47.523132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe0755-121b-4670-a924-089363d2544e admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a7e8bdeffe462e96441485bad5e45b, user_id=cbc29701d8924ca9a0c6763d01fcbec4, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:47.535901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe0755-121b-4670-a924-089363d2544e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:47.545621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1076/2159] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:47 2022] PUT /identity/v3/projects/28a7e8bdeffe462e96441485bad5e45b/users/cbc29701d8924ca9a0c6763d01fcbec4/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:47.558183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe0755-121b-4670-a924-089363d2544e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:47.560807 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c7fe0755-121b-4670-a924-089363d2544e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:47.631101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183e0d2-414c-40e2-baf4-bfdbeaeb095e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:47.631826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183e0d2-414c-40e2-baf4-bfdbeaeb095e service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:47.632115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183e0d2-414c-40e2-baf4-bfdbeaeb095e service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:47.632392 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183e0d2-414c-40e2-baf4-bfdbeaeb095e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:47.676398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:47.691558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:47.703960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe0755-121b-4670-a924-089363d2544e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:47.709682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:47.710562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:47.710867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:47.711156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] PATH_INFO: `/v3/projects/5add293a58ed4980909cbd21ae33e1dd` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:47.712488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5add293a58ed4980909cbd21ae33e1dd)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:47.714688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:47.759593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183e0d2-414c-40e2-baf4-bfdbeaeb095e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:47.761946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183e0d2-414c-40e2-baf4-bfdbeaeb095e service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:47.781954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1084/2160] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:47.783420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747b675-ef88-4ee8-a7ec-1dcf49823c9b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:47.783729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747b675-ef88-4ee8-a7ec-1dcf49823c9b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:47.783995 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747b675-ef88-4ee8-a7ec-1dcf49823c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:47.814084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5add293a58ed4980909cbd21ae33e1dd', 'request_id': 'req-7aedf37f-c498-4a56-b4b7-746c219dd031'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:47.827234 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5add293a58ed4980909cbd21ae33e1dd', 'request_id': 'req-7aedf37f-c498-4a56-b4b7-746c219dd031'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:47.836149 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5add293a58ed4980909cbd21ae33e1dd', 'request_id': 'req-7aedf37f-c498-4a56-b4b7-746c219dd031'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:47.858920 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8747b675-ef88-4ee8-a7ec-1dcf49823c9b None None] MFA Rules not processed for user `cbc29701d8924ca9a0c6763d01fcbec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:47.860288 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8747b675-ef88-4ee8-a7ec-1dcf49823c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:47.866143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] The token cache is being invalidate because project 5add293a58ed4980909cbd21ae33e1dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:47.866473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:47.869123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:47.879492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1077/2161] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:47 2022] DELETE /identity/v3/projects/5add293a58ed4980909cbd21ae33e1dd => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:47.881938 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:47.888668 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:47.968793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1085/2162] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:47.971569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efccec0-50c8-40fc-8f74-b25140224ea2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:47.974850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedf37f-c498-4a56-b4b7-746c219dd031 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:47.978864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efccec0-50c8-40fc-8f74-b25140224ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:47.979751 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efccec0-50c8-40fc-8f74-b25140224ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:47.981819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbce8bb-c673-49af-b5b9-d335c03c8d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:47.982444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce8bb-c673-49af-b5b9-d335c03c8d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:47.982768 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce8bb-c673-49af-b5b9-d335c03c8d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:47.983050 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce8bb-c673-49af-b5b9-d335c03c8d51 admin admin] PATH_INFO: `/v3/users/a0e5b8eaad5e47db98c50f16187dd1f0` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:47.984625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbce8bb-c673-49af-b5b9-d335c03c8d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e5b8eaad5e47db98c50f16187dd1f0)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:47.986562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbce8bb-c673-49af-b5b9-d335c03c8d51 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:48.009479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1efccec0-50c8-40fc-8f74-b25140224ea2 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:48.011441 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1efccec0-50c8-40fc-8f74-b25140224ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:48.029934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1086/2163] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:48.031623 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efccec0-50c8-40fc-8f74-b25140224ea2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:48.034041 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1efccec0-50c8-40fc-8f74-b25140224ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:48.069236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2dbce8bb-c673-49af-b5b9-d335c03c8d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e5b8eaad5e47db98c50f16187dd1f0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:48.069911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2dbce8bb-c673-49af-b5b9-d335c03c8d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e5b8eaad5e47db98c50f16187dd1f0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:48.090713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2dbce8bb-c673-49af-b5b9-d335c03c8d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e5b8eaad5e47db98c50f16187dd1f0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:48.103993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2dbce8bb-c673-49af-b5b9-d335c03c8d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e5b8eaad5e47db98c50f16187dd1f0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:48.105218 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2dbce8bb-c673-49af-b5b9-d335c03c8d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e5b8eaad5e47db98c50f16187dd1f0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:48.116650 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:48.134022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1078/2164] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:47 2022] DELETE /identity/v3/users/a0e5b8eaad5e47db98c50f16187dd1f0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:48.135626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a756ea-15e7-45f1-abad-45cd412947ad None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:48.135973 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a756ea-15e7-45f1-abad-45cd412947ad None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:48.136222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a756ea-15e7-45f1-abad-45cd412947ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:48.143267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efccec0-50c8-40fc-8f74-b25140224ea2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:48.156881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-25a756ea-15e7-45f1-abad-45cd412947ad None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:48.158111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-25a756ea-15e7-45f1-abad-45cd412947ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:48.214115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ac4f-f636-46d4-8626-6967a7534189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:48.214868 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ac4f-f636-46d4-8626-6967a7534189 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:48.215156 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ac4f-f636-46d4-8626-6967a7534189 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:48.215433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ac4f-f636-46d4-8626-6967a7534189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:48.218260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d1e6ac4f-f636-46d4-8626-6967a7534189 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:48.229655 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1079/2165] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:48.229655 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40ab77-f160-4410-b300-840e38c1e8cf None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:48.229655 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40ab77-f160-4410-b300-840e38c1e8cf None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:48.229655 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40ab77-f160-4410-b300-840e38c1e8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:48.238355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:48.250339 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7e40ab77-f160-4410-b300-840e38c1e8cf None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:48.251671 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7e40ab77-f160-4410-b300-840e38c1e8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:48.263426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1080/2166] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:48.265018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40ab77-f160-4410-b300-840e38c1e8cf None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:48.278197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40ab77-f160-4410-b300-840e38c1e8cf None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:48.284663 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0657ec8-50e1-40d7-a442-ecc7d4887b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:48.286041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0657ec8-50e1-40d7-a442-ecc7d4887b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:48.286275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0657ec8-50e1-40d7-a442-ecc7d4887b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:48.286498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0657ec8-50e1-40d7-a442-ecc7d4887b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:48.287455 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0657ec8-50e1-40d7-a442-ecc7d4887b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:17:48.288048 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0657ec8-50e1-40d7-a442-ecc7d4887b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:48.291230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0657ec8-50e1-40d7-a442-ecc7d4887b44 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:48.305221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1081/2167] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:17:48.305221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0657ec8-50e1-40d7-a442-ecc7d4887b44 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:48.308274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c0657ec8-50e1-40d7-a442-ecc7d4887b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:48.316877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ac4f-f636-46d4-8626-6967a7534189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:48.318695 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ac4f-f636-46d4-8626-6967a7534189 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:48.329512 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1087/2168] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:48.330477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ac4f-f636-46d4-8626-6967a7534189 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:48.342205 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ac4f-f636-46d4-8626-6967a7534189 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:48.348320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94902a10-af74-4035-8048-3387197cd65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:48.349187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94902a10-af74-4035-8048-3387197cd65d admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:48.349475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94902a10-af74-4035-8048-3387197cd65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:48.349792 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94902a10-af74-4035-8048-3387197cd65d admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:48.350706 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94902a10-af74-4035-8048-3387197cd65d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:48.353391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94902a10-af74-4035-8048-3387197cd65d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:48.384114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1088/2169] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:48 2022] POST /identity/v3/projects => generated 397 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:48.389863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94902a10-af74-4035-8048-3387197cd65d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:48.394393 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0657ec8-50e1-40d7-a442-ecc7d4887b44 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:48.488762 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94902a10-af74-4035-8048-3387197cd65d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:48.496393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd79da-d334-4272-948b-273c48caa13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:48.497477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd79da-d334-4272-948b-273c48caa13d admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:48.497875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd79da-d334-4272-948b-273c48caa13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:48.498306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd79da-d334-4272-948b-273c48caa13d admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:48.499258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd79da-d334-4272-948b-273c48caa13d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:48.501833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd79da-d334-4272-948b-273c48caa13d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:48.504556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c25aa-7e9c-4e80-9a77-7a0e66c51591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:48.506410 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c25aa-7e9c-4e80-9a77-7a0e66c51591 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:48.507045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c25aa-7e9c-4e80-9a77-7a0e66c51591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:48.507807 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c25aa-7e9c-4e80-9a77-7a0e66c51591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:48.542082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c25aa-7e9c-4e80-9a77-7a0e66c51591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:48.546424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1089/2170] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:48 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:17:48.546641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c25aa-7e9c-4e80-9a77-7a0e66c51591 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:48.547880 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd79da-d334-4272-948b-273c48caa13d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:48.562758 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1082/2171] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:48.569200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd79da-d334-4272-948b-273c48caa13d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:48.575899 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731ff14-c64d-42e2-a5f4-7f47be1a292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:48.577315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731ff14-c64d-42e2-a5f4-7f47be1a292a admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:48.577901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731ff14-c64d-42e2-a5f4-7f47be1a292a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:48.578364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731ff14-c64d-42e2-a5f4-7f47be1a292a admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:48.579585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731ff14-c64d-42e2-a5f4-7f47be1a292a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:48.582516 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731ff14-c64d-42e2-a5f4-7f47be1a292a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:48.602256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1090/2172] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:17:48.606530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c25aa-7e9c-4e80-9a77-7a0e66c51591 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:48.618629 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c25aa-7e9c-4e80-9a77-7a0e66c51591 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:48.625500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf811b-b612-4793-a268-99f0f59de3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:48.626226 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf811b-b612-4793-a268-99f0f59de3cc admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:48.626508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf811b-b612-4793-a268-99f0f59de3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:48.626841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf811b-b612-4793-a268-99f0f59de3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:48.628035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf811b-b612-4793-a268-99f0f59de3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:48.630084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf811b-b612-4793-a268-99f0f59de3cc admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:48.646744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1083/2173] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:48.648136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731ff14-c64d-42e2-a5f4-7f47be1a292a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:48.664339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731ff14-c64d-42e2-a5f4-7f47be1a292a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:48.671455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b447534-833e-46f8-b785-fc79f3fd2b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:48.672489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b447534-833e-46f8-b785-fc79f3fd2b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:48.672887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b447534-833e-46f8-b785-fc79f3fd2b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:48.673086 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b447534-833e-46f8-b785-fc79f3fd2b2e admin admin] PATH_INFO: `/v3/projects/9d7c58b64e4147c0b927e0750efd5269/users/3330bc108de9457993d6299f133e5ddd/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:48.705954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b447534-833e-46f8-b785-fc79f3fd2b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7c58b64e4147c0b927e0750efd5269, user_id=3330bc108de9457993d6299f133e5ddd, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:48.706855 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b447534-833e-46f8-b785-fc79f3fd2b2e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:48.747665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1091/2174] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:48 2022] PUT /identity/v3/projects/9d7c58b64e4147c0b927e0750efd5269/users/3330bc108de9457993d6299f133e5ddd/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:48.748071 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651a5f1-66bc-4180-a98b-123af48f101b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:48.748364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651a5f1-66bc-4180-a98b-123af48f101b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:48.748642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651a5f1-66bc-4180-a98b-123af48f101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:48.793169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5651a5f1-66bc-4180-a98b-123af48f101b None None] MFA Rules not processed for user `3330bc108de9457993d6299f133e5ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:48.795688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5651a5f1-66bc-4180-a98b-123af48f101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:48.823045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:48.953337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1084/2175] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:48.967025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b447534-833e-46f8-b785-fc79f3fd2b2e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:48.969059 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6b447534-833e-46f8-b785-fc79f3fd2b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:49.069245 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:49.073802 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b447534-833e-46f8-b785-fc79f3fd2b2e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:49.080919 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b2294-a9b6-4be9-b8b9-22ba20335344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:49.082007 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b2294-a9b6-4be9-b8b9-22ba20335344 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:49.082298 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b2294-a9b6-4be9-b8b9-22ba20335344 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:49.082575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b2294-a9b6-4be9-b8b9-22ba20335344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:49.097726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b2294-a9b6-4be9-b8b9-22ba20335344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:49.100633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b2294-a9b6-4be9-b8b9-22ba20335344 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:49.119204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1092/2176] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:49.258209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651a5f1-66bc-4180-a98b-123af48f101b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:49.260787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5651a5f1-66bc-4180-a98b-123af48f101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:49.401363 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651a5f1-66bc-4180-a98b-123af48f101b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:49.412131 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe09f48-3de4-45cc-aa76-fbf740a88f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:49.413040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe09f48-3de4-45cc-aa76-fbf740a88f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:49.413317 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe09f48-3de4-45cc-aa76-fbf740a88f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:49.413590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe09f48-3de4-45cc-aa76-fbf740a88f12 admin admin] PATH_INFO: `/v3/projects/1474cbcd333b494682f25d30ba455b50` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:49.417791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe09f48-3de4-45cc-aa76-fbf740a88f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1474cbcd333b494682f25d30ba455b50)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:49.431076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe09f48-3de4-45cc-aa76-fbf740a88f12 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:49.580165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0fe09f48-3de4-45cc-aa76-fbf740a88f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1474cbcd333b494682f25d30ba455b50', 'request_id': 'req-0fe09f48-3de4-45cc-aa76-fbf740a88f12'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:49.600606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0fe09f48-3de4-45cc-aa76-fbf740a88f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1474cbcd333b494682f25d30ba455b50', 'request_id': 'req-0fe09f48-3de4-45cc-aa76-fbf740a88f12'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:49.613242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0fe09f48-3de4-45cc-aa76-fbf740a88f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1474cbcd333b494682f25d30ba455b50', 'request_id': 'req-0fe09f48-3de4-45cc-aa76-fbf740a88f12'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:49.631501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0fe09f48-3de4-45cc-aa76-fbf740a88f12 admin admin] The token cache is being invalidate because project 1474cbcd333b494682f25d30ba455b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:49.631947 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0fe09f48-3de4-45cc-aa76-fbf740a88f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:49.632701 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0fe09f48-3de4-45cc-aa76-fbf740a88f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:49.635037 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1085/2177] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:49 2022] DELETE /identity/v3/projects/1474cbcd333b494682f25d30ba455b50 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:51.220963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b2294-a9b6-4be9-b8b9-22ba20335344 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:51.222529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-069b2294-a9b6-4be9-b8b9-22ba20335344 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:51.238382 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b2294-a9b6-4be9-b8b9-22ba20335344 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:51.367910 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a4cb8-944e-451c-aadd-01979f61c248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:51.368877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a4cb8-944e-451c-aadd-01979f61c248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:51.369168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a4cb8-944e-451c-aadd-01979f61c248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:51.369629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a4cb8-944e-451c-aadd-01979f61c248 admin admin] PATH_INFO: `/v3/users/5e758636d2a0444d97a6622ff717ff59` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:51.371121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a4cb8-944e-451c-aadd-01979f61c248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e758636d2a0444d97a6622ff717ff59)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:51.375120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a4cb8-944e-451c-aadd-01979f61c248 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:51.443092 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-fd0a4cb8-944e-451c-aadd-01979f61c248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e758636d2a0444d97a6622ff717ff59'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:51.458279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-fd0a4cb8-944e-451c-aadd-01979f61c248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e758636d2a0444d97a6622ff717ff59'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:51.465642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-fd0a4cb8-944e-451c-aadd-01979f61c248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e758636d2a0444d97a6622ff717ff59'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:51.487199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-fd0a4cb8-944e-451c-aadd-01979f61c248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e758636d2a0444d97a6622ff717ff59'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:51.488226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-fd0a4cb8-944e-451c-aadd-01979f61c248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e758636d2a0444d97a6622ff717ff59'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:51.506870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1093/2178] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:51 2022] DELETE /identity/v3/users/5e758636d2a0444d97a6622ff717ff59 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:51.511765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722c6d-e915-4795-b412-1f7a5e1a7017 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:51.512747 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722c6d-e915-4795-b412-1f7a5e1a7017 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:51.513062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722c6d-e915-4795-b412-1f7a5e1a7017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:51.535671 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4c722c6d-e915-4795-b412-1f7a5e1a7017 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:51.537239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4c722c6d-e915-4795-b412-1f7a5e1a7017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:51.595213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:51.628825 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1086/2179] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:51.656703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a4cb8-944e-451c-aadd-01979f61c248 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:51.658298 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-fd0a4cb8-944e-451c-aadd-01979f61c248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:51.755348 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a4cb8-944e-451c-aadd-01979f61c248 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:51.761483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8735bb2-8623-4247-b017-e8999d5e9015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:51.762401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8735bb2-8623-4247-b017-e8999d5e9015 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:51.762920 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8735bb2-8623-4247-b017-e8999d5e9015 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:51.763308 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8735bb2-8623-4247-b017-e8999d5e9015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:51.784814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8735bb2-8623-4247-b017-e8999d5e9015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:51.788035 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8735bb2-8623-4247-b017-e8999d5e9015 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:51.808571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1094/2180] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:52.363686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c722c6d-e915-4795-b412-1f7a5e1a7017 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:52.365938 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4c722c6d-e915-4795-b412-1f7a5e1a7017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:52.390919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c722c6d-e915-4795-b412-1f7a5e1a7017 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:52.426234 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:52.429570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:52.430508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:52.431335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] PATH_INFO: `/v3/projects/d3237e3093f74f85a263807e97d1ec37` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:52.434111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3237e3093f74f85a263807e97d1ec37)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:52.440722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:52.543856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3237e3093f74f85a263807e97d1ec37', 'request_id': 'req-f619d484-af92-45f6-b8df-0f5bc420d9b4'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:52.555397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3237e3093f74f85a263807e97d1ec37', 'request_id': 'req-f619d484-af92-45f6-b8df-0f5bc420d9b4'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:52.562788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3237e3093f74f85a263807e97d1ec37', 'request_id': 'req-f619d484-af92-45f6-b8df-0f5bc420d9b4'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:52.576270 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] The token cache is being invalidate because project d3237e3093f74f85a263807e97d1ec37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:52.576546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:52.577234 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:52.579264 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1087/2181] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:52 2022] DELETE /identity/v3/projects/d3237e3093f74f85a263807e97d1ec37 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:52.583527 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8735bb2-8623-4247-b017-e8999d5e9015 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:52.597216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8735bb2-8623-4247-b017-e8999d5e9015 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:52.614274 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:52.691841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b907c5-39ea-4088-86eb-fdda4cfe8901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:52.692868 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b907c5-39ea-4088-86eb-fdda4cfe8901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:52.693152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b907c5-39ea-4088-86eb-fdda4cfe8901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:52.693428 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b907c5-39ea-4088-86eb-fdda4cfe8901 admin admin] PATH_INFO: `/v3/users/cbc29701d8924ca9a0c6763d01fcbec4` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:52.695028 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b907c5-39ea-4088-86eb-fdda4cfe8901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc29701d8924ca9a0c6763d01fcbec4)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:52.697267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b907c5-39ea-4088-86eb-fdda4cfe8901 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:52.784704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f8b907c5-39ea-4088-86eb-fdda4cfe8901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc29701d8924ca9a0c6763d01fcbec4'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:52.799213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f8b907c5-39ea-4088-86eb-fdda4cfe8901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc29701d8924ca9a0c6763d01fcbec4'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:52.800002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f8b907c5-39ea-4088-86eb-fdda4cfe8901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc29701d8924ca9a0c6763d01fcbec4'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:52.823745 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f8b907c5-39ea-4088-86eb-fdda4cfe8901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc29701d8924ca9a0c6763d01fcbec4'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:52.825014 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f8b907c5-39ea-4088-86eb-fdda4cfe8901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc29701d8924ca9a0c6763d01fcbec4'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:52.851179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1095/2182] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:52 2022] DELETE /identity/v3/users/cbc29701d8924ca9a0c6763d01fcbec4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:53.188846 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:53.192305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:53.218563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b907c5-39ea-4088-86eb-fdda4cfe8901 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:53.220909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f8b907c5-39ea-4088-86eb-fdda4cfe8901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:53.231119 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619d484-af92-45f6-b8df-0f5bc420d9b4 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:53.324636 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b907c5-39ea-4088-86eb-fdda4cfe8901 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:53.335479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:53.338077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:53.338779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:53.339819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07 admin admin] PATH_INFO: `/v3/projects/28a7e8bdeffe462e96441485bad5e45b` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:53.342505 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a7e8bdeffe462e96441485bad5e45b)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:53.345338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:53.367419 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ec5e0-0762-4c1c-8b7e-3cb0d69bcbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:53.369251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec5e0-0762-4c1c-8b7e-3cb0d69bcbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:53.369684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec5e0-0762-4c1c-8b7e-3cb0d69bcbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:53.370072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec5e0-0762-4c1c-8b7e-3cb0d69bcbc7 admin admin] PATH_INFO: `/v3/users/77d716bd0385473a967f472215baec5b` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:53.371986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ec5e0-0762-4c1c-8b7e-3cb0d69bcbc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d716bd0385473a967f472215baec5b)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:53.375456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ec5e0-0762-4c1c-8b7e-3cb0d69bcbc7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:53.410341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:53.431232 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a7e8bdeffe462e96441485bad5e45b', 'request_id': 'req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:53.450792 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a7e8bdeffe462e96441485bad5e45b', 'request_id': 'req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:53.465684 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a7e8bdeffe462e96441485bad5e45b', 'request_id': 'req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:53.468194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-847ec5e0-0762-4c1c-8b7e-3cb0d69bcbc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d716bd0385473a967f472215baec5b'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:53.469018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-847ec5e0-0762-4c1c-8b7e-3cb0d69bcbc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d716bd0385473a967f472215baec5b'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:53.487323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-847ec5e0-0762-4c1c-8b7e-3cb0d69bcbc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d716bd0385473a967f472215baec5b'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:53.492891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:53.496349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-847ec5e0-0762-4c1c-8b7e-3cb0d69bcbc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d716bd0385473a967f472215baec5b'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:53.497289 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-847ec5e0-0762-4c1c-8b7e-3cb0d69bcbc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d716bd0385473a967f472215baec5b'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:53.501181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07 admin admin] The token cache is being invalidate because project 28a7e8bdeffe462e96441485bad5e45b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:53.501688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:53.502869 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0fdc0f1b-f35f-4a23-bd82-a2760eb8cb07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:53.504688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1096/2183] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:53 2022] DELETE /identity/v3/projects/28a7e8bdeffe462e96441485bad5e45b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:53.509886 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a00427-55fc-4994-9c68-cb7deef51acc None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:53.510258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a00427-55fc-4994-9c68-cb7deef51acc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:53.510620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a00427-55fc-4994-9c68-cb7deef51acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:53.521664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1088/2184] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:53 2022] DELETE /identity/v3/users/77d716bd0385473a967f472215baec5b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:53.532608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-61a00427-55fc-4994-9c68-cb7deef51acc None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:53.534240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-61a00427-55fc-4994-9c68-cb7deef51acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:53.645329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1097/2185] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:53.653066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419988b-4938-49e3-a46d-fe4c0e98355c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:53.653662 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419988b-4938-49e3-a46d-fe4c0e98355c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:53.653662 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419988b-4938-49e3-a46d-fe4c0e98355c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:53.712394 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8419988b-4938-49e3-a46d-fe4c0e98355c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:53.713841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8419988b-4938-49e3-a46d-fe4c0e98355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:53.727493 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1089/2186] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:53.736190 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a00427-55fc-4994-9c68-cb7deef51acc None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:53.755147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a00427-55fc-4994-9c68-cb7deef51acc None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:53.769555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81daa6-e293-4238-b243-7f839c6c5914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:53.770478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81daa6-e293-4238-b243-7f839c6c5914 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:53.770820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81daa6-e293-4238-b243-7f839c6c5914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:53.771132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81daa6-e293-4238-b243-7f839c6c5914 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:53.772003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81daa6-e293-4238-b243-7f839c6c5914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:17:53.772646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81daa6-e293-4238-b243-7f839c6c5914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:53.774484 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81daa6-e293-4238-b243-7f839c6c5914 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:53.790038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1098/2187] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:17:53.796919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419988b-4938-49e3-a46d-fe4c0e98355c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:53.809551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419988b-4938-49e3-a46d-fe4c0e98355c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:53.816829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c037c0-9bc2-4051-95eb-b84107237c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:53.817536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c037c0-9bc2-4051-95eb-b84107237c4b admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:53.818315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c037c0-9bc2-4051-95eb-b84107237c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:53.818796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c037c0-9bc2-4051-95eb-b84107237c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:53.820469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c037c0-9bc2-4051-95eb-b84107237c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:53.825846 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c037c0-9bc2-4051-95eb-b84107237c4b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:53.876857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1090/2188] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:53 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:53.883315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81daa6-e293-4238-b243-7f839c6c5914 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:53.892419 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c037c0-9bc2-4051-95eb-b84107237c4b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:53.894950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-22c037c0-9bc2-4051-95eb-b84107237c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:53.898330 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81daa6-e293-4238-b243-7f839c6c5914 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:53.986348 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78448462-4470-457f-9e08-97bae6487ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:53.987594 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78448462-4470-457f-9e08-97bae6487ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:53.988058 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78448462-4470-457f-9e08-97bae6487ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:53.988657 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78448462-4470-457f-9e08-97bae6487ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:53.989665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78448462-4470-457f-9e08-97bae6487ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:53.991928 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78448462-4470-457f-9e08-97bae6487ab6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:54.003507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c037c0-9bc2-4051-95eb-b84107237c4b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:54.010032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:54.011105 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:54.011465 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:54.011815 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] PATH_INFO: `/v3/projects/a09d403b30974fc5b90c01d476e6fe10` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:54.013342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09d403b30974fc5b90c01d476e6fe10)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:54.015465 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:54.023384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1099/2189] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:53 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:17:54.027908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78448462-4470-457f-9e08-97bae6487ab6 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:54.043241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78448462-4470-457f-9e08-97bae6487ab6 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:54.051281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fe511-df24-4db4-b45f-ff05c7131e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:54.052846 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fe511-df24-4db4-b45f-ff05c7131e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:54.053356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fe511-df24-4db4-b45f-ff05c7131e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:54.053824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fe511-df24-4db4-b45f-ff05c7131e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:54.055247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fe511-df24-4db4-b45f-ff05c7131e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:54.058483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fe511-df24-4db4-b45f-ff05c7131e74 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:54.078601 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1100/2190] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:17:54.080089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fe511-df24-4db4-b45f-ff05c7131e74 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:54.082325 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09d403b30974fc5b90c01d476e6fe10', 'request_id': 'req-b1542e06-bfec-4b93-b153-065558c9e348'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:54.093631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09d403b30974fc5b90c01d476e6fe10', 'request_id': 'req-b1542e06-bfec-4b93-b153-065558c9e348'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:54.095392 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fe511-df24-4db4-b45f-ff05c7131e74 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:54.103953 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09d403b30974fc5b90c01d476e6fe10', 'request_id': 'req-b1542e06-bfec-4b93-b153-065558c9e348'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:54.120152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] The token cache is being invalidate because project a09d403b30974fc5b90c01d476e6fe10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:54.120564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:54.122199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:54.123842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1091/2191] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:53 2022] DELETE /identity/v3/projects/a09d403b30974fc5b90c01d476e6fe10 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:54.129425 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:54.130945 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:54.131377 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:54.176260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679d4c9-d7c9-4537-b8f9-ff463b49383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:54.177449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679d4c9-d7c9-4537-b8f9-ff463b49383f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:54.178017 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679d4c9-d7c9-4537-b8f9-ff463b49383f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:54.178401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679d4c9-d7c9-4537-b8f9-ff463b49383f admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:54.179345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679d4c9-d7c9-4537-b8f9-ff463b49383f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:54.181389 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679d4c9-d7c9-4537-b8f9-ff463b49383f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:54.194507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1101/2192] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:54.199557 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679d4c9-d7c9-4537-b8f9-ff463b49383f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:54.202615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f679d4c9-d7c9-4537-b8f9-ff463b49383f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:54.202830 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:54.221580 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679d4c9-d7c9-4537-b8f9-ff463b49383f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:54.224207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1542e06-bfec-4b93-b153-065558c9e348 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:54.229931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139bed4-5bd8-4c78-baa9-5dfed46ed4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:54.230903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139bed4-5bd8-4c78-baa9-5dfed46ed4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:54.231819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139bed4-5bd8-4c78-baa9-5dfed46ed4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:54.232110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139bed4-5bd8-4c78-baa9-5dfed46ed4cd admin admin] PATH_INFO: `/v3/projects/23b70b9856a54dc89cf1a8ae9c3b760d/users/289a87dcbb224efc95407a2ba38ec4e2/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:54.233060 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55713d2-fb06-4d89-8ed9-9e0323dad65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:54.234077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55713d2-fb06-4d89-8ed9-9e0323dad65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:54.234421 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55713d2-fb06-4d89-8ed9-9e0323dad65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:54.234894 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55713d2-fb06-4d89-8ed9-9e0323dad65c admin admin] PATH_INFO: `/v3/users/55bacdb07aa045d9aec11acff154ae57` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:54.237010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55713d2-fb06-4d89-8ed9-9e0323dad65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=55bacdb07aa045d9aec11acff154ae57)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:54.238924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55713d2-fb06-4d89-8ed9-9e0323dad65c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:54.252506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139bed4-5bd8-4c78-baa9-5dfed46ed4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b70b9856a54dc89cf1a8ae9c3b760d, user_id=289a87dcbb224efc95407a2ba38ec4e2, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:54.255445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139bed4-5bd8-4c78-baa9-5dfed46ed4cd admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:54.280320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1102/2193] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:54 2022] PUT /identity/v3/projects/23b70b9856a54dc89cf1a8ae9c3b760d/users/289a87dcbb224efc95407a2ba38ec4e2/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:54.294233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471d2e8-c762-4e60-b774-0e73d8ecd017 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:54.294832 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471d2e8-c762-4e60-b774-0e73d8ecd017 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:54.295230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471d2e8-c762-4e60-b774-0e73d8ecd017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:54.351011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a471d2e8-c762-4e60-b774-0e73d8ecd017 None None] MFA Rules not processed for user `289a87dcbb224efc95407a2ba38ec4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:54.352121 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a55713d2-fb06-4d89-8ed9-9e0323dad65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55bacdb07aa045d9aec11acff154ae57'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:54.353472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a55713d2-fb06-4d89-8ed9-9e0323dad65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55bacdb07aa045d9aec11acff154ae57'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:54.353840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a471d2e8-c762-4e60-b774-0e73d8ecd017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:54.399017 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a55713d2-fb06-4d89-8ed9-9e0323dad65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55bacdb07aa045d9aec11acff154ae57'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:54.419205 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a55713d2-fb06-4d89-8ed9-9e0323dad65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55bacdb07aa045d9aec11acff154ae57'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:54.421092 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a55713d2-fb06-4d89-8ed9-9e0323dad65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55bacdb07aa045d9aec11acff154ae57'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:54.465139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1092/2194] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:54 2022] DELETE /identity/v3/users/55bacdb07aa045d9aec11acff154ae57 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:54.488530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1103/2195] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:54.502723 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55713d2-fb06-4d89-8ed9-9e0323dad65c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:54.505575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a55713d2-fb06-4d89-8ed9-9e0323dad65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:54.632897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55713d2-fb06-4d89-8ed9-9e0323dad65c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:54.639577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c67b58-d792-4eee-93c0-c17d46a3afc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:54.640579 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c67b58-d792-4eee-93c0-c17d46a3afc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:54.641083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c67b58-d792-4eee-93c0-c17d46a3afc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:54.641529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c67b58-d792-4eee-93c0-c17d46a3afc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:54.760351 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c67b58-d792-4eee-93c0-c17d46a3afc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:54.763950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c67b58-d792-4eee-93c0-c17d46a3afc4 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:54.798198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1093/2196] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:54.807624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471d2e8-c762-4e60-b774-0e73d8ecd017 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:54.810467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a471d2e8-c762-4e60-b774-0e73d8ecd017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:54.855759 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c67b58-d792-4eee-93c0-c17d46a3afc4 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:54.858049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-03c67b58-d792-4eee-93c0-c17d46a3afc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:54.924670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:54.966803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471d2e8-c762-4e60-b774-0e73d8ecd017 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:55.015686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c67b58-d792-4eee-93c0-c17d46a3afc4 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:55.022696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bddec6-13d4-48c1-b7af-12b0ae2154de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:55.023785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bddec6-13d4-48c1-b7af-12b0ae2154de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:55.024415 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bddec6-13d4-48c1-b7af-12b0ae2154de admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:55.024845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bddec6-13d4-48c1-b7af-12b0ae2154de admin admin] PATH_INFO: `/v3/projects/09f8f034ac0e45b88ed1012ae94253fd` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:55.026590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bddec6-13d4-48c1-b7af-12b0ae2154de admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f8f034ac0e45b88ed1012ae94253fd)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:55.029240 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bddec6-13d4-48c1-b7af-12b0ae2154de admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:55.052230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:55.100031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-53bddec6-13d4-48c1-b7af-12b0ae2154de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f8f034ac0e45b88ed1012ae94253fd', 'request_id': 'req-53bddec6-13d4-48c1-b7af-12b0ae2154de'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:55.108705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b97ef8-87d3-44dc-a668-c60f022a302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:55.109189 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b97ef8-87d3-44dc-a668-c60f022a302d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:55.109383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b97ef8-87d3-44dc-a668-c60f022a302d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:55.109526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b97ef8-87d3-44dc-a668-c60f022a302d admin admin] PATH_INFO: `/v3/users/3330bc108de9457993d6299f133e5ddd` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:55.111918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b97ef8-87d3-44dc-a668-c60f022a302d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3330bc108de9457993d6299f133e5ddd)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:55.116236 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b97ef8-87d3-44dc-a668-c60f022a302d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:55.122393 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-53bddec6-13d4-48c1-b7af-12b0ae2154de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f8f034ac0e45b88ed1012ae94253fd', 'request_id': 'req-53bddec6-13d4-48c1-b7af-12b0ae2154de'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:55.134287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-53bddec6-13d4-48c1-b7af-12b0ae2154de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f8f034ac0e45b88ed1012ae94253fd', 'request_id': 'req-53bddec6-13d4-48c1-b7af-12b0ae2154de'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:55.156821 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-53bddec6-13d4-48c1-b7af-12b0ae2154de admin admin] The token cache is being invalidate because project 09f8f034ac0e45b88ed1012ae94253fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:55.157456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-53bddec6-13d4-48c1-b7af-12b0ae2154de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:55.158327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-53bddec6-13d4-48c1-b7af-12b0ae2154de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:55.166525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1094/2197] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:54 2022] DELETE /identity/v3/projects/09f8f034ac0e45b88ed1012ae94253fd => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:55.172860 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b649-1d81-4883-8ae7-8e05e7ef0913 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:55.173755 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b649-1d81-4883-8ae7-8e05e7ef0913 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:55.174123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b649-1d81-4883-8ae7-8e05e7ef0913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:55.202195 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-12b9b649-1d81-4883-8ae7-8e05e7ef0913 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:55.203693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-12b9b649-1d81-4883-8ae7-8e05e7ef0913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:55.220231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c7b97ef8-87d3-44dc-a668-c60f022a302d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3330bc108de9457993d6299f133e5ddd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:55.239445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c7b97ef8-87d3-44dc-a668-c60f022a302d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3330bc108de9457993d6299f133e5ddd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:55.242458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c7b97ef8-87d3-44dc-a668-c60f022a302d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3330bc108de9457993d6299f133e5ddd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:55.260465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c7b97ef8-87d3-44dc-a668-c60f022a302d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3330bc108de9457993d6299f133e5ddd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:55.261281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c7b97ef8-87d3-44dc-a668-c60f022a302d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3330bc108de9457993d6299f133e5ddd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:55.281026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1104/2198] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:54 2022] DELETE /identity/v3/users/3330bc108de9457993d6299f133e5ddd => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:55.287640 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c865cf-82c0-4dd9-b995-0230145cb96b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:55.288116 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c865cf-82c0-4dd9-b995-0230145cb96b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:55.288568 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c865cf-82c0-4dd9-b995-0230145cb96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:55.308310 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1095/2199] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:55.311282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-49c865cf-82c0-4dd9-b995-0230145cb96b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:55.312794 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-49c865cf-82c0-4dd9-b995-0230145cb96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:55.313684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7db57-bdf8-40e0-906a-36313f10843c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:55.314191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7db57-bdf8-40e0-906a-36313f10843c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:55.314685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7db57-bdf8-40e0-906a-36313f10843c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:55.350873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-cde7db57-bdf8-40e0-906a-36313f10843c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:55.352685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cde7db57-bdf8-40e0-906a-36313f10843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:55.479325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1105/2200] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:55.502122 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c865cf-82c0-4dd9-b995-0230145cb96b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:55.504172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:55.509238 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-49c865cf-82c0-4dd9-b995-0230145cb96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:55.559959 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1096/2201] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:55.561056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7db57-bdf8-40e0-906a-36313f10843c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:55.578004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7db57-bdf8-40e0-906a-36313f10843c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:55.602146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59194356-ad2b-4f8a-bfbd-f1491957d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:55.602820 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59194356-ad2b-4f8a-bfbd-f1491957d215 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:55.603127 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59194356-ad2b-4f8a-bfbd-f1491957d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:55.603393 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59194356-ad2b-4f8a-bfbd-f1491957d215 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:55.604177 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59194356-ad2b-4f8a-bfbd-f1491957d215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:17:55.604493 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59194356-ad2b-4f8a-bfbd-f1491957d215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:55.606797 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59194356-ad2b-4f8a-bfbd-f1491957d215 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:55.641741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1097/2202] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:17:55.643188 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59194356-ad2b-4f8a-bfbd-f1491957d215 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:55.671357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59194356-ad2b-4f8a-bfbd-f1491957d215 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:55.678532 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d9518-7d17-4486-829f-0f03a9bf7e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:55.679362 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d9518-7d17-4486-829f-0f03a9bf7e19 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:55.679664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d9518-7d17-4486-829f-0f03a9bf7e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:55.679913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d9518-7d17-4486-829f-0f03a9bf7e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:55.680653 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d9518-7d17-4486-829f-0f03a9bf7e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:55.683062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d9518-7d17-4486-829f-0f03a9bf7e19 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:55.720165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c865cf-82c0-4dd9-b995-0230145cb96b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:55.729556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f3127-6986-4a72-b6f6-5d83c5941dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:55.730288 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f3127-6986-4a72-b6f6-5d83c5941dca service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:55.730577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f3127-6986-4a72-b6f6-5d83c5941dca service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:55.731245 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f3127-6986-4a72-b6f6-5d83c5941dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:55.740682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1098/2203] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:55 2022] POST /identity/v3/projects => generated 359 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:55.742190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d9518-7d17-4486-829f-0f03a9bf7e19 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:55.745506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f3127-6986-4a72-b6f6-5d83c5941dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:55.760359 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f3127-6986-4a72-b6f6-5d83c5941dca service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:55.779190 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:55.789071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1106/2204] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:55.907611 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d9518-7d17-4486-829f-0f03a9bf7e19 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:55.913706 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9227b4-a65f-4b72-996f-e80d4b6c0db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:55.914417 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9227b4-a65f-4b72-996f-e80d4b6c0db3 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:55.914740 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9227b4-a65f-4b72-996f-e80d4b6c0db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:55.915177 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9227b4-a65f-4b72-996f-e80d4b6c0db3 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:55.915991 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9227b4-a65f-4b72-996f-e80d4b6c0db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:55.918926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9227b4-a65f-4b72-996f-e80d4b6c0db3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:55.962081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1099/2205] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:55 2022] POST /identity/v3/users => generated 280 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:55.963324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f3127-6986-4a72-b6f6-5d83c5941dca service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:55.975456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f3127-6986-4a72-b6f6-5d83c5941dca service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:55.988487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ca5a1-af41-4ad1-b118-f1d8448158e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:55.989806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ca5a1-af41-4ad1-b118-f1d8448158e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:55.990421 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ca5a1-af41-4ad1-b118-f1d8448158e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:55.991133 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ca5a1-af41-4ad1-b118-f1d8448158e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:55.992608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ca5a1-af41-4ad1-b118-f1d8448158e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:55.994737 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ca5a1-af41-4ad1-b118-f1d8448158e3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:56.022475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1107/2206] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:56.024163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9227b4-a65f-4b72-996f-e80d4b6c0db3 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:56.040776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9227b4-a65f-4b72-996f-e80d4b6c0db3 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:56.045917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709789b-cdad-4f56-ae12-d07733a84a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:56.046678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709789b-cdad-4f56-ae12-d07733a84a63 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:56.046969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709789b-cdad-4f56-ae12-d07733a84a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:56.047232 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709789b-cdad-4f56-ae12-d07733a84a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:56.048804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709789b-cdad-4f56-ae12-d07733a84a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:56.050436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709789b-cdad-4f56-ae12-d07733a84a63 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:56.071564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1100/2207] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:56.073266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ca5a1-af41-4ad1-b118-f1d8448158e3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:56.086244 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ca5a1-af41-4ad1-b118-f1d8448158e3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:56.094188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ddfc0-1776-4c40-a248-922ddc3dfa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:56.095479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ddfc0-1776-4c40-a248-922ddc3dfa12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:56.095877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ddfc0-1776-4c40-a248-922ddc3dfa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:56.096217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ddfc0-1776-4c40-a248-922ddc3dfa12 admin admin] PATH_INFO: `/v3/projects/8e30ee9bdd8744338ccb4945cf7a7c4e/users/294af7e56696403db6fd812a019db12e/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:56.128425 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ddfc0-1776-4c40-a248-922ddc3dfa12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e30ee9bdd8744338ccb4945cf7a7c4e, user_id=294af7e56696403db6fd812a019db12e, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:56.132459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ddfc0-1776-4c40-a248-922ddc3dfa12 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:56.171750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1108/2208] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:56 2022] PUT /identity/v3/projects/8e30ee9bdd8744338ccb4945cf7a7c4e/users/294af7e56696403db6fd812a019db12e/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:56.242966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe59c39-6b2d-401c-ad33-471fff539c9f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:56.243614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe59c39-6b2d-401c-ad33-471fff539c9f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:56.243986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe59c39-6b2d-401c-ad33-471fff539c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:56.277644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ffe59c39-6b2d-401c-ad33-471fff539c9f None None] MFA Rules not processed for user `294af7e56696403db6fd812a019db12e`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:56.280129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ffe59c39-6b2d-401c-ad33-471fff539c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:56.329373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ddfc0-1776-4c40-a248-922ddc3dfa12 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:56.331859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2a5ddfc0-1776-4c40-a248-922ddc3dfa12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:56.406510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1101/2209] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:56 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:56.453595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ddfc0-1776-4c40-a248-922ddc3dfa12 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:56.459469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe59c39-6b2d-401c-ad33-471fff539c9f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:56.461129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ffe59c39-6b2d-401c-ad33-471fff539c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:56.461752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:56.462769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:56.463137 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:56.463499 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] PATH_INFO: `/v3/projects/9d7c58b64e4147c0b927e0750efd5269` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:56.465641 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7c58b64e4147c0b927e0750efd5269)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:56.467960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:56.499561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:56.537667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe59c39-6b2d-401c-ad33-471fff539c9f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:56.553166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7c58b64e4147c0b927e0750efd5269', 'request_id': 'req-a4376d11-a7b3-491a-9d22-1de2f86acacf'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:56.564320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7c58b64e4147c0b927e0750efd5269', 'request_id': 'req-a4376d11-a7b3-491a-9d22-1de2f86acacf'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:56.572320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7c58b64e4147c0b927e0750efd5269', 'request_id': 'req-a4376d11-a7b3-491a-9d22-1de2f86acacf'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:56.587954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] The token cache is being invalidate because project 9d7c58b64e4147c0b927e0750efd5269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:56.588572 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:56.589334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:56.592570 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1109/2210] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:56 2022] DELETE /identity/v3/projects/9d7c58b64e4147c0b927e0750efd5269 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:56.611418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487f693-4c39-4dde-ac85-314f2fd013f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:56.612116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487f693-4c39-4dde-ac85-314f2fd013f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:56.612403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487f693-4c39-4dde-ac85-314f2fd013f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:56.612679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487f693-4c39-4dde-ac85-314f2fd013f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:56.614890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4487f693-4c39-4dde-ac85-314f2fd013f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:56.710747 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487f693-4c39-4dde-ac85-314f2fd013f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:56.713656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487f693-4c39-4dde-ac85-314f2fd013f7 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:56.731014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1102/2211] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:56 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:56.759931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:56.764425 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:56.888753 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:56.902018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4376d11-a7b3-491a-9d22-1de2f86acacf admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:56.913725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b8740-382f-4ec2-ba53-d815e6c71bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:56.915653 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b8740-382f-4ec2-ba53-d815e6c71bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:56.916887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b8740-382f-4ec2-ba53-d815e6c71bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:56.917879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b8740-382f-4ec2-ba53-d815e6c71bc1 admin admin] PATH_INFO: `/v3/users/294af7e56696403db6fd812a019db12e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:56.921020 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b8740-382f-4ec2-ba53-d815e6c71bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=294af7e56696403db6fd812a019db12e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:56.925433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b8740-382f-4ec2-ba53-d815e6c71bc1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:57.030369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4f7b8740-382f-4ec2-ba53-d815e6c71bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294af7e56696403db6fd812a019db12e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:57.044477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4f7b8740-382f-4ec2-ba53-d815e6c71bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294af7e56696403db6fd812a019db12e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:57.045555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4f7b8740-382f-4ec2-ba53-d815e6c71bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294af7e56696403db6fd812a019db12e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:57.064470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4f7b8740-382f-4ec2-ba53-d815e6c71bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294af7e56696403db6fd812a019db12e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:57.065724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4f7b8740-382f-4ec2-ba53-d815e6c71bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294af7e56696403db6fd812a019db12e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:57.087075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1110/2212] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:17:56 2022] DELETE /identity/v3/users/294af7e56696403db6fd812a019db12e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:57.092316 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ded96-5233-4ce4-8dc6-7bfc6b6d2ef7 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:57.093393 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ded96-5233-4ce4-8dc6-7bfc6b6d2ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:57.095726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ded96-5233-4ce4-8dc6-7bfc6b6d2ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:57.120737 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0c1ded96-5233-4ce4-8dc6-7bfc6b6d2ef7 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:57.122046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0c1ded96-5233-4ce4-8dc6-7bfc6b6d2ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:57.251974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1103/2213] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:57.262795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b8740-382f-4ec2-ba53-d815e6c71bc1 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:57.266592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4f7b8740-382f-4ec2-ba53-d815e6c71bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:57.437472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b8740-382f-4ec2-ba53-d815e6c71bc1 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:57.442840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1b668-bc4c-4555-8a5b-5e86f19bc69a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:57.443767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1b668-bc4c-4555-8a5b-5e86f19bc69a service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:57.444186 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1b668-bc4c-4555-8a5b-5e86f19bc69a service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:57.444642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1b668-bc4c-4555-8a5b-5e86f19bc69a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:57.468409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1b668-bc4c-4555-8a5b-5e86f19bc69a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:57.470186 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1b668-bc4c-4555-8a5b-5e86f19bc69a service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:57.482699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1111/2214] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:17:57.911287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ded96-5233-4ce4-8dc6-7bfc6b6d2ef7 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:57.913460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0c1ded96-5233-4ce4-8dc6-7bfc6b6d2ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:57.942164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ded96-5233-4ce4-8dc6-7bfc6b6d2ef7 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:57.948308 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f762b-ef96-4eba-bffe-bca36a34a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:57.949278 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f762b-ef96-4eba-bffe-bca36a34a4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:57.949634 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f762b-ef96-4eba-bffe-bca36a34a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:57.950103 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f762b-ef96-4eba-bffe-bca36a34a4c8 admin admin] PATH_INFO: `/v3/projects/8e30ee9bdd8744338ccb4945cf7a7c4e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:57.951960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f762b-ef96-4eba-bffe-bca36a34a4c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e30ee9bdd8744338ccb4945cf7a7c4e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:57.954119 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f762b-ef96-4eba-bffe-bca36a34a4c8 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:58.036043 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:58.071705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c83f762b-ef96-4eba-bffe-bca36a34a4c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e30ee9bdd8744338ccb4945cf7a7c4e', 'request_id': 'req-c83f762b-ef96-4eba-bffe-bca36a34a4c8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:58.087583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c83f762b-ef96-4eba-bffe-bca36a34a4c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e30ee9bdd8744338ccb4945cf7a7c4e', 'request_id': 'req-c83f762b-ef96-4eba-bffe-bca36a34a4c8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:58.104508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c83f762b-ef96-4eba-bffe-bca36a34a4c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e30ee9bdd8744338ccb4945cf7a7c4e', 'request_id': 'req-c83f762b-ef96-4eba-bffe-bca36a34a4c8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:58.135636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c83f762b-ef96-4eba-bffe-bca36a34a4c8 admin admin] The token cache is being invalidate because project 8e30ee9bdd8744338ccb4945cf7a7c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:17:58.136379 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c83f762b-ef96-4eba-bffe-bca36a34a4c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:58.138742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c83f762b-ef96-4eba-bffe-bca36a34a4c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:17:58.142311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1104/2215] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:17:57 2022] DELETE /identity/v3/projects/8e30ee9bdd8744338ccb4945cf7a7c4e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:17:58.155567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db001f-5165-4453-9dcd-7d883bc23906 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:58.156355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db001f-5165-4453-9dcd-7d883bc23906 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:58.157343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db001f-5165-4453-9dcd-7d883bc23906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:58.193127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d5db001f-5165-4453-9dcd-7d883bc23906 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:58.194894 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d5db001f-5165-4453-9dcd-7d883bc23906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:58.278760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1112/2216] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:58.287465 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d859-f605-4339-996d-962bb346e39a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:58.287729 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d859-f605-4339-996d-962bb346e39a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:58.288015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d859-f605-4339-996d-962bb346e39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:58.316298 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1398d859-f605-4339-996d-962bb346e39a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:58.318431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1398d859-f605-4339-996d-962bb346e39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:58.332812 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1105/2217] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:17:58.337719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db001f-5165-4453-9dcd-7d883bc23906 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:58.358593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db001f-5165-4453-9dcd-7d883bc23906 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:58.367217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6dd90-74b9-4d48-b3ca-ebdcb4631f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:58.368406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6dd90-74b9-4d48-b3ca-ebdcb4631f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:58.368924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6dd90-74b9-4d48-b3ca-ebdcb4631f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:58.369424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6dd90-74b9-4d48-b3ca-ebdcb4631f67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:58.370858 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6dd90-74b9-4d48-b3ca-ebdcb4631f67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:17:58.371418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6dd90-74b9-4d48-b3ca-ebdcb4631f67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:58.374565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6dd90-74b9-4d48-b3ca-ebdcb4631f67 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:58.393359 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1113/2218] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:17:58.396151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398d859-f605-4339-996d-962bb346e39a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:58.409603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398d859-f605-4339-996d-962bb346e39a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:58.415704 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006607fe-d14e-46e7-9541-e075d3634fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:58.416535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006607fe-d14e-46e7-9541-e075d3634fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:58.416914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006607fe-d14e-46e7-9541-e075d3634fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:58.417303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006607fe-d14e-46e7-9541-e075d3634fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:58.418119 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006607fe-d14e-46e7-9541-e075d3634fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:58.420286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006607fe-d14e-46e7-9541-e075d3634fb7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:58.471093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1106/2219] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:17:58 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:58.473267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6dd90-74b9-4d48-b3ca-ebdcb4631f67 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:58.484347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:17:58.489906 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6dd90-74b9-4d48-b3ca-ebdcb4631f67 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:58.620805 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24033bad-f15c-431b-ac50-2b01e4ccc929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:58.621935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24033bad-f15c-431b-ac50-2b01e4ccc929 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:58.622438 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24033bad-f15c-431b-ac50-2b01e4ccc929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:58.622965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24033bad-f15c-431b-ac50-2b01e4ccc929 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:58.624315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24033bad-f15c-431b-ac50-2b01e4ccc929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:58.631362 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24033bad-f15c-431b-ac50-2b01e4ccc929 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:58.682860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1114/2220] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:17:58 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:17:58.688725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006607fe-d14e-46e7-9541-e075d3634fb7 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:58.716031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006607fe-d14e-46e7-9541-e075d3634fb7 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:58.736758 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05816c3-c538-40a3-9411-9f4db8b77ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:58.738631 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05816c3-c538-40a3-9411-9f4db8b77ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:58.739745 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05816c3-c538-40a3-9411-9f4db8b77ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:58.741263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05816c3-c538-40a3-9411-9f4db8b77ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:58.743227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05816c3-c538-40a3-9411-9f4db8b77ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:58.745609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05816c3-c538-40a3-9411-9f4db8b77ac4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:58.773004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1107/2221] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:17:58.773900 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24033bad-f15c-431b-ac50-2b01e4ccc929 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:58.788367 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24033bad-f15c-431b-ac50-2b01e4ccc929 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:58.794550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be7b13-ef71-4143-99a9-4a458e0fa8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:58.795758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7b13-ef71-4143-99a9-4a458e0fa8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:58.796373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7b13-ef71-4143-99a9-4a458e0fa8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:58.796806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7b13-ef71-4143-99a9-4a458e0fa8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:58.798034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be7b13-ef71-4143-99a9-4a458e0fa8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:58.800117 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be7b13-ef71-4143-99a9-4a458e0fa8d9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:58.825644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1115/2222] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:17:58.836629 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05816c3-c538-40a3-9411-9f4db8b77ac4 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:58.854869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05816c3-c538-40a3-9411-9f4db8b77ac4 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:58.863596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f7128-3255-42fa-8d88-02ab5a80863d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:58.865634 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f7128-3255-42fa-8d88-02ab5a80863d admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:58.866325 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f7128-3255-42fa-8d88-02ab5a80863d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:58.866975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f7128-3255-42fa-8d88-02ab5a80863d admin admin] PATH_INFO: `/v3/projects/bdf99ca427374f0a9333141593ea33c2/users/9a3b95b117914230819b17ecda8ffa7e/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:58.897741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f7128-3255-42fa-8d88-02ab5a80863d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf99ca427374f0a9333141593ea33c2, user_id=9a3b95b117914230819b17ecda8ffa7e, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:58.903467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f7128-3255-42fa-8d88-02ab5a80863d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:58.964967 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1108/2223] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:17:58 2022] PUT /identity/v3/projects/bdf99ca427374f0a9333141593ea33c2/users/9a3b95b117914230819b17ecda8ffa7e/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:17:58.979880 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94967b4-2be8-4bb4-80c0-e0389c08ee6b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:58.980230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94967b4-2be8-4bb4-80c0-e0389c08ee6b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:58.980753 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94967b4-2be8-4bb4-80c0-e0389c08ee6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:59.033074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a94967b4-2be8-4bb4-80c0-e0389c08ee6b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:17:59.037823 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a94967b4-2be8-4bb4-80c0-e0389c08ee6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:59.151335 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1116/2224] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:17:59.162958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f7128-3255-42fa-8d88-02ab5a80863d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:17:59.165339 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c74f7128-3255-42fa-8d88-02ab5a80863d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:17:59.255453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f7128-3255-42fa-8d88-02ab5a80863d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:17:59.282837 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9990f-1b70-428b-839c-10fc11aad0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:17:59.283601 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9990f-1b70-428b-839c-10fc11aad0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:17:59.283891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9990f-1b70-428b-839c-10fc11aad0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:17:59.284251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9990f-1b70-428b-839c-10fc11aad0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:17:59.297388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9990f-1b70-428b-839c-10fc11aad0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:17:59.299129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9990f-1b70-428b-839c-10fc11aad0e2 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:17:59.318964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1109/2225] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:18:05.886860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14a354-74cf-48fc-b1c6-36efecdbbc4f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:05.887839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14a354-74cf-48fc-b1c6-36efecdbbc4f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:05.888376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14a354-74cf-48fc-b1c6-36efecdbbc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:05.929462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ca14a354-74cf-48fc-b1c6-36efecdbbc4f None None] MFA Rules not processed for user `9a3b95b117914230819b17ecda8ffa7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:18:05.931191 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ca14a354-74cf-48fc-b1c6-36efecdbbc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:06.045917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1117/2226] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:18:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:18:06.050367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9990f-1b70-428b-839c-10fc11aad0e2 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:06.088931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9990f-1b70-428b-839c-10fc11aad0e2 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:06.101020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9beacd-f6a4-4915-af0e-e9985a4ec1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:06.101859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9beacd-f6a4-4915-af0e-e9985a4ec1be admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:06.102146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9beacd-f6a4-4915-af0e-e9985a4ec1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:06.102422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9beacd-f6a4-4915-af0e-e9985a4ec1be admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:06.103191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9beacd-f6a4-4915-af0e-e9985a4ec1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:06.105251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9beacd-f6a4-4915-af0e-e9985a4ec1be admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:06.173372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1110/2227] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:18:06 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:18:06.178109 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14a354-74cf-48fc-b1c6-36efecdbbc4f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:06.189992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14a354-74cf-48fc-b1c6-36efecdbbc4f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:06.205124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:18:06.284403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda11db-07e6-4fca-b264-e84ffd86efef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:06.285120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda11db-07e6-4fca-b264-e84ffd86efef admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:06.285403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda11db-07e6-4fca-b264-e84ffd86efef admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:06.285659 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda11db-07e6-4fca-b264-e84ffd86efef admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:06.286615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda11db-07e6-4fca-b264-e84ffd86efef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:06.288529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda11db-07e6-4fca-b264-e84ffd86efef admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:06.312485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1118/2228] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:18:06 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:18:06.316777 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9beacd-f6a4-4915-af0e-e9985a4ec1be admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:06.328341 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9beacd-f6a4-4915-af0e-e9985a4ec1be admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:06.333266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae40e2-be35-46c4-ab59-0f45f8480500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:06.333969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae40e2-be35-46c4-ab59-0f45f8480500 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:06.334251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae40e2-be35-46c4-ab59-0f45f8480500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:06.334547 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae40e2-be35-46c4-ab59-0f45f8480500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:06.335336 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae40e2-be35-46c4-ab59-0f45f8480500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:06.336979 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae40e2-be35-46c4-ab59-0f45f8480500 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:06.349457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1111/2229] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:18:06.353861 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda11db-07e6-4fca-b264-e84ffd86efef admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:06.365212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda11db-07e6-4fca-b264-e84ffd86efef admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:06.373598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81550039-7264-4413-8637-d26d378b98b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:06.376129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81550039-7264-4413-8637-d26d378b98b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:06.376634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81550039-7264-4413-8637-d26d378b98b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:06.377152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81550039-7264-4413-8637-d26d378b98b5 admin admin] PATH_INFO: `/v3/projects/e4f3a770f241438b9345df304d220d0e/users/02f0813f2394461893e5d23db8d4f8ed/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:06.411697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81550039-7264-4413-8637-d26d378b98b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f3a770f241438b9345df304d220d0e, user_id=02f0813f2394461893e5d23db8d4f8ed, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:06.414273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81550039-7264-4413-8637-d26d378b98b5 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:06.431286 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1119/2230] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:18:06 2022] PUT /identity/v3/projects/e4f3a770f241438b9345df304d220d0e/users/02f0813f2394461893e5d23db8d4f8ed/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:18:06.437084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae40e2-be35-46c4-ab59-0f45f8480500 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:06.452147 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae40e2-be35-46c4-ab59-0f45f8480500 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:06.482273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:18:06.520997 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930aa72f-de9f-4061-bce0-2cfd9fd1d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:06.521811 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aa72f-de9f-4061-bce0-2cfd9fd1d1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:06.522170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aa72f-de9f-4061-bce0-2cfd9fd1d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:06.522503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aa72f-de9f-4061-bce0-2cfd9fd1d1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:06.523565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930aa72f-de9f-4061-bce0-2cfd9fd1d1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:06.525724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930aa72f-de9f-4061-bce0-2cfd9fd1d1e3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:06.546745 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1112/2231] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:18:06.550506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81550039-7264-4413-8637-d26d378b98b5 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:06.564980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81550039-7264-4413-8637-d26d378b98b5 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:06.571855 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007adde-3532-436c-9016-5212280ab693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:06.573530 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007adde-3532-436c-9016-5212280ab693 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:06.573925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007adde-3532-436c-9016-5212280ab693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:06.574205 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007adde-3532-436c-9016-5212280ab693 admin admin] PATH_INFO: `/v3/projects/e4f3a770f241438b9345df304d220d0e/users/02f0813f2394461893e5d23db8d4f8ed/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:06.576550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007adde-3532-436c-9016-5212280ab693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f3a770f241438b9345df304d220d0e, user_id=02f0813f2394461893e5d23db8d4f8ed, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:06.579838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007adde-3532-436c-9016-5212280ab693 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:06.593176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1120/2232] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:18:06 2022] PUT /identity/v3/projects/e4f3a770f241438b9345df304d220d0e/users/02f0813f2394461893e5d23db8d4f8ed/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:18:07.187465 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930aa72f-de9f-4061-bce0-2cfd9fd1d1e3 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:07.190169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-930aa72f-de9f-4061-bce0-2cfd9fd1d1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:07.253065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930aa72f-de9f-4061-bce0-2cfd9fd1d1e3 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:07.418110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fa085-78bd-44db-bb90-58a06f65c02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:07.419165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa085-78bd-44db-bb90-58a06f65c02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:07.419450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa085-78bd-44db-bb90-58a06f65c02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:07.419725 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa085-78bd-44db-bb90-58a06f65c02a admin admin] PATH_INFO: `/v3/users/289a87dcbb224efc95407a2ba38ec4e2` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:07.424989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fa085-78bd-44db-bb90-58a06f65c02a admin admin] RBAC: Authorizing `identity:delete_user(user_id=289a87dcbb224efc95407a2ba38ec4e2)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:07.427421 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fa085-78bd-44db-bb90-58a06f65c02a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:07.559686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-df9fa085-78bd-44db-bb90-58a06f65c02a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289a87dcbb224efc95407a2ba38ec4e2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:18:07.560509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-df9fa085-78bd-44db-bb90-58a06f65c02a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289a87dcbb224efc95407a2ba38ec4e2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:18:07.598937 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-df9fa085-78bd-44db-bb90-58a06f65c02a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289a87dcbb224efc95407a2ba38ec4e2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:18:07.619072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-df9fa085-78bd-44db-bb90-58a06f65c02a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289a87dcbb224efc95407a2ba38ec4e2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:18:07.619757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-df9fa085-78bd-44db-bb90-58a06f65c02a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289a87dcbb224efc95407a2ba38ec4e2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:18:07.639823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1113/2233] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:18:07 2022] DELETE /identity/v3/users/289a87dcbb224efc95407a2ba38ec4e2 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:18:07.644547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9356bb8-ce87-432c-9239-cdfe4062db2e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:07.645127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9356bb8-ce87-432c-9239-cdfe4062db2e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:07.645127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9356bb8-ce87-432c-9239-cdfe4062db2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:07.686959 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a9356bb8-ce87-432c-9239-cdfe4062db2e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:18:07.688429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a9356bb8-ce87-432c-9239-cdfe4062db2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:07.816206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1121/2234] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:18:07.895941 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fa085-78bd-44db-bb90-58a06f65c02a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:07.897974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-df9fa085-78bd-44db-bb90-58a06f65c02a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:08.017746 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:18:08.045003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fa085-78bd-44db-bb90-58a06f65c02a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:08.057256 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdca272-edac-404e-9821-4dacd3ac658b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:08.057958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca272-edac-404e-9821-4dacd3ac658b service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:08.058242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca272-edac-404e-9821-4dacd3ac658b service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:08.058518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca272-edac-404e-9821-4dacd3ac658b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:08.071406 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdca272-edac-404e-9821-4dacd3ac658b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:08.072904 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdca272-edac-404e-9821-4dacd3ac658b service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:08.087412 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1114/2235] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:18:09.183431 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dfd05-489b-45f5-881e-e2f6b9a28737 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:09.184054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dfd05-489b-45f5-881e-e2f6b9a28737 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:09.184511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dfd05-489b-45f5-881e-e2f6b9a28737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:09.269286 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-cc6dfd05-489b-45f5-881e-e2f6b9a28737 None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:18:09.278976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-cc6dfd05-489b-45f5-881e-e2f6b9a28737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:09.460640 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1122/2236] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:18:09.473625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdca272-edac-404e-9821-4dacd3ac658b service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:09.478287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2bdca272-edac-404e-9821-4dacd3ac658b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:09.504146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dfd05-489b-45f5-881e-e2f6b9a28737 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:09.506303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-cc6dfd05-489b-45f5-881e-e2f6b9a28737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:09.543758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dfd05-489b-45f5-881e-e2f6b9a28737 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:09.564013 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:09.565640 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:09.577123 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:09.580366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda admin admin] PATH_INFO: `/v3/projects/23b70b9856a54dc89cf1a8ae9c3b760d` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:09.584542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b70b9856a54dc89cf1a8ae9c3b760d)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:09.588528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:09.614852 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:18:09.753628 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdca272-edac-404e-9821-4dacd3ac658b service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:09.759937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b70b9856a54dc89cf1a8ae9c3b760d', 'request_id': 'req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:18:09.785116 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b70b9856a54dc89cf1a8ae9c3b760d', 'request_id': 'req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:18:09.794548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b70b9856a54dc89cf1a8ae9c3b760d', 'request_id': 'req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:18:09.825532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda admin admin] The token cache is being invalidate because project 23b70b9856a54dc89cf1a8ae9c3b760d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:18:09.830096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:18:09.831677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3b4906b1-2c72-43dd-ae26-f79b4ec72dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:18:09.835061 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1123/2237] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:18:09 2022] DELETE /identity/v3/projects/23b70b9856a54dc89cf1a8ae9c3b760d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:18:09.949218 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed7dc7-8a57-4b23-a6f7-574dd63f5332 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:09.950775 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed7dc7-8a57-4b23-a6f7-574dd63f5332 service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:09.951643 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed7dc7-8a57-4b23-a6f7-574dd63f5332 service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:09.952228 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed7dc7-8a57-4b23-a6f7-574dd63f5332 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:09.968406 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-50ed7dc7-8a57-4b23-a6f7-574dd63f5332 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:09.975069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2809a8-2d68-4daa-aed3-31eaa0beae49 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:09.975771 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2809a8-2d68-4daa-aed3-31eaa0beae49 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:09.976180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2809a8-2d68-4daa-aed3-31eaa0beae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:10.019762 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5f2809a8-2d68-4daa-aed3-31eaa0beae49 None None] MFA Rules not processed for user `e255fb99a08c41289688042238d152ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:18:10.021997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5f2809a8-2d68-4daa-aed3-31eaa0beae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:10.095554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed7dc7-8a57-4b23-a6f7-574dd63f5332 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:10.097201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed7dc7-8a57-4b23-a6f7-574dd63f5332 service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:10.113429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1115/2238] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:18:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:18:10.202437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1124/2239] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:18:15.380897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6ff64-faa8-4ccc-86f7-b7cccda38f36 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:15.381502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6ff64-faa8-4ccc-86f7-b7cccda38f36 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:15.381502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6ff64-faa8-4ccc-86f7-b7cccda38f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:15.514612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-96a6ff64-faa8-4ccc-86f7-b7cccda38f36 None None] MFA Rules not processed for user `02f0813f2394461893e5d23db8d4f8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:18:15.515914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-96a6ff64-faa8-4ccc-86f7-b7cccda38f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:15.592828 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:18:15.726941 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1116/2240] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:18:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:18:15.750793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2809a8-2d68-4daa-aed3-31eaa0beae49 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:15.755339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5f2809a8-2d68-4daa-aed3-31eaa0beae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:15.914317 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2809a8-2d68-4daa-aed3-31eaa0beae49 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:15.925672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730a9f2-3e88-48c8-85e6-927d50ccd22e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:15.927076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730a9f2-3e88-48c8-85e6-927d50ccd22e service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:15.927689 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730a9f2-3e88-48c8-85e6-927d50ccd22e service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:15.928311 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730a9f2-3e88-48c8-85e6-927d50ccd22e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:15.930598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1730a9f2-3e88-48c8-85e6-927d50ccd22e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:15.984156 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:18:16.030799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730a9f2-3e88-48c8-85e6-927d50ccd22e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:16.032540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730a9f2-3e88-48c8-85e6-927d50ccd22e service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:16.055511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1125/2241] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:18:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:18:18.463552 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa8508-4bb2-41ff-86c8-0ee7d51ad83d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:18.468771 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa8508-4bb2-41ff-86c8-0ee7d51ad83d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:18.469055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa8508-4bb2-41ff-86c8-0ee7d51ad83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:18.499295 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d0aa8508-4bb2-41ff-86c8-0ee7d51ad83d None None] MFA Rules not processed for user `9a3b95b117914230819b17ecda8ffa7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:18:18.501014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d0aa8508-4bb2-41ff-86c8-0ee7d51ad83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:18.523547 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1117/2242] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:18:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:18:26.047469 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=11 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:18:28.490796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=24 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:18:32.778781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7faec-e780-4229-b6c1-39a0953fc135 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:32.779430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7faec-e780-4229-b6c1-39a0953fc135 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:32.779622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7faec-e780-4229-b6c1-39a0953fc135 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:32.781152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1126/2243] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jul 21 12:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:18:32.788526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a376b8-355b-4206-a921-5d81ad797a9c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:32.788526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a376b8-355b-4206-a921-5d81ad797a9c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:32.788526 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a376b8-355b-4206-a921-5d81ad797a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:32.809383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-69a376b8-355b-4206-a921-5d81ad797a9c None None] MFA Rules not processed for user `f3fb1d091b27472081549f4166ca172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:18:32.810553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-69a376b8-355b-4206-a921-5d81ad797a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:32.821573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1118/2244] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jul 21 12:18:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:18:32.833733 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7faec-e780-4229-b6c1-39a0953fc135 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:32.835633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1ab7faec-e780-4229-b6c1-39a0953fc135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:32.916169 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7faec-e780-4229-b6c1-39a0953fc135 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:32.920244 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30d338-5306-48a8-9f40-b32c709c874e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10611bf25b9e4604ad769a6902f7f457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:32.920932 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30d338-5306-48a8-9f40-b32c709c874e service glance] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:32.921217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30d338-5306-48a8-9f40-b32c709c874e service glance] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:32.921495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30d338-5306-48a8-9f40-b32c709c874e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:32.939933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30d338-5306-48a8-9f40-b32c709c874e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:32.941546 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30d338-5306-48a8-9f40-b32c709c874e service glance] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:32.953825 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1127/2245] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:18:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:18:33.033473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cb583-32ec-4441-a2ef-6cb49974f4c6 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:33.033778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cb583-32ec-4441-a2ef-6cb49974f4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:33.034056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cb583-32ec-4441-a2ef-6cb49974f4c6 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:33.035477 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1119/2246] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jul 21 12:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:18:33.040927 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9da16-7f7a-4f35-b7b8-e68f382bbad1 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:33.041427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9da16-7f7a-4f35-b7b8-e68f382bbad1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:33.041769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9da16-7f7a-4f35-b7b8-e68f382bbad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:33.063816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d3d9da16-7f7a-4f35-b7b8-e68f382bbad1 None None] MFA Rules not processed for user `88cfd88c19fd4c979e921e3d8cd9cc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:18:33.065091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d3d9da16-7f7a-4f35-b7b8-e68f382bbad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:33.125042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1128/2247] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jul 21 12:18:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:18:33.139838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cb583-32ec-4441-a2ef-6cb49974f4c6 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:33.142630 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-476cb583-32ec-4441-a2ef-6cb49974f4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:33.158616 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cb583-32ec-4441-a2ef-6cb49974f4c6 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:33.163826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73c0d6-7918-4fa4-9e9f-44fc56474c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:33.164561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73c0d6-7918-4fa4-9e9f-44fc56474c1e service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:33.164891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73c0d6-7918-4fa4-9e9f-44fc56474c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:33.165218 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73c0d6-7918-4fa4-9e9f-44fc56474c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:33.173508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73c0d6-7918-4fa4-9e9f-44fc56474c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:33.174987 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73c0d6-7918-4fa4-9e9f-44fc56474c1e service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:33.183571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1120/2248] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:18:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:18:33.270452 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622547b-c80a-4db8-a618-49aa11db4278 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:33.270825 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622547b-c80a-4db8-a618-49aa11db4278 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:33.272187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622547b-c80a-4db8-a618-49aa11db4278 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:33.274277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1129/2249] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jul 21 12:18:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 12:18:33.280570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073d3ff-ae2a-4180-a023-b091b748d526 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:33.281325 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073d3ff-ae2a-4180-a023-b091b748d526 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:33.281811 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073d3ff-ae2a-4180-a023-b091b748d526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:33.305503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-6073d3ff-ae2a-4180-a023-b091b748d526 None None] MFA Rules not processed for user `f3fb1d091b27472081549f4166ca172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:18:33.307821 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6073d3ff-ae2a-4180-a023-b091b748d526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:33.320262 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1121/2250] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jul 21 12:18:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:18:33.332510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622547b-c80a-4db8-a618-49aa11db4278 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:33.352241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622547b-c80a-4db8-a618-49aa11db4278 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:33.357715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f13111-b804-49b2-aa49-75f14274616b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:33.358751 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13111-b804-49b2-aa49-75f14274616b service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:33.359136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13111-b804-49b2-aa49-75f14274616b service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:33.359310 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13111-b804-49b2-aa49-75f14274616b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:33.372577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f13111-b804-49b2-aa49-75f14274616b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:33.374035 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f13111-b804-49b2-aa49-75f14274616b service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:33.387433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1130/2251] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:18:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:18:37.621466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6e2d3-eb8c-467a-b28b-f1f3f1166f87 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:37.621991 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6e2d3-eb8c-467a-b28b-f1f3f1166f87 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:37.621991 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6e2d3-eb8c-467a-b28b-f1f3f1166f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:37.644035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e8e6e2d3-eb8c-467a-b28b-f1f3f1166f87 None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:18:37.648110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e8e6e2d3-eb8c-467a-b28b-f1f3f1166f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:37.659089 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1122/2252] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:18:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:18:37.679878 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f13111-b804-49b2-aa49-75f14274616b service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:37.679878 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d2f13111-b804-49b2-aa49-75f14274616b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:37.693164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f13111-b804-49b2-aa49-75f14274616b service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:37.699302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26a0ca-41e3-47c1-ac89-df90fb6fcc41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:37.699971 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26a0ca-41e3-47c1-ac89-df90fb6fcc41 service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:37.700266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26a0ca-41e3-47c1-ac89-df90fb6fcc41 service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:37.700529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26a0ca-41e3-47c1-ac89-df90fb6fcc41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:37.709985 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26a0ca-41e3-47c1-ac89-df90fb6fcc41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:37.711482 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26a0ca-41e3-47c1-ac89-df90fb6fcc41 service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:37.721120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1131/2253] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:18:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:18:47.636992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=15 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:18:47.717204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=61 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:18:54.108721 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6e2d3-eb8c-467a-b28b-f1f3f1166f87 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:54.110862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e8e6e2d3-eb8c-467a-b28b-f1f3f1166f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:54.212799 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6e2d3-eb8c-467a-b28b-f1f3f1166f87 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:54.220820 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac1631-a808-42e4-9934-66a1b6ec59dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06c172bcd99f469f83728c98d061a7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:54.222361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac1631-a808-42e4-9934-66a1b6ec59dd service placement] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:54.223070 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac1631-a808-42e4-9934-66a1b6ec59dd service placement] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:54.223707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac1631-a808-42e4-9934-66a1b6ec59dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:54.227910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5cac1631-a808-42e4-9934-66a1b6ec59dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:54.245220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac1631-a808-42e4-9934-66a1b6ec59dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:54.247301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac1631-a808-42e4-9934-66a1b6ec59dd service placement] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:54.260164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1123/2254] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:18:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:18:57.200843 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffbd79-bac7-4bae-89e5-cfd88ba0c0c3 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:57.201710 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffbd79-bac7-4bae-89e5-cfd88ba0c0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:57.201798 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffbd79-bac7-4bae-89e5-cfd88ba0c0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:57.228544 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-72ffbd79-bac7-4bae-89e5-cfd88ba0c0c3 None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:18:57.229867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-72ffbd79-bac7-4bae-89e5-cfd88ba0c0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:18:57.238892 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1132/2255] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jul 21 12:18:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:18:57.266213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac1631-a808-42e4-9934-66a1b6ec59dd service placement] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:18:57.285689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac1631-a808-42e4-9934-66a1b6ec59dd service placement] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:18:57.292687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b2028-f5b1-46c2-b680-067f27000e33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:18:57.293902 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b2028-f5b1-46c2-b680-067f27000e33 service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:18:57.294428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b2028-f5b1-46c2-b680-067f27000e33 service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:18:57.296337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b2028-f5b1-46c2-b680-067f27000e33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:18:57.307130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b2028-f5b1-46c2-b680-067f27000e33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:18:57.308899 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b2028-f5b1-46c2-b680-067f27000e33 service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:18:57.320392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1124/2256] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:18:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:19:01.991720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffbd79-bac7-4bae-89e5-cfd88ba0c0c3 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:19:01.993474 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-72ffbd79-bac7-4bae-89e5-cfd88ba0c0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:19:02.006097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffbd79-bac7-4bae-89e5-cfd88ba0c0c3 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:19:02.010478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2dbda-51c3-4c24-81f8-14154d67a90e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:19:02.011192 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2dbda-51c3-4c24-81f8-14154d67a90e service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:19:02.011493 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2dbda-51c3-4c24-81f8-14154d67a90e service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:19:02.011761 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2dbda-51c3-4c24-81f8-14154d67a90e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:19:02.022111 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2dbda-51c3-4c24-81f8-14154d67a90e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:19:02.023705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2dbda-51c3-4c24-81f8-14154d67a90e service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:19:02.034706 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1133/2257] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:19:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:19:05.771619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a8e58-d9a6-4698-9408-4d4700b3deaa None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:19:05.772179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a8e58-d9a6-4698-9408-4d4700b3deaa None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:19:05.772297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a8e58-d9a6-4698-9408-4d4700b3deaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:19:05.792517 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-508a8e58-d9a6-4698-9408-4d4700b3deaa None None] MFA Rules not processed for user `491d61d97e114e5988bab922a0f366bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:19:05.793952 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-508a8e58-d9a6-4698-9408-4d4700b3deaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:19:05.850607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1125/2258] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:19:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:19:12.029256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=9 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:19:15.843294 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=63 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:19:41.920314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df52d-226f-4bdf-b708-c2f31554f2ff None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:19:41.920899 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df52d-226f-4bdf-b708-c2f31554f2ff None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:19:41.920899 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df52d-226f-4bdf-b708-c2f31554f2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:19:41.947265 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-227df52d-226f-4bdf-b708-c2f31554f2ff None None] MFA Rules not processed for user `e255fb99a08c41289688042238d152ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:19:41.948674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-227df52d-226f-4bdf-b708-c2f31554f2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:19:41.956827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1134/2259] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:19:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:19:51.939082 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:19:52.107312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac06914-9461-433c-9a6c-f7b94d2cd6c5 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:19:52.108148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac06914-9461-433c-9a6c-f7b94d2cd6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:19:52.108317 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac06914-9461-433c-9a6c-f7b94d2cd6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:19:52.127246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-bac06914-9461-433c-9a6c-f7b94d2cd6c5 None None] MFA Rules not processed for user `d9a96b51c98344a09cc59af05dd455ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:19:52.128575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bac06914-9461-433c-9a6c-f7b94d2cd6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:19:52.195362 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1126/2260] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:19:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:02.188419 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=25 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:09.633956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960805c-2476-4bb1-b1d8-d57896acf5ec None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:09.634461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960805c-2476-4bb1-b1d8-d57896acf5ec None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:09.634564 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960805c-2476-4bb1-b1d8-d57896acf5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:09.652422 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1960805c-2476-4bb1-b1d8-d57896acf5ec None None] MFA Rules not processed for user `2b092b666ad84405a6ed07827fcd8a87`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:09.653609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1960805c-2476-4bb1-b1d8-d57896acf5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:09.710977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1135/2261] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:15.606760 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa24ce-f9bf-49b1-b93f-2a0af81d64ca None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:15.607391 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa24ce-f9bf-49b1-b93f-2a0af81d64ca None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:15.607391 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa24ce-f9bf-49b1-b93f-2a0af81d64ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:15.627224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a2aa24ce-f9bf-49b1-b93f-2a0af81d64ca None None] MFA Rules not processed for user `491d61d97e114e5988bab922a0f366bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:15.628460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a2aa24ce-f9bf-49b1-b93f-2a0af81d64ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:15.636698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1127/2262] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:19.703433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=25 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:25.621273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:36.083738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960805c-2476-4bb1-b1d8-d57896acf5ec None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:36.094273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960805c-2476-4bb1-b1d8-d57896acf5ec None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:36.098012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875420ef-2c2e-42e9-a10b-3bcafbecd49b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:36.098730 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875420ef-2c2e-42e9-a10b-3bcafbecd49b service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:36.099005 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875420ef-2c2e-42e9-a10b-3bcafbecd49b service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:36.099277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875420ef-2c2e-42e9-a10b-3bcafbecd49b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:36.101151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-875420ef-2c2e-42e9-a10b-3bcafbecd49b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:36.116059 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875420ef-2c2e-42e9-a10b-3bcafbecd49b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:36.117743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875420ef-2c2e-42e9-a10b-3bcafbecd49b service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:36.130121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1136/2263] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:20:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:20:37.410220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa24ce-f9bf-49b1-b93f-2a0af81d64ca None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:37.422924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa24ce-f9bf-49b1-b93f-2a0af81d64ca None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:37.427369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee90ce-b49b-45b9-b309-a1e3d4f6366d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:37.428088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee90ce-b49b-45b9-b309-a1e3d4f6366d service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:37.428505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee90ce-b49b-45b9-b309-a1e3d4f6366d service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:37.428778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee90ce-b49b-45b9-b309-a1e3d4f6366d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:37.430693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-38ee90ce-b49b-45b9-b309-a1e3d4f6366d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:37.445890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee90ce-b49b-45b9-b309-a1e3d4f6366d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:37.448335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee90ce-b49b-45b9-b309-a1e3d4f6366d service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:37.460580 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1128/2264] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:20:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:20:42.257925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875420ef-2c2e-42e9-a10b-3bcafbecd49b service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:42.268566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875420ef-2c2e-42e9-a10b-3bcafbecd49b service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:42.274210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8cd10-6488-4bf9-88cf-7a88fcf819ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:42.275251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8cd10-6488-4bf9-88cf-7a88fcf819ee service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:42.275674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8cd10-6488-4bf9-88cf-7a88fcf819ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:42.276125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8cd10-6488-4bf9-88cf-7a88fcf819ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:42.278769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5dd8cd10-6488-4bf9-88cf-7a88fcf819ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:42.345465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8cd10-6488-4bf9-88cf-7a88fcf819ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:42.346948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8cd10-6488-4bf9-88cf-7a88fcf819ee service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:42.358041 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1137/2265] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:20:46.070594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee90ce-b49b-45b9-b309-a1e3d4f6366d service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:46.072274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-38ee90ce-b49b-45b9-b309-a1e3d4f6366d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:46.091200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee90ce-b49b-45b9-b309-a1e3d4f6366d service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:46.096530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad7ba4-0aa4-4269-80f6-b0ecb161495d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:46.097466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad7ba4-0aa4-4269-80f6-b0ecb161495d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:46.097751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad7ba4-0aa4-4269-80f6-b0ecb161495d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:46.098025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad7ba4-0aa4-4269-80f6-b0ecb161495d admin admin] PATH_INFO: `/v3/users/e255fb99a08c41289688042238d152ac` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:46.099295 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad7ba4-0aa4-4269-80f6-b0ecb161495d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e255fb99a08c41289688042238d152ac)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:46.101235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad7ba4-0aa4-4269-80f6-b0ecb161495d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:46.156354 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9dad7ba4-0aa4-4269-80f6-b0ecb161495d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e255fb99a08c41289688042238d152ac'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:46.157109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9dad7ba4-0aa4-4269-80f6-b0ecb161495d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e255fb99a08c41289688042238d152ac'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:46.170732 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9dad7ba4-0aa4-4269-80f6-b0ecb161495d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e255fb99a08c41289688042238d152ac'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:46.178010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9dad7ba4-0aa4-4269-80f6-b0ecb161495d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e255fb99a08c41289688042238d152ac'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:46.178810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9dad7ba4-0aa4-4269-80f6-b0ecb161495d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e255fb99a08c41289688042238d152ac'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:46.193541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1129/2266] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:20:46 2022] DELETE /identity/v3/users/e255fb99a08c41289688042238d152ac => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:46.381410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8cd10-6488-4bf9-88cf-7a88fcf819ee service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:46.395741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8cd10-6488-4bf9-88cf-7a88fcf819ee service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:46.466577 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095d21f-1368-4626-85fd-8c147f89fa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:46.467536 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095d21f-1368-4626-85fd-8c147f89fa96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:46.467956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095d21f-1368-4626-85fd-8c147f89fa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:46.468243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095d21f-1368-4626-85fd-8c147f89fa96 admin admin] PATH_INFO: `/v3/projects/a9394be48a1641aea48adb937993faaa` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:46.469528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095d21f-1368-4626-85fd-8c147f89fa96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9394be48a1641aea48adb937993faaa)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:46.471497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095d21f-1368-4626-85fd-8c147f89fa96 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:46.521596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a095d21f-1368-4626-85fd-8c147f89fa96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9394be48a1641aea48adb937993faaa', 'request_id': 'req-a095d21f-1368-4626-85fd-8c147f89fa96'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:46.530405 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a095d21f-1368-4626-85fd-8c147f89fa96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9394be48a1641aea48adb937993faaa', 'request_id': 'req-a095d21f-1368-4626-85fd-8c147f89fa96'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:46.537154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a095d21f-1368-4626-85fd-8c147f89fa96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9394be48a1641aea48adb937993faaa', 'request_id': 'req-a095d21f-1368-4626-85fd-8c147f89fa96'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:46.549472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a095d21f-1368-4626-85fd-8c147f89fa96 admin admin] The token cache is being invalidate because project a9394be48a1641aea48adb937993faaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:20:46.549772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a095d21f-1368-4626-85fd-8c147f89fa96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:46.550477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a095d21f-1368-4626-85fd-8c147f89fa96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:46.552343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1138/2267] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:20:46 2022] DELETE /identity/v3/projects/a9394be48a1641aea48adb937993faaa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:20:46.557367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1080b3-5d66-4b0d-a96f-9aad57bd39b4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:46.557731 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1080b3-5d66-4b0d-a96f-9aad57bd39b4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:46.557903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1080b3-5d66-4b0d-a96f-9aad57bd39b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:46.578000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8f1080b3-5d66-4b0d-a96f-9aad57bd39b4 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:46.579247 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8f1080b3-5d66-4b0d-a96f-9aad57bd39b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:46.646221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1130/2268] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:46.664114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439598ed-b24f-4c07-884d-842d7ee581b7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:46.664744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439598ed-b24f-4c07-884d-842d7ee581b7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:46.665469 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439598ed-b24f-4c07-884d-842d7ee581b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:46.698096 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-439598ed-b24f-4c07-884d-842d7ee581b7 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:46.700341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-439598ed-b24f-4c07-884d-842d7ee581b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:46.714631 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1139/2269] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:46.721175 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1080b3-5d66-4b0d-a96f-9aad57bd39b4 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:46.731966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1080b3-5d66-4b0d-a96f-9aad57bd39b4 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:46.738107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252be1a4-da9e-4253-b323-b7dd7527acc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:46.739317 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252be1a4-da9e-4253-b323-b7dd7527acc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:46.739859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252be1a4-da9e-4253-b323-b7dd7527acc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:46.740244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252be1a4-da9e-4253-b323-b7dd7527acc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:46.741536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252be1a4-da9e-4253-b323-b7dd7527acc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:20:46.741882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252be1a4-da9e-4253-b323-b7dd7527acc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:46.744493 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252be1a4-da9e-4253-b323-b7dd7527acc1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:46.758181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1131/2270] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:20:46.763666 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439598ed-b24f-4c07-884d-842d7ee581b7 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:46.769952 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:46.773813 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439598ed-b24f-4c07-884d-842d7ee581b7 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:46.780879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb65a54-fb0f-4bb1-a552-a83f4f675131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:46.782368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb65a54-fb0f-4bb1-a552-a83f4f675131 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:46.783198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb65a54-fb0f-4bb1-a552-a83f4f675131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:46.783513 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb65a54-fb0f-4bb1-a552-a83f4f675131 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:46.784292 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb65a54-fb0f-4bb1-a552-a83f4f675131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:46.794689 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb65a54-fb0f-4bb1-a552-a83f4f675131 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:46.824592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1140/2271] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:20:46 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:20:46.829083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252be1a4-da9e-4253-b323-b7dd7527acc1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:46.839557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252be1a4-da9e-4253-b323-b7dd7527acc1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:46.894828 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:46.913870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb6085-120b-45d2-8100-fa82d656ca5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:46.914602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6085-120b-45d2-8100-fa82d656ca5e admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:46.914951 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6085-120b-45d2-8100-fa82d656ca5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:46.915230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6085-120b-45d2-8100-fa82d656ca5e admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:46.915972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb6085-120b-45d2-8100-fa82d656ca5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:46.917943 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb6085-120b-45d2-8100-fa82d656ca5e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:46.942082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1132/2272] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:20:46 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:20:46.946815 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb65a54-fb0f-4bb1-a552-a83f4f675131 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:46.960598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb65a54-fb0f-4bb1-a552-a83f4f675131 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:46.966699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4418c7-6315-4340-81fb-37e552b2ad00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:46.967337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4418c7-6315-4340-81fb-37e552b2ad00 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:46.967622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4418c7-6315-4340-81fb-37e552b2ad00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:46.967885 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4418c7-6315-4340-81fb-37e552b2ad00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:46.968656 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4418c7-6315-4340-81fb-37e552b2ad00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:46.970324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4418c7-6315-4340-81fb-37e552b2ad00 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:46.989721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1141/2273] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:20:46.994117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb6085-120b-45d2-8100-fa82d656ca5e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:47.005923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb6085-120b-45d2-8100-fa82d656ca5e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:47.011378 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12a9b4-7d0b-415e-8e31-353c4dbe3024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:47.012072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12a9b4-7d0b-415e-8e31-353c4dbe3024 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:47.012362 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12a9b4-7d0b-415e-8e31-353c4dbe3024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:47.012639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12a9b4-7d0b-415e-8e31-353c4dbe3024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:47.013393 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12a9b4-7d0b-415e-8e31-353c4dbe3024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:47.015134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12a9b4-7d0b-415e-8e31-353c4dbe3024 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:47.031206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1133/2274] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:20:47.036608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4418c7-6315-4340-81fb-37e552b2ad00 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:47.055845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4418c7-6315-4340-81fb-37e552b2ad00 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:47.062390 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65d32c-a53d-4c86-9c4b-c51e23231764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:47.063819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65d32c-a53d-4c86-9c4b-c51e23231764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:47.064201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65d32c-a53d-4c86-9c4b-c51e23231764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:47.064671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65d32c-a53d-4c86-9c4b-c51e23231764 admin admin] PATH_INFO: `/v3/projects/e6d8fccaaaa64141b4e8e0da9046d43d/users/332aadcb6a43410ebaf3f9e47be8c17e/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:47.091870 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65d32c-a53d-4c86-9c4b-c51e23231764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d8fccaaaa64141b4e8e0da9046d43d, user_id=332aadcb6a43410ebaf3f9e47be8c17e, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:47.096839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65d32c-a53d-4c86-9c4b-c51e23231764 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:47.119781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1142/2275] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:20:47 2022] PUT /identity/v3/projects/e6d8fccaaaa64141b4e8e0da9046d43d/users/332aadcb6a43410ebaf3f9e47be8c17e/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:47.131884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cc3dd-e009-40f8-9c10-3956e296bd43 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:47.132761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cc3dd-e009-40f8-9c10-3956e296bd43 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:47.132761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cc3dd-e009-40f8-9c10-3956e296bd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:47.164866 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-317cc3dd-e009-40f8-9c10-3956e296bd43 None None] MFA Rules not processed for user `332aadcb6a43410ebaf3f9e47be8c17e`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:47.166120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-317cc3dd-e009-40f8-9c10-3956e296bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:47.242304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1134/2276] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:47.253817 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65d32c-a53d-4c86-9c4b-c51e23231764 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:47.255830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3e65d32c-a53d-4c86-9c4b-c51e23231764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:47.347090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65d32c-a53d-4c86-9c4b-c51e23231764 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:47.353261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c55b47-46f0-4efb-a8e1-44aa41428696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:47.353934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c55b47-46f0-4efb-a8e1-44aa41428696 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:47.354217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c55b47-46f0-4efb-a8e1-44aa41428696 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:47.354497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c55b47-46f0-4efb-a8e1-44aa41428696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:47.363962 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c55b47-46f0-4efb-a8e1-44aa41428696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:47.366278 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c55b47-46f0-4efb-a8e1-44aa41428696 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:47.377269 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1143/2277] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:20:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:20:50.115907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cc3dd-e009-40f8-9c10-3956e296bd43 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:50.185857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cc3dd-e009-40f8-9c10-3956e296bd43 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:50.190648 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e38a2-b741-4d9d-980a-5a54f5384294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:50.191570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e38a2-b741-4d9d-980a-5a54f5384294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:50.191857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e38a2-b741-4d9d-980a-5a54f5384294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:50.192132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e38a2-b741-4d9d-980a-5a54f5384294 admin admin] PATH_INFO: `/v3/users/332aadcb6a43410ebaf3f9e47be8c17e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:50.193337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e38a2-b741-4d9d-980a-5a54f5384294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=332aadcb6a43410ebaf3f9e47be8c17e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:50.195321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e38a2-b741-4d9d-980a-5a54f5384294 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:50.246024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ff5e38a2-b741-4d9d-980a-5a54f5384294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332aadcb6a43410ebaf3f9e47be8c17e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:50.246682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ff5e38a2-b741-4d9d-980a-5a54f5384294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332aadcb6a43410ebaf3f9e47be8c17e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:50.254377 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:50.261503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ff5e38a2-b741-4d9d-980a-5a54f5384294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332aadcb6a43410ebaf3f9e47be8c17e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:50.270116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ff5e38a2-b741-4d9d-980a-5a54f5384294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332aadcb6a43410ebaf3f9e47be8c17e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:50.270954 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ff5e38a2-b741-4d9d-980a-5a54f5384294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332aadcb6a43410ebaf3f9e47be8c17e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:50.285445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1135/2278] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:20:50 2022] DELETE /identity/v3/users/332aadcb6a43410ebaf3f9e47be8c17e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:50.290084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5f78f-e493-4d26-9888-743312249506 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:50.290583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5f78f-e493-4d26-9888-743312249506 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:50.290732 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5f78f-e493-4d26-9888-743312249506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:50.309080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-72b5f78f-e493-4d26-9888-743312249506 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:50.310328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-72b5f78f-e493-4d26-9888-743312249506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:50.374008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1144/2279] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:50.384056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e38a2-b741-4d9d-980a-5a54f5384294 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:50.385569 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ff5e38a2-b741-4d9d-980a-5a54f5384294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:50.446207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e38a2-b741-4d9d-980a-5a54f5384294 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:50.449989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf2a4d-6ae3-41ea-aa5e-1462b6f57807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:50.450727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf2a4d-6ae3-41ea-aa5e-1462b6f57807 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:50.451018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf2a4d-6ae3-41ea-aa5e-1462b6f57807 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:50.451299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf2a4d-6ae3-41ea-aa5e-1462b6f57807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:50.461232 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf2a4d-6ae3-41ea-aa5e-1462b6f57807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:50.462732 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf2a4d-6ae3-41ea-aa5e-1462b6f57807 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:50.473983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1136/2280] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:20:50.785714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5f78f-e493-4d26-9888-743312249506 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:50.787289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-72b5f78f-e493-4d26-9888-743312249506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:50.802816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5f78f-e493-4d26-9888-743312249506 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:50.811590 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:50.813062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:50.813735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:50.814216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d admin admin] PATH_INFO: `/v3/projects/e6d8fccaaaa64141b4e8e0da9046d43d` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:50.816323 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d8fccaaaa64141b4e8e0da9046d43d)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:50.820330 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:50.862276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:50.882833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d8fccaaaa64141b4e8e0da9046d43d', 'request_id': 'req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:50.891518 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d8fccaaaa64141b4e8e0da9046d43d', 'request_id': 'req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:50.898520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d8fccaaaa64141b4e8e0da9046d43d', 'request_id': 'req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:50.910550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d admin admin] The token cache is being invalidate because project e6d8fccaaaa64141b4e8e0da9046d43d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:20:50.910847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:50.911537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7c4e4fe6-f420-4d2f-a4fa-5970e92e974d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:50.913140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1145/2281] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:20:50 2022] DELETE /identity/v3/projects/e6d8fccaaaa64141b4e8e0da9046d43d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:50.918356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64887d1-b2f3-41fa-b214-6b7add99e9af None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:50.918680 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64887d1-b2f3-41fa-b214-6b7add99e9af None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:50.918943 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64887d1-b2f3-41fa-b214-6b7add99e9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:50.939118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a64887d1-b2f3-41fa-b214-6b7add99e9af None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:50.940342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a64887d1-b2f3-41fa-b214-6b7add99e9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:51.007090 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1137/2282] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:51.015573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfeac9-c3d7-4397-b193-c18bdc579940 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:51.015851 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfeac9-c3d7-4397-b193-c18bdc579940 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:51.016127 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfeac9-c3d7-4397-b193-c18bdc579940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:51.036545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5bbfeac9-c3d7-4397-b193-c18bdc579940 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:51.037807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5bbfeac9-c3d7-4397-b193-c18bdc579940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:51.046749 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1146/2283] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:51.051106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64887d1-b2f3-41fa-b214-6b7add99e9af None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:51.060873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64887d1-b2f3-41fa-b214-6b7add99e9af None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:51.065486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63780a83-f021-4b0c-91f2-907af9631e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:51.066143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63780a83-f021-4b0c-91f2-907af9631e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:51.066431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63780a83-f021-4b0c-91f2-907af9631e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:51.066729 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63780a83-f021-4b0c-91f2-907af9631e29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:51.067482 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63780a83-f021-4b0c-91f2-907af9631e29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:20:51.067783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63780a83-f021-4b0c-91f2-907af9631e29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:51.069418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63780a83-f021-4b0c-91f2-907af9631e29 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:51.081992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1138/2284] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:20:51.087197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfeac9-c3d7-4397-b193-c18bdc579940 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:51.097152 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfeac9-c3d7-4397-b193-c18bdc579940 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:51.102629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888998bb-2fd5-4a5e-b1cf-1f47d509160f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:51.103327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888998bb-2fd5-4a5e-b1cf-1f47d509160f admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:51.103608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888998bb-2fd5-4a5e-b1cf-1f47d509160f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:51.103878 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888998bb-2fd5-4a5e-b1cf-1f47d509160f admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:51.104620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888998bb-2fd5-4a5e-b1cf-1f47d509160f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:51.106525 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888998bb-2fd5-4a5e-b1cf-1f47d509160f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:51.137076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1147/2285] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:20:51 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:20:51.142084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63780a83-f021-4b0c-91f2-907af9631e29 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:51.154361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63780a83-f021-4b0c-91f2-907af9631e29 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:51.242105 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fb733-94a8-454e-81e0-b7e78131bb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:51.242831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fb733-94a8-454e-81e0-b7e78131bb1e admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:51.243115 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fb733-94a8-454e-81e0-b7e78131bb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:51.243387 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fb733-94a8-454e-81e0-b7e78131bb1e admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:51.244107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fb733-94a8-454e-81e0-b7e78131bb1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:51.247250 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fb733-94a8-454e-81e0-b7e78131bb1e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:51.257251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:51.274852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1139/2286] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:20:51 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:20:51.276558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888998bb-2fd5-4a5e-b1cf-1f47d509160f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:51.288029 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888998bb-2fd5-4a5e-b1cf-1f47d509160f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:51.293327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f207b-ac54-4794-96e0-1a8fffbfd697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:51.294107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f207b-ac54-4794-96e0-1a8fffbfd697 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:51.294312 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f207b-ac54-4794-96e0-1a8fffbfd697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:51.294533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f207b-ac54-4794-96e0-1a8fffbfd697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:51.295317 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f207b-ac54-4794-96e0-1a8fffbfd697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:51.297287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f207b-ac54-4794-96e0-1a8fffbfd697 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:51.309081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1148/2287] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:20:51.313452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fb733-94a8-454e-81e0-b7e78131bb1e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:51.324198 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fb733-94a8-454e-81e0-b7e78131bb1e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:51.329124 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a6b44-9dd5-40a7-a633-78d98eee69ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:51.329869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a6b44-9dd5-40a7-a633-78d98eee69ee admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:51.330195 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a6b44-9dd5-40a7-a633-78d98eee69ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:51.330513 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a6b44-9dd5-40a7-a633-78d98eee69ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:51.331351 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a6b44-9dd5-40a7-a633-78d98eee69ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:51.333097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a6b44-9dd5-40a7-a633-78d98eee69ee admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:51.345843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1140/2288] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:20:51.350165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f207b-ac54-4794-96e0-1a8fffbfd697 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:51.360753 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f207b-ac54-4794-96e0-1a8fffbfd697 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:51.365358 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37a10c-d35a-4807-8a3b-3f42badfabd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:51.366256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a10c-d35a-4807-8a3b-3f42badfabd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:51.366535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a10c-d35a-4807-8a3b-3f42badfabd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:51.366842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a10c-d35a-4807-8a3b-3f42badfabd2 admin admin] PATH_INFO: `/v3/projects/81d0745163314e7d96fd2905ba05f15e/users/0d354a8aadcf4ca3bd4b178cb6209ba3/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:51.382384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37a10c-d35a-4807-8a3b-3f42badfabd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d0745163314e7d96fd2905ba05f15e, user_id=0d354a8aadcf4ca3bd4b178cb6209ba3, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:51.385071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37a10c-d35a-4807-8a3b-3f42badfabd2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:51.400721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1149/2289] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:20:51 2022] PUT /identity/v3/projects/81d0745163314e7d96fd2905ba05f15e/users/0d354a8aadcf4ca3bd4b178cb6209ba3/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:51.411055 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a456b-b997-45c0-b8a5-e5e93da541cf None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:51.411372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a456b-b997-45c0-b8a5-e5e93da541cf None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:51.411650 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a456b-b997-45c0-b8a5-e5e93da541cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:51.439847 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fc1a456b-b997-45c0-b8a5-e5e93da541cf None None] MFA Rules not processed for user `0d354a8aadcf4ca3bd4b178cb6209ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:51.441114 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fc1a456b-b997-45c0-b8a5-e5e93da541cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:51.514140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1141/2290] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:51.519596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37a10c-d35a-4807-8a3b-3f42badfabd2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:51.590241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37a10c-d35a-4807-8a3b-3f42badfabd2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:51.596219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7d505-30a0-4eec-b854-4481c3221c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:51.596943 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7d505-30a0-4eec-b854-4481c3221c06 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:51.597276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7d505-30a0-4eec-b854-4481c3221c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:51.597726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7d505-30a0-4eec-b854-4481c3221c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:51.598690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7d505-30a0-4eec-b854-4481c3221c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:51.601225 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7d505-30a0-4eec-b854-4481c3221c06 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:51.633713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1150/2291] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:20:51 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:20:51.639344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a456b-b997-45c0-b8a5-e5e93da541cf None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:51.650474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a456b-b997-45c0-b8a5-e5e93da541cf None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:51.712719 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b79fc2-561e-489d-8b31-1eac01a144c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:51.713304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b79fc2-561e-489d-8b31-1eac01a144c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:51.713622 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b79fc2-561e-489d-8b31-1eac01a144c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:51.713897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b79fc2-561e-489d-8b31-1eac01a144c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:51.714606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b79fc2-561e-489d-8b31-1eac01a144c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:51.716571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b79fc2-561e-489d-8b31-1eac01a144c0 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:51.740491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1142/2292] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:20:51 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:20:51.744645 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7d505-30a0-4eec-b854-4481c3221c06 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:51.756230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7d505-30a0-4eec-b854-4481c3221c06 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:51.761678 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf44717-33c2-4f2f-993a-aefb0a0d1038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:51.762403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44717-33c2-4f2f-993a-aefb0a0d1038 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:51.762726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44717-33c2-4f2f-993a-aefb0a0d1038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:51.763101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44717-33c2-4f2f-993a-aefb0a0d1038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:51.763842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf44717-33c2-4f2f-993a-aefb0a0d1038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:51.765449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf44717-33c2-4f2f-993a-aefb0a0d1038 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:51.776512 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1151/2293] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:20:51.781594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b79fc2-561e-489d-8b31-1eac01a144c0 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:51.797201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b79fc2-561e-489d-8b31-1eac01a144c0 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:51.805772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b20c0b-42ed-41a0-a36e-5aea32b55305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:51.807134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b20c0b-42ed-41a0-a36e-5aea32b55305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:51.807495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b20c0b-42ed-41a0-a36e-5aea32b55305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:51.807871 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b20c0b-42ed-41a0-a36e-5aea32b55305 admin admin] PATH_INFO: `/v3/projects/538afb697986468dab8e5c0f17ca47bf/users/fd458d1e77c3432b8730dd6e6748ad80/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:51.830118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b20c0b-42ed-41a0-a36e-5aea32b55305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538afb697986468dab8e5c0f17ca47bf, user_id=fd458d1e77c3432b8730dd6e6748ad80, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:51.832975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b20c0b-42ed-41a0-a36e-5aea32b55305 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:51.849349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1143/2294] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:20:51 2022] PUT /identity/v3/projects/538afb697986468dab8e5c0f17ca47bf/users/fd458d1e77c3432b8730dd6e6748ad80/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:20:51.853549 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf44717-33c2-4f2f-993a-aefb0a0d1038 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:51.863685 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf44717-33c2-4f2f-993a-aefb0a0d1038 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:51.886980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:51.930601 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a35c89-7e87-4b49-aac2-c85fa3f9723f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:51.931305 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a35c89-7e87-4b49-aac2-c85fa3f9723f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:51.931561 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a35c89-7e87-4b49-aac2-c85fa3f9723f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:51.931871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a35c89-7e87-4b49-aac2-c85fa3f9723f admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:51.932604 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a35c89-7e87-4b49-aac2-c85fa3f9723f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:51.934190 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a35c89-7e87-4b49-aac2-c85fa3f9723f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:51.944421 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1152/2295] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:20:51.949460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b20c0b-42ed-41a0-a36e-5aea32b55305 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:51.966358 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b20c0b-42ed-41a0-a36e-5aea32b55305 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:51.971936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8a89-f5d7-4a02-a28a-5d7f073da886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:51.972839 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8a89-f5d7-4a02-a28a-5d7f073da886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:51.973119 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8a89-f5d7-4a02-a28a-5d7f073da886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:51.973390 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8a89-f5d7-4a02-a28a-5d7f073da886 admin admin] PATH_INFO: `/v3/projects/538afb697986468dab8e5c0f17ca47bf/users/fd458d1e77c3432b8730dd6e6748ad80/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:51.975566 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a8a89-f5d7-4a02-a28a-5d7f073da886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538afb697986468dab8e5c0f17ca47bf, user_id=fd458d1e77c3432b8730dd6e6748ad80, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:51.978189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a8a89-f5d7-4a02-a28a-5d7f073da886 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:51.989446 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1144/2296] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:20:51 2022] PUT /identity/v3/projects/538afb697986468dab8e5c0f17ca47bf/users/fd458d1e77c3432b8730dd6e6748ad80/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:52.001481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b273f3-2190-4b50-ab01-ee9218034ef5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:52.001770 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b273f3-2190-4b50-ab01-ee9218034ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:52.002079 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b273f3-2190-4b50-ab01-ee9218034ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:52.030252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-38b273f3-2190-4b50-ab01-ee9218034ef5 None None] MFA Rules not processed for user `fd458d1e77c3432b8730dd6e6748ad80`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:52.031492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-38b273f3-2190-4b50-ab01-ee9218034ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:52.110431 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1153/2297] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:52.122592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8a89-f5d7-4a02-a28a-5d7f073da886 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:52.124477 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-564a8a89-f5d7-4a02-a28a-5d7f073da886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:52.157355 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:52.191020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8a89-f5d7-4a02-a28a-5d7f073da886 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:52.195290 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22890be5-1c3e-4795-8c96-f7c9517e1ebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:52.195499 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22890be5-1c3e-4795-8c96-f7c9517e1ebe service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:52.195788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22890be5-1c3e-4795-8c96-f7c9517e1ebe service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:52.196061 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22890be5-1c3e-4795-8c96-f7c9517e1ebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:52.206176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22890be5-1c3e-4795-8c96-f7c9517e1ebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:52.207656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22890be5-1c3e-4795-8c96-f7c9517e1ebe service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:52.218056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1145/2298] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:20:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:20:52.628161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b273f3-2190-4b50-ab01-ee9218034ef5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:52.697618 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b273f3-2190-4b50-ab01-ee9218034ef5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:52.703467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3270197-7c55-4edf-81dc-7e4f687bb866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:52.704360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3270197-7c55-4edf-81dc-7e4f687bb866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:52.704639 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3270197-7c55-4edf-81dc-7e4f687bb866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:52.704914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3270197-7c55-4edf-81dc-7e4f687bb866 admin admin] PATH_INFO: `/v3/users/0d354a8aadcf4ca3bd4b178cb6209ba3` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:52.706249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3270197-7c55-4edf-81dc-7e4f687bb866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d354a8aadcf4ca3bd4b178cb6209ba3)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:52.708224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3270197-7c55-4edf-81dc-7e4f687bb866 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:52.760876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d3270197-7c55-4edf-81dc-7e4f687bb866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d354a8aadcf4ca3bd4b178cb6209ba3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:52.762893 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:52.769248 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d3270197-7c55-4edf-81dc-7e4f687bb866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d354a8aadcf4ca3bd4b178cb6209ba3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:52.770259 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d3270197-7c55-4edf-81dc-7e4f687bb866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d354a8aadcf4ca3bd4b178cb6209ba3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:52.782311 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d3270197-7c55-4edf-81dc-7e4f687bb866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d354a8aadcf4ca3bd4b178cb6209ba3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:52.782965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d3270197-7c55-4edf-81dc-7e4f687bb866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d354a8aadcf4ca3bd4b178cb6209ba3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:52.797339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1154/2299] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:20:52 2022] DELETE /identity/v3/users/0d354a8aadcf4ca3bd4b178cb6209ba3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:52.802012 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f7721-b624-4fa3-941f-74279c7aa00c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:52.802285 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f7721-b624-4fa3-941f-74279c7aa00c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:52.802559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f7721-b624-4fa3-941f-74279c7aa00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:52.820917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-aa7f7721-b624-4fa3-941f-74279c7aa00c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:52.822088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-aa7f7721-b624-4fa3-941f-74279c7aa00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:52.883011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1146/2300] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:52.894803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3270197-7c55-4edf-81dc-7e4f687bb866 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:52.897247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d3270197-7c55-4edf-81dc-7e4f687bb866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:52.961230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3270197-7c55-4edf-81dc-7e4f687bb866 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:52.965143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e37533-85b6-4d30-97df-1664df3d580a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:52.965786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e37533-85b6-4d30-97df-1664df3d580a service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:52.966065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e37533-85b6-4d30-97df-1664df3d580a service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:52.966428 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e37533-85b6-4d30-97df-1664df3d580a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:52.976107 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e37533-85b6-4d30-97df-1664df3d580a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:52.977558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e37533-85b6-4d30-97df-1664df3d580a service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:52.987586 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1155/2301] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:20:53.284546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f7721-b624-4fa3-941f-74279c7aa00c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:53.286191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-aa7f7721-b624-4fa3-941f-74279c7aa00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:53.300127 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f7721-b624-4fa3-941f-74279c7aa00c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:53.305094 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:53.306001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:53.306276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:53.306555 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] PATH_INFO: `/v3/projects/81d0745163314e7d96fd2905ba05f15e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:53.308028 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d0745163314e7d96fd2905ba05f15e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:53.310147 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:53.368992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d0745163314e7d96fd2905ba05f15e', 'request_id': 'req-513ec058-4571-4cc5-97ed-ce5049dcb2ce'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:53.377386 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d0745163314e7d96fd2905ba05f15e', 'request_id': 'req-513ec058-4571-4cc5-97ed-ce5049dcb2ce'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:53.383150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d0745163314e7d96fd2905ba05f15e', 'request_id': 'req-513ec058-4571-4cc5-97ed-ce5049dcb2ce'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:53.395594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] The token cache is being invalidate because project 81d0745163314e7d96fd2905ba05f15e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:20:53.395882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:53.396619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:53.398220 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1147/2302] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:20:53 2022] DELETE /identity/v3/projects/81d0745163314e7d96fd2905ba05f15e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:53.402691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e37533-85b6-4d30-97df-1664df3d580a service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:53.413255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e37533-85b6-4d30-97df-1664df3d580a service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:53.475983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59526089-1c43-4621-b342-33cdc9c459c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:53.476885 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59526089-1c43-4621-b342-33cdc9c459c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:53.477161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59526089-1c43-4621-b342-33cdc9c459c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:53.477428 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59526089-1c43-4621-b342-33cdc9c459c8 admin admin] PATH_INFO: `/v3/users/fd458d1e77c3432b8730dd6e6748ad80` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:53.478643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59526089-1c43-4621-b342-33cdc9c459c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd458d1e77c3432b8730dd6e6748ad80)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:53.480619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59526089-1c43-4621-b342-33cdc9c459c8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:53.532859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-59526089-1c43-4621-b342-33cdc9c459c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd458d1e77c3432b8730dd6e6748ad80'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:53.540990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-59526089-1c43-4621-b342-33cdc9c459c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd458d1e77c3432b8730dd6e6748ad80'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:53.541719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-59526089-1c43-4621-b342-33cdc9c459c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd458d1e77c3432b8730dd6e6748ad80'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:53.554188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:53.555717 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-59526089-1c43-4621-b342-33cdc9c459c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd458d1e77c3432b8730dd6e6748ad80'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:53.556587 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-59526089-1c43-4621-b342-33cdc9c459c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd458d1e77c3432b8730dd6e6748ad80'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:53.577298 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1156/2303] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:20:53 2022] DELETE /identity/v3/users/fd458d1e77c3432b8730dd6e6748ad80 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:53.876952 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:53.880640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:53.901610 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ec058-4571-4cc5-97ed-ce5049dcb2ce admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:53.955298 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:53.969002 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe270870-951b-49e0-83fc-91b6a2521d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:53.969918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe270870-951b-49e0-83fc-91b6a2521d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:53.970200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe270870-951b-49e0-83fc-91b6a2521d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:53.970473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe270870-951b-49e0-83fc-91b6a2521d40 admin admin] PATH_INFO: `/v3/projects/538afb697986468dab8e5c0f17ca47bf` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:53.972020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe270870-951b-49e0-83fc-91b6a2521d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538afb697986468dab8e5c0f17ca47bf)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:53.973953 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe270870-951b-49e0-83fc-91b6a2521d40 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:54.026032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fe270870-951b-49e0-83fc-91b6a2521d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538afb697986468dab8e5c0f17ca47bf', 'request_id': 'req-fe270870-951b-49e0-83fc-91b6a2521d40'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:54.035346 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fe270870-951b-49e0-83fc-91b6a2521d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538afb697986468dab8e5c0f17ca47bf', 'request_id': 'req-fe270870-951b-49e0-83fc-91b6a2521d40'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:54.041479 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fe270870-951b-49e0-83fc-91b6a2521d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538afb697986468dab8e5c0f17ca47bf', 'request_id': 'req-fe270870-951b-49e0-83fc-91b6a2521d40'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:54.053693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fe270870-951b-49e0-83fc-91b6a2521d40 admin admin] The token cache is being invalidate because project 538afb697986468dab8e5c0f17ca47bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:20:54.054013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fe270870-951b-49e0-83fc-91b6a2521d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:54.054838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fe270870-951b-49e0-83fc-91b6a2521d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:54.056473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1148/2304] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:20:53 2022] DELETE /identity/v3/projects/538afb697986468dab8e5c0f17ca47bf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:54.061713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95100ebf-8c57-47a7-9b18-0a4534f46593 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:54.062266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95100ebf-8c57-47a7-9b18-0a4534f46593 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:54.062266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95100ebf-8c57-47a7-9b18-0a4534f46593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:54.081276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-95100ebf-8c57-47a7-9b18-0a4534f46593 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:54.082511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-95100ebf-8c57-47a7-9b18-0a4534f46593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:54.148481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1157/2305] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:54.156685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d1887-dc1f-474d-b87d-77e72412354b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:54.157158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d1887-dc1f-474d-b87d-77e72412354b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:54.157705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d1887-dc1f-474d-b87d-77e72412354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:54.177984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-573d1887-dc1f-474d-b87d-77e72412354b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:54.179245 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-573d1887-dc1f-474d-b87d-77e72412354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:54.188093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1149/2306] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:54.192585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95100ebf-8c57-47a7-9b18-0a4534f46593 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:54.203032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95100ebf-8c57-47a7-9b18-0a4534f46593 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:54.207906 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752fa77-1138-4478-9466-3cc819613a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:54.208533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752fa77-1138-4478-9466-3cc819613a90 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:54.208793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752fa77-1138-4478-9466-3cc819613a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:54.209062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752fa77-1138-4478-9466-3cc819613a90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:54.209807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752fa77-1138-4478-9466-3cc819613a90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:20:54.210113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752fa77-1138-4478-9466-3cc819613a90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:54.211752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752fa77-1138-4478-9466-3cc819613a90 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:54.225208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1158/2307] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:20:54.230282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d1887-dc1f-474d-b87d-77e72412354b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:54.240422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d1887-dc1f-474d-b87d-77e72412354b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:54.245881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9ae27-e998-4f3f-a4da-41a6f3ea3e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:54.246570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9ae27-e998-4f3f-a4da-41a6f3ea3e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:54.246849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9ae27-e998-4f3f-a4da-41a6f3ea3e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:54.247148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9ae27-e998-4f3f-a4da-41a6f3ea3e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:54.247922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9ae27-e998-4f3f-a4da-41a6f3ea3e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:54.249890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9ae27-e998-4f3f-a4da-41a6f3ea3e10 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:54.287776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1150/2308] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:20:54 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:20:54.292582 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752fa77-1138-4478-9466-3cc819613a90 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:54.304254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752fa77-1138-4478-9466-3cc819613a90 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:54.367952 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b5dd1-aea7-435e-b948-cfff964a08e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:54.368611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b5dd1-aea7-435e-b948-cfff964a08e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:54.368920 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b5dd1-aea7-435e-b948-cfff964a08e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:54.369177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b5dd1-aea7-435e-b948-cfff964a08e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:54.369879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b5dd1-aea7-435e-b948-cfff964a08e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:54.371891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b5dd1-aea7-435e-b948-cfff964a08e6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:54.393267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1159/2309] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:20:54 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:20:54.397510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9ae27-e998-4f3f-a4da-41a6f3ea3e10 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:54.408706 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9ae27-e998-4f3f-a4da-41a6f3ea3e10 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:54.414356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db790a5d-2bec-4670-ab2e-1811f66f90aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:54.415087 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790a5d-2bec-4670-ab2e-1811f66f90aa admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:54.415376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790a5d-2bec-4670-ab2e-1811f66f90aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:54.415651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790a5d-2bec-4670-ab2e-1811f66f90aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:54.416402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db790a5d-2bec-4670-ab2e-1811f66f90aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:54.418030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db790a5d-2bec-4670-ab2e-1811f66f90aa admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:54.430583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1151/2310] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:20:54.437728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b5dd1-aea7-435e-b948-cfff964a08e6 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:54.449479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b5dd1-aea7-435e-b948-cfff964a08e6 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:54.455677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d0ac9-2bd2-4377-a0cc-22a4b1f1d9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:54.456271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d0ac9-2bd2-4377-a0cc-22a4b1f1d9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:54.457730 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d0ac9-2bd2-4377-a0cc-22a4b1f1d9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:54.457825 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d0ac9-2bd2-4377-a0cc-22a4b1f1d9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:54.458720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d0ac9-2bd2-4377-a0cc-22a4b1f1d9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:54.461315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d0ac9-2bd2-4377-a0cc-22a4b1f1d9d2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:54.477381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1160/2311] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:20:54.479033 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db790a5d-2bec-4670-ab2e-1811f66f90aa admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:54.490981 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db790a5d-2bec-4670-ab2e-1811f66f90aa admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:54.496856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406573-a6d9-4fb7-b305-97d30b398e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:54.497910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406573-a6d9-4fb7-b305-97d30b398e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:54.498190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406573-a6d9-4fb7-b305-97d30b398e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:54.498518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406573-a6d9-4fb7-b305-97d30b398e9a admin admin] PATH_INFO: `/v3/projects/be2a4556f43f46b6b03e5c6f179cbffa/users/ab7414d02f0e4f0f95ed3562a9f3e76e/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:54.516781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb406573-a6d9-4fb7-b305-97d30b398e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2a4556f43f46b6b03e5c6f179cbffa, user_id=ab7414d02f0e4f0f95ed3562a9f3e76e, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:54.519606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb406573-a6d9-4fb7-b305-97d30b398e9a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:54.536496 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1152/2312] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:20:54 2022] PUT /identity/v3/projects/be2a4556f43f46b6b03e5c6f179cbffa/users/ab7414d02f0e4f0f95ed3562a9f3e76e/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:20:54.547785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a19e0-d2e6-4388-958b-5797b141f17d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:54.548092 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a19e0-d2e6-4388-958b-5797b141f17d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:54.548341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a19e0-d2e6-4388-958b-5797b141f17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:54.577825 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b83a19e0-d2e6-4388-958b-5797b141f17d None None] MFA Rules not processed for user `ab7414d02f0e4f0f95ed3562a9f3e76e`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:54.579103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b83a19e0-d2e6-4388-958b-5797b141f17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:54.626277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:54.654393 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1161/2313] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:54.660070 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406573-a6d9-4fb7-b305-97d30b398e9a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:54.738760 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406573-a6d9-4fb7-b305-97d30b398e9a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:54.744435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905bb1d-fd19-4611-933f-45b25e4fcf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:54.745109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905bb1d-fd19-4611-933f-45b25e4fcf77 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:54.745393 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905bb1d-fd19-4611-933f-45b25e4fcf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:54.745672 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905bb1d-fd19-4611-933f-45b25e4fcf77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:54.746424 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905bb1d-fd19-4611-933f-45b25e4fcf77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:54.748507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905bb1d-fd19-4611-933f-45b25e4fcf77 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:54.780020 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1153/2314] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:20:54 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:20:54.784403 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a19e0-d2e6-4388-958b-5797b141f17d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:54.795841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a19e0-d2e6-4388-958b-5797b141f17d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:54.856177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25cc73-e31f-4f5b-bb40-8468df2287c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:54.857010 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25cc73-e31f-4f5b-bb40-8468df2287c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:54.857281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25cc73-e31f-4f5b-bb40-8468df2287c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:54.857569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25cc73-e31f-4f5b-bb40-8468df2287c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:54.858281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25cc73-e31f-4f5b-bb40-8468df2287c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:54.860259 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25cc73-e31f-4f5b-bb40-8468df2287c3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:54.881477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1162/2315] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:20:54 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:20:54.886557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905bb1d-fd19-4611-933f-45b25e4fcf77 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:54.892270 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:54.899605 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905bb1d-fd19-4611-933f-45b25e4fcf77 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:54.906299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494982c4-8ec3-4b4d-9989-09af1e0e8fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:54.907097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494982c4-8ec3-4b4d-9989-09af1e0e8fbb admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:54.907413 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494982c4-8ec3-4b4d-9989-09af1e0e8fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:54.907782 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494982c4-8ec3-4b4d-9989-09af1e0e8fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:54.908567 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494982c4-8ec3-4b4d-9989-09af1e0e8fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:54.910276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494982c4-8ec3-4b4d-9989-09af1e0e8fbb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:54.922386 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1154/2316] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:20:54.927101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25cc73-e31f-4f5b-bb40-8468df2287c3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:54.938132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25cc73-e31f-4f5b-bb40-8468df2287c3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:54.943646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dfe29-0b27-4ddb-acfc-f7ca2fd51f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:54.944582 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dfe29-0b27-4ddb-acfc-f7ca2fd51f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:54.944865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dfe29-0b27-4ddb-acfc-f7ca2fd51f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:54.945139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dfe29-0b27-4ddb-acfc-f7ca2fd51f57 admin admin] PATH_INFO: `/v3/projects/643a1860906e4afdb53f1ce05d09c4fe/users/ca2be2f9bd0b4e7ea3b131afbf66a114/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:54.962634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dfe29-0b27-4ddb-acfc-f7ca2fd51f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=643a1860906e4afdb53f1ce05d09c4fe, user_id=ca2be2f9bd0b4e7ea3b131afbf66a114, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:54.965329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dfe29-0b27-4ddb-acfc-f7ca2fd51f57 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:54.979844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1163/2317] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:20:54 2022] PUT /identity/v3/projects/643a1860906e4afdb53f1ce05d09c4fe/users/ca2be2f9bd0b4e7ea3b131afbf66a114/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:54.984056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494982c4-8ec3-4b4d-9989-09af1e0e8fbb admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:54.995456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494982c4-8ec3-4b4d-9989-09af1e0e8fbb admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:55.055302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2889e4-b993-4e14-8195-a157d222ec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:55.056258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2889e4-b993-4e14-8195-a157d222ec61 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:55.056876 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2889e4-b993-4e14-8195-a157d222ec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:55.057349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2889e4-b993-4e14-8195-a157d222ec61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:55.058221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2889e4-b993-4e14-8195-a157d222ec61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:55.060106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2889e4-b993-4e14-8195-a157d222ec61 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:55.071611 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1155/2318] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:20:55.076113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dfe29-0b27-4ddb-acfc-f7ca2fd51f57 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:55.087146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dfe29-0b27-4ddb-acfc-f7ca2fd51f57 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:55.092537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db5858-9338-4336-9695-d2e0e8dd9b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:55.093498 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db5858-9338-4336-9695-d2e0e8dd9b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:55.093786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db5858-9338-4336-9695-d2e0e8dd9b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:55.094062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db5858-9338-4336-9695-d2e0e8dd9b93 admin admin] PATH_INFO: `/v3/projects/643a1860906e4afdb53f1ce05d09c4fe/users/ca2be2f9bd0b4e7ea3b131afbf66a114/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:55.096189 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db5858-9338-4336-9695-d2e0e8dd9b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=643a1860906e4afdb53f1ce05d09c4fe, user_id=ca2be2f9bd0b4e7ea3b131afbf66a114, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:55.098984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db5858-9338-4336-9695-d2e0e8dd9b93 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:55.111218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1164/2319] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:20:55 2022] PUT /identity/v3/projects/643a1860906e4afdb53f1ce05d09c4fe/users/ca2be2f9bd0b4e7ea3b131afbf66a114/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:55.123431 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec773f49-12e9-4870-85d9-7d6134c71d80 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:55.123892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec773f49-12e9-4870-85d9-7d6134c71d80 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:55.124175 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec773f49-12e9-4870-85d9-7d6134c71d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:55.164237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ec773f49-12e9-4870-85d9-7d6134c71d80 None None] MFA Rules not processed for user `ca2be2f9bd0b4e7ea3b131afbf66a114`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:55.166033 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ec773f49-12e9-4870-85d9-7d6134c71d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:55.246765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1156/2320] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:55 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:55.258447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db5858-9338-4336-9695-d2e0e8dd9b93 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:55.260836 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-94db5858-9338-4336-9695-d2e0e8dd9b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:55.348192 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db5858-9338-4336-9695-d2e0e8dd9b93 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:55.352754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550a68c-63f1-4812-9b1a-7586ef548bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:55.353458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550a68c-63f1-4812-9b1a-7586ef548bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:55.353734 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550a68c-63f1-4812-9b1a-7586ef548bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:55.354003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550a68c-63f1-4812-9b1a-7586ef548bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:55.364973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550a68c-63f1-4812-9b1a-7586ef548bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:55.366871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550a68c-63f1-4812-9b1a-7586ef548bf0 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:55.377730 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1165/2321] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:20:55 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:20:56.951397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec773f49-12e9-4870-85d9-7d6134c71d80 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:57.019066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec773f49-12e9-4870-85d9-7d6134c71d80 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:57.024291 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce408db6-55bd-45f8-ad13-1fa0b3f69ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:57.025201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408db6-55bd-45f8-ad13-1fa0b3f69ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:57.025487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408db6-55bd-45f8-ad13-1fa0b3f69ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:57.025762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408db6-55bd-45f8-ad13-1fa0b3f69ab6 admin admin] PATH_INFO: `/v3/users/ab7414d02f0e4f0f95ed3562a9f3e76e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:57.027043 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce408db6-55bd-45f8-ad13-1fa0b3f69ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7414d02f0e4f0f95ed3562a9f3e76e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:57.028980 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce408db6-55bd-45f8-ad13-1fa0b3f69ab6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:57.044754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:57.082073 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ce408db6-55bd-45f8-ad13-1fa0b3f69ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7414d02f0e4f0f95ed3562a9f3e76e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.082744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ce408db6-55bd-45f8-ad13-1fa0b3f69ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7414d02f0e4f0f95ed3562a9f3e76e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.095812 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ce408db6-55bd-45f8-ad13-1fa0b3f69ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7414d02f0e4f0f95ed3562a9f3e76e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.104145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ce408db6-55bd-45f8-ad13-1fa0b3f69ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7414d02f0e4f0f95ed3562a9f3e76e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.105099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ce408db6-55bd-45f8-ad13-1fa0b3f69ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7414d02f0e4f0f95ed3562a9f3e76e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.121549 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1157/2322] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:20:56 2022] DELETE /identity/v3/users/ab7414d02f0e4f0f95ed3562a9f3e76e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:57.126416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1eb93-baba-4826-8a6d-fd3136cffe47 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:57.127007 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1eb93-baba-4826-8a6d-fd3136cffe47 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:57.127299 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1eb93-baba-4826-8a6d-fd3136cffe47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:57.147464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2ed1eb93-baba-4826-8a6d-fd3136cffe47 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:57.148702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2ed1eb93-baba-4826-8a6d-fd3136cffe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:57.187243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:57.215769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1166/2323] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:57.226273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce408db6-55bd-45f8-ad13-1fa0b3f69ab6 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:57.227826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ce408db6-55bd-45f8-ad13-1fa0b3f69ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:57.291379 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce408db6-55bd-45f8-ad13-1fa0b3f69ab6 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:57.295730 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6e477-558d-4228-9015-abb2e7c2fa45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:57.297228 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e477-558d-4228-9015-abb2e7c2fa45 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:57.297719 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e477-558d-4228-9015-abb2e7c2fa45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:57.298209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e477-558d-4228-9015-abb2e7c2fa45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:57.315096 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6e477-558d-4228-9015-abb2e7c2fa45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:57.317895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6e477-558d-4228-9015-abb2e7c2fa45 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:57.335924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1158/2324] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:20:57.640166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1eb93-baba-4826-8a6d-fd3136cffe47 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:57.641872 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2ed1eb93-baba-4826-8a6d-fd3136cffe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:57.656474 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1eb93-baba-4826-8a6d-fd3136cffe47 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:57.662688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:57.663657 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:57.663939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:57.664700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] PATH_INFO: `/v3/projects/be2a4556f43f46b6b03e5c6f179cbffa` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:57.665702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2a4556f43f46b6b03e5c6f179cbffa)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:57.667739 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:57.720473 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2a4556f43f46b6b03e5c6f179cbffa', 'request_id': 'req-e8f023b1-621d-443d-be22-7f1187a8a3a1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.731914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2a4556f43f46b6b03e5c6f179cbffa', 'request_id': 'req-e8f023b1-621d-443d-be22-7f1187a8a3a1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.739539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2a4556f43f46b6b03e5c6f179cbffa', 'request_id': 'req-e8f023b1-621d-443d-be22-7f1187a8a3a1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.754248 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] The token cache is being invalidate because project be2a4556f43f46b6b03e5c6f179cbffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:20:57.754756 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.755565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.757560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1167/2325] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:20:57 2022] DELETE /identity/v3/projects/be2a4556f43f46b6b03e5c6f179cbffa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:57.762752 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6e477-558d-4228-9015-abb2e7c2fa45 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:57.777924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6e477-558d-4228-9015-abb2e7c2fa45 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:57.846602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95769e-ed6f-4986-bafc-03ff2c50e0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:57.847638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95769e-ed6f-4986-bafc-03ff2c50e0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:57.848012 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95769e-ed6f-4986-bafc-03ff2c50e0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:57.848302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95769e-ed6f-4986-bafc-03ff2c50e0d7 admin admin] PATH_INFO: `/v3/users/ca2be2f9bd0b4e7ea3b131afbf66a114` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:57.849646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95769e-ed6f-4986-bafc-03ff2c50e0d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2be2f9bd0b4e7ea3b131afbf66a114)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:57.851665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95769e-ed6f-4986-bafc-03ff2c50e0d7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:57.897898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:57.908648 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2f95769e-ed6f-4986-bafc-03ff2c50e0d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2be2f9bd0b4e7ea3b131afbf66a114'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.909533 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2f95769e-ed6f-4986-bafc-03ff2c50e0d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2be2f9bd0b4e7ea3b131afbf66a114'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.923993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2f95769e-ed6f-4986-bafc-03ff2c50e0d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2be2f9bd0b4e7ea3b131afbf66a114'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.932870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2f95769e-ed6f-4986-bafc-03ff2c50e0d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2be2f9bd0b4e7ea3b131afbf66a114'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.933736 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2f95769e-ed6f-4986-bafc-03ff2c50e0d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2be2f9bd0b4e7ea3b131afbf66a114'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:57.948350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1159/2326] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:20:57 2022] DELETE /identity/v3/users/ca2be2f9bd0b4e7ea3b131afbf66a114 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:58.276710 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:58.278324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:58.294470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f023b1-621d-443d-be22-7f1187a8a3a1 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:58.365624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dd6d9-417c-490f-a7a4-855d18bd30b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:58.366430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dd6d9-417c-490f-a7a4-855d18bd30b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:58.366727 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dd6d9-417c-490f-a7a4-855d18bd30b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:58.367006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dd6d9-417c-490f-a7a4-855d18bd30b4 admin admin] PATH_INFO: `/v3/projects/643a1860906e4afdb53f1ce05d09c4fe` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:58.368255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dd6d9-417c-490f-a7a4-855d18bd30b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=643a1860906e4afdb53f1ce05d09c4fe)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:58.370248 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dd6d9-417c-490f-a7a4-855d18bd30b4 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:58.432213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a98dd6d9-417c-490f-a7a4-855d18bd30b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '643a1860906e4afdb53f1ce05d09c4fe', 'request_id': 'req-a98dd6d9-417c-490f-a7a4-855d18bd30b4'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:58.439978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a98dd6d9-417c-490f-a7a4-855d18bd30b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '643a1860906e4afdb53f1ce05d09c4fe', 'request_id': 'req-a98dd6d9-417c-490f-a7a4-855d18bd30b4'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:58.446939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a98dd6d9-417c-490f-a7a4-855d18bd30b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '643a1860906e4afdb53f1ce05d09c4fe', 'request_id': 'req-a98dd6d9-417c-490f-a7a4-855d18bd30b4'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:58.451171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:58.459600 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a98dd6d9-417c-490f-a7a4-855d18bd30b4 admin admin] The token cache is being invalidate because project 643a1860906e4afdb53f1ce05d09c4fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:20:58.460070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a98dd6d9-417c-490f-a7a4-855d18bd30b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:58.460756 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a98dd6d9-417c-490f-a7a4-855d18bd30b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:20:58.462470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1168/2327] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:20:58 2022] DELETE /identity/v3/projects/643a1860906e4afdb53f1ce05d09c4fe => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:58.467944 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22d0f8-b42b-4cfc-a612-c39192ad02f1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:58.468432 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22d0f8-b42b-4cfc-a612-c39192ad02f1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:58.468665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22d0f8-b42b-4cfc-a612-c39192ad02f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:58.487471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-cd22d0f8-b42b-4cfc-a612-c39192ad02f1 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:58.488683 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cd22d0f8-b42b-4cfc-a612-c39192ad02f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:58.554398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1160/2328] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:58.563873 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b92955-47ea-4871-909f-6f9deff5bfb5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:58.564179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b92955-47ea-4871-909f-6f9deff5bfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:58.564418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b92955-47ea-4871-909f-6f9deff5bfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:58.583841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-55b92955-47ea-4871-909f-6f9deff5bfb5 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:58.585067 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-55b92955-47ea-4871-909f-6f9deff5bfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:58.593171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1169/2329] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:58.597606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22d0f8-b42b-4cfc-a612-c39192ad02f1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:58.607746 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22d0f8-b42b-4cfc-a612-c39192ad02f1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:58.612602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd94612-9dbb-4771-8171-e0ae67160684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:58.613277 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd94612-9dbb-4771-8171-e0ae67160684 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:58.613554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd94612-9dbb-4771-8171-e0ae67160684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:58.613950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd94612-9dbb-4771-8171-e0ae67160684 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:58.614552 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd94612-9dbb-4771-8171-e0ae67160684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:20:58.614896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd94612-9dbb-4771-8171-e0ae67160684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:58.616578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd94612-9dbb-4771-8171-e0ae67160684 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:58.630842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1161/2330] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:20:58.635514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b92955-47ea-4871-909f-6f9deff5bfb5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:58.645999 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b92955-47ea-4871-909f-6f9deff5bfb5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:58.651626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb363d-6e70-4d7d-9424-ae7606788fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:58.652322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb363d-6e70-4d7d-9424-ae7606788fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:58.652600 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb363d-6e70-4d7d-9424-ae7606788fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:58.652866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb363d-6e70-4d7d-9424-ae7606788fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:58.653735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb363d-6e70-4d7d-9424-ae7606788fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:58.656834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb363d-6e70-4d7d-9424-ae7606788fd0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:58.688084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1170/2331] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:20:58 2022] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:20:58.692305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd94612-9dbb-4771-8171-e0ae67160684 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:58.702457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd94612-9dbb-4771-8171-e0ae67160684 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:58.765310 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee8aac-8a67-42c5-a30e-3d55020c4e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:58.766262 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee8aac-8a67-42c5-a30e-3d55020c4e20 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:58.766636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee8aac-8a67-42c5-a30e-3d55020c4e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:58.766973 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee8aac-8a67-42c5-a30e-3d55020c4e20 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:58.767673 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee8aac-8a67-42c5-a30e-3d55020c4e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:58.769660 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee8aac-8a67-42c5-a30e-3d55020c4e20 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:58.791781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1162/2332] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:20:58 2022] POST /identity/v3/users => generated 304 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:20:58.796539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb363d-6e70-4d7d-9424-ae7606788fd0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:58.807783 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb363d-6e70-4d7d-9424-ae7606788fd0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:58.813293 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974851d0-9942-4baf-81e4-78e32cf05465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:58.813970 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974851d0-9942-4baf-81e4-78e32cf05465 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:58.814251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974851d0-9942-4baf-81e4-78e32cf05465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:58.814520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974851d0-9942-4baf-81e4-78e32cf05465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:58.815289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974851d0-9942-4baf-81e4-78e32cf05465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:58.816893 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974851d0-9942-4baf-81e4-78e32cf05465 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:58.828154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1171/2333] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:20:58.832653 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee8aac-8a67-42c5-a30e-3d55020c4e20 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:58.843283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee8aac-8a67-42c5-a30e-3d55020c4e20 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:58.848539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9766a-15ee-450b-b256-b9b94a3ee25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:58.849202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9766a-15ee-450b-b256-b9b94a3ee25c admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:58.849479 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9766a-15ee-450b-b256-b9b94a3ee25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:58.849752 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9766a-15ee-450b-b256-b9b94a3ee25c admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:58.850494 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9766a-15ee-450b-b256-b9b94a3ee25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:58.852123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9766a-15ee-450b-b256-b9b94a3ee25c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:58.862849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1163/2334] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:20:58.868929 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974851d0-9942-4baf-81e4-78e32cf05465 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:58.880876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974851d0-9942-4baf-81e4-78e32cf05465 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:58.886685 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822016ab-84fc-4d0d-a97b-316e2968e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:58.887615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822016ab-84fc-4d0d-a97b-316e2968e9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:58.887896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822016ab-84fc-4d0d-a97b-316e2968e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:58.888179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822016ab-84fc-4d0d-a97b-316e2968e9ed admin admin] PATH_INFO: `/v3/projects/19b4f47aeaf34ddb8cff3e319168ab0d/users/3b557c98206c4d5e91b28d3d890e104d/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:58.902850 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822016ab-84fc-4d0d-a97b-316e2968e9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b4f47aeaf34ddb8cff3e319168ab0d, user_id=3b557c98206c4d5e91b28d3d890e104d, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:58.905598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822016ab-84fc-4d0d-a97b-316e2968e9ed admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:58.923605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1172/2335] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:20:58 2022] PUT /identity/v3/projects/19b4f47aeaf34ddb8cff3e319168ab0d/users/3b557c98206c4d5e91b28d3d890e104d/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:58.935614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c3f25-d713-4e12-ae4f-bc05a9dea442 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:58.935933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c3f25-d713-4e12-ae4f-bc05a9dea442 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:58.936217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c3f25-d713-4e12-ae4f-bc05a9dea442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:58.973735 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a98c3f25-d713-4e12-ae4f-bc05a9dea442 None None] MFA Rules not processed for user `3b557c98206c4d5e91b28d3d890e104d`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:58.975021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a98c3f25-d713-4e12-ae4f-bc05a9dea442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:58.985433 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:59.060964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1164/2336] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:59.066012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822016ab-84fc-4d0d-a97b-316e2968e9ed admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:59.131849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822016ab-84fc-4d0d-a97b-316e2968e9ed admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:59.137008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee84c8-285c-41cb-a374-31117d6b9835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:59.138093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee84c8-285c-41cb-a374-31117d6b9835 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:59.138372 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee84c8-285c-41cb-a374-31117d6b9835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:59.138648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee84c8-285c-41cb-a374-31117d6b9835 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:59.139406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee84c8-285c-41cb-a374-31117d6b9835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:59.141406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee84c8-285c-41cb-a374-31117d6b9835 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:59.174727 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1173/2337] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:20:59 2022] POST /identity/v3/projects => generated 407 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:20:59.179531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c3f25-d713-4e12-ae4f-bc05a9dea442 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:59.195152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c3f25-d713-4e12-ae4f-bc05a9dea442 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:59.281135 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd63831-dea6-4a03-a60d-f13257c84711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:59.282017 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd63831-dea6-4a03-a60d-f13257c84711 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:59.282300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd63831-dea6-4a03-a60d-f13257c84711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:59.282572 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd63831-dea6-4a03-a60d-f13257c84711 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:59.283313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd63831-dea6-4a03-a60d-f13257c84711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:59.285328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd63831-dea6-4a03-a60d-f13257c84711 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:59.312307 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1165/2338] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:20:59 2022] POST /identity/v3/users => generated 310 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:20:59.316235 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee84c8-285c-41cb-a374-31117d6b9835 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:59.329509 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee84c8-285c-41cb-a374-31117d6b9835 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:59.335108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7680b2-51f6-4574-971b-59520a943edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:59.336055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7680b2-51f6-4574-971b-59520a943edc admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:59.336433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7680b2-51f6-4574-971b-59520a943edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:59.336645 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7680b2-51f6-4574-971b-59520a943edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:59.337409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7680b2-51f6-4574-971b-59520a943edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:59.339296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7680b2-51f6-4574-971b-59520a943edc admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:59.353404 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1174/2339] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:20:59.357795 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd63831-dea6-4a03-a60d-f13257c84711 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:59.370613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd63831-dea6-4a03-a60d-f13257c84711 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:59.376798 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be444f7b-43a3-444b-b374-9855b10af796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:59.377721 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be444f7b-43a3-444b-b374-9855b10af796 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:59.378005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be444f7b-43a3-444b-b374-9855b10af796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:59.378280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be444f7b-43a3-444b-b374-9855b10af796 admin admin] PATH_INFO: `/v3/projects/bf709e20f7f94ed494079440e838c7c2/users/77d90e43e2b84f1a85edf7ac70e7fe6a/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:59.396087 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be444f7b-43a3-444b-b374-9855b10af796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf709e20f7f94ed494079440e838c7c2, user_id=77d90e43e2b84f1a85edf7ac70e7fe6a, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:59.399006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be444f7b-43a3-444b-b374-9855b10af796 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:59.422518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1166/2340] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:20:59 2022] PUT /identity/v3/projects/bf709e20f7f94ed494079440e838c7c2/users/77d90e43e2b84f1a85edf7ac70e7fe6a/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:59.427699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7680b2-51f6-4574-971b-59520a943edc admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:59.444454 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7680b2-51f6-4574-971b-59520a943edc admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:59.511901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b3957-cb49-4574-bf02-cb975085b350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:59.512580 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3957-cb49-4574-bf02-cb975085b350 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:59.512890 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3957-cb49-4574-bf02-cb975085b350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:59.513168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3957-cb49-4574-bf02-cb975085b350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:59.513905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b3957-cb49-4574-bf02-cb975085b350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:59.515523 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b3957-cb49-4574-bf02-cb975085b350 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:59.524216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:20:59.530840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1175/2341] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:20:59.535784 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be444f7b-43a3-444b-b374-9855b10af796 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:59.547163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be444f7b-43a3-444b-b374-9855b10af796 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:59.552072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da3d2c-7dc0-4b91-820b-c302eefb9da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:59.552963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da3d2c-7dc0-4b91-820b-c302eefb9da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:59.553245 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da3d2c-7dc0-4b91-820b-c302eefb9da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:59.553520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da3d2c-7dc0-4b91-820b-c302eefb9da7 admin admin] PATH_INFO: `/v3/projects/bf709e20f7f94ed494079440e838c7c2/users/77d90e43e2b84f1a85edf7ac70e7fe6a/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:59.555563 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da3d2c-7dc0-4b91-820b-c302eefb9da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf709e20f7f94ed494079440e838c7c2, user_id=77d90e43e2b84f1a85edf7ac70e7fe6a, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:59.558183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da3d2c-7dc0-4b91-820b-c302eefb9da7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:59.569396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1167/2342] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:20:59 2022] PUT /identity/v3/projects/bf709e20f7f94ed494079440e838c7c2/users/77d90e43e2b84f1a85edf7ac70e7fe6a/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:20:59.580076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99300e-a235-477c-b6c7-102ebc7dd6a5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:59.580368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99300e-a235-477c-b6c7-102ebc7dd6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:59.580668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99300e-a235-477c-b6c7-102ebc7dd6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:59.615300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-fa99300e-a235-477c-b6c7-102ebc7dd6a5 None None] MFA Rules not processed for user `77d90e43e2b84f1a85edf7ac70e7fe6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:20:59.616765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-fa99300e-a235-477c-b6c7-102ebc7dd6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:59.690809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1176/2343] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:20:59 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:20:59.702426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da3d2c-7dc0-4b91-820b-c302eefb9da7 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:59.704482 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b0da3d2c-7dc0-4b91-820b-c302eefb9da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:20:59.766674 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da3d2c-7dc0-4b91-820b-c302eefb9da7 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:59.770635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2373c-59c7-4518-833b-33260c72ee47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:59.771320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2373c-59c7-4518-833b-33260c72ee47 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:59.771607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2373c-59c7-4518-833b-33260c72ee47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:59.771921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2373c-59c7-4518-833b-33260c72ee47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:20:59.783531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2373c-59c7-4518-833b-33260c72ee47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:20:59.784964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2373c-59c7-4518-833b-33260c72ee47 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:20:59.796485 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1168/2344] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:20:59 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:20:59.953533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99300e-a235-477c-b6c7-102ebc7dd6a5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:20:59.964364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99300e-a235-477c-b6c7-102ebc7dd6a5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:20:59.968954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd297d0-bb17-48c8-b8a1-c5b6163b27aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:20:59.969607 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd297d0-bb17-48c8-b8a1-c5b6163b27aa service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:20:59.969878 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd297d0-bb17-48c8-b8a1-c5b6163b27aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:20:59.970204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd297d0-bb17-48c8-b8a1-c5b6163b27aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:00.027433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd297d0-bb17-48c8-b8a1-c5b6163b27aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:00.028901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd297d0-bb17-48c8-b8a1-c5b6163b27aa service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:00.037920 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1177/2345] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:20:59 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:04.433476 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2373c-59c7-4518-833b-33260c72ee47 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:04.439031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:04.443256 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2373c-59c7-4518-833b-33260c72ee47 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:04.448155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d52f2c-d584-48d3-badf-86bc50810aaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:04.448918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d52f2c-d584-48d3-badf-86bc50810aaf service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:04.449212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d52f2c-d584-48d3-badf-86bc50810aaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:04.449841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d52f2c-d584-48d3-badf-86bc50810aaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:04.452502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d1d52f2c-d584-48d3-badf-86bc50810aaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:04.526987 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d52f2c-d584-48d3-badf-86bc50810aaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:04.528445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d52f2c-d584-48d3-badf-86bc50810aaf service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:04.538998 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1169/2346] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:05.454350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd297d0-bb17-48c8-b8a1-c5b6163b27aa service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:05.529381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd297d0-bb17-48c8-b8a1-c5b6163b27aa service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:05.535797 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8f1f6-6924-4e0e-b04a-318c7e9d3229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:05.536690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8f1f6-6924-4e0e-b04a-318c7e9d3229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:05.536960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8f1f6-6924-4e0e-b04a-318c7e9d3229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:05.537219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8f1f6-6924-4e0e-b04a-318c7e9d3229 admin admin] PATH_INFO: `/v3/users/3b557c98206c4d5e91b28d3d890e104d` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:05.538599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8f1f6-6924-4e0e-b04a-318c7e9d3229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b557c98206c4d5e91b28d3d890e104d)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:05.540614 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8f1f6-6924-4e0e-b04a-318c7e9d3229 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:05.572211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:05.600415 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dca8f1f6-6924-4e0e-b04a-318c7e9d3229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b557c98206c4d5e91b28d3d890e104d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:05.608557 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dca8f1f6-6924-4e0e-b04a-318c7e9d3229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b557c98206c4d5e91b28d3d890e104d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:05.609544 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dca8f1f6-6924-4e0e-b04a-318c7e9d3229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b557c98206c4d5e91b28d3d890e104d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:05.624043 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dca8f1f6-6924-4e0e-b04a-318c7e9d3229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b557c98206c4d5e91b28d3d890e104d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:05.624871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dca8f1f6-6924-4e0e-b04a-318c7e9d3229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b557c98206c4d5e91b28d3d890e104d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:05.646502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1178/2347] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:21:05 2022] DELETE /identity/v3/users/3b557c98206c4d5e91b28d3d890e104d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:05.651388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47618b3d-b8ea-4d87-8c8e-af1b43609408 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:05.651863 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47618b3d-b8ea-4d87-8c8e-af1b43609408 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:05.652121 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47618b3d-b8ea-4d87-8c8e-af1b43609408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:05.672457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-47618b3d-b8ea-4d87-8c8e-af1b43609408 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:05.673682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-47618b3d-b8ea-4d87-8c8e-af1b43609408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:05.736029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1170/2348] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:05.746022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8f1f6-6924-4e0e-b04a-318c7e9d3229 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:05.747546 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-dca8f1f6-6924-4e0e-b04a-318c7e9d3229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:05.811164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8f1f6-6924-4e0e-b04a-318c7e9d3229 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:05.815037 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ee59a-f7bd-44ab-baa7-5095eca850b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:05.815671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ee59a-f7bd-44ab-baa7-5095eca850b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:05.815965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ee59a-f7bd-44ab-baa7-5095eca850b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:05.816236 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ee59a-f7bd-44ab-baa7-5095eca850b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:05.826295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ee59a-f7bd-44ab-baa7-5095eca850b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:05.827937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ee59a-f7bd-44ab-baa7-5095eca850b3 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:05.838076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1179/2349] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:06.130441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47618b3d-b8ea-4d87-8c8e-af1b43609408 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:06.132363 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-47618b3d-b8ea-4d87-8c8e-af1b43609408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:06.147444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47618b3d-b8ea-4d87-8c8e-af1b43609408 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:06.159301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:06.160779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:06.161253 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:06.161919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] PATH_INFO: `/v3/projects/19b4f47aeaf34ddb8cff3e319168ab0d` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:06.164129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b4f47aeaf34ddb8cff3e319168ab0d)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:06.166768 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:06.228347 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b4f47aeaf34ddb8cff3e319168ab0d', 'request_id': 'req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:06.239179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b4f47aeaf34ddb8cff3e319168ab0d', 'request_id': 'req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:06.246626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b4f47aeaf34ddb8cff3e319168ab0d', 'request_id': 'req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:06.260260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] The token cache is being invalidate because project 19b4f47aeaf34ddb8cff3e319168ab0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:21:06.260557 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:06.261233 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:06.263355 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1171/2350] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:21:06 2022] DELETE /identity/v3/projects/19b4f47aeaf34ddb8cff3e319168ab0d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:06.267926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ee59a-f7bd-44ab-baa7-5095eca850b3 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:06.279555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ee59a-f7bd-44ab-baa7-5095eca850b3 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:06.287724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:06.289386 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:06.329038 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:06.368345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b3509-71c7-423d-b738-dad824bd40fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:06.369268 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b3509-71c7-423d-b738-dad824bd40fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:06.369581 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b3509-71c7-423d-b738-dad824bd40fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:06.369828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b3509-71c7-423d-b738-dad824bd40fb admin admin] PATH_INFO: `/v3/users/77d90e43e2b84f1a85edf7ac70e7fe6a` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:06.371316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b3509-71c7-423d-b738-dad824bd40fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d90e43e2b84f1a85edf7ac70e7fe6a)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:06.373560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b3509-71c7-423d-b738-dad824bd40fb admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:06.397850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450016f-c7c4-4b70-9e4c-cfa6ad24df6a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:06.406237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45186ae6-6927-4eb3-9dc9-84b06d38f0e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:06.406768 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45186ae6-6927-4eb3-9dc9-84b06d38f0e0 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:06.407120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45186ae6-6927-4eb3-9dc9-84b06d38f0e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:06.407329 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45186ae6-6927-4eb3-9dc9-84b06d38f0e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:06.409780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-45186ae6-6927-4eb3-9dc9-84b06d38f0e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:06.454845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d30b3509-71c7-423d-b738-dad824bd40fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d90e43e2b84f1a85edf7ac70e7fe6a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:06.457467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:06.473538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d30b3509-71c7-423d-b738-dad824bd40fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d90e43e2b84f1a85edf7ac70e7fe6a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:06.474978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d30b3509-71c7-423d-b738-dad824bd40fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d90e43e2b84f1a85edf7ac70e7fe6a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:06.490413 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45186ae6-6927-4eb3-9dc9-84b06d38f0e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:06.492151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45186ae6-6927-4eb3-9dc9-84b06d38f0e0 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:06.492585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d30b3509-71c7-423d-b738-dad824bd40fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d90e43e2b84f1a85edf7ac70e7fe6a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:06.493351 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d30b3509-71c7-423d-b738-dad824bd40fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d90e43e2b84f1a85edf7ac70e7fe6a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:06.502935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1172/2351] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:06.509753 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1180/2352] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:21:06 2022] DELETE /identity/v3/users/77d90e43e2b84f1a85edf7ac70e7fe6a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:06.823781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45186ae6-6927-4eb3-9dc9-84b06d38f0e0 service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:06.825260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-45186ae6-6927-4eb3-9dc9-84b06d38f0e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:06.840181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45186ae6-6927-4eb3-9dc9-84b06d38f0e0 service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:06.910787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f3617-003a-4714-afb2-e5c943108e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:06.911679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f3617-003a-4714-afb2-e5c943108e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:06.911965 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f3617-003a-4714-afb2-e5c943108e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:06.912242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f3617-003a-4714-afb2-e5c943108e41 admin admin] PATH_INFO: `/v3/projects/bf709e20f7f94ed494079440e838c7c2` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:06.913510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f3617-003a-4714-afb2-e5c943108e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf709e20f7f94ed494079440e838c7c2)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:06.915472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f3617-003a-4714-afb2-e5c943108e41 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:06.967531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-146f3617-003a-4714-afb2-e5c943108e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf709e20f7f94ed494079440e838c7c2', 'request_id': 'req-146f3617-003a-4714-afb2-e5c943108e41'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:06.977275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-146f3617-003a-4714-afb2-e5c943108e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf709e20f7f94ed494079440e838c7c2', 'request_id': 'req-146f3617-003a-4714-afb2-e5c943108e41'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:06.985730 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-146f3617-003a-4714-afb2-e5c943108e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf709e20f7f94ed494079440e838c7c2', 'request_id': 'req-146f3617-003a-4714-afb2-e5c943108e41'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:06.987100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:06.999765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-146f3617-003a-4714-afb2-e5c943108e41 admin admin] The token cache is being invalidate because project bf709e20f7f94ed494079440e838c7c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:21:07.000650 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-146f3617-003a-4714-afb2-e5c943108e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:07.001453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-146f3617-003a-4714-afb2-e5c943108e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:07.003582 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1173/2353] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:21:06 2022] DELETE /identity/v3/projects/bf709e20f7f94ed494079440e838c7c2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:07.009044 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515498-8dee-48f0-a413-a2530e881c4a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:07.009335 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515498-8dee-48f0-a413-a2530e881c4a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:07.009619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515498-8dee-48f0-a413-a2530e881c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:07.029258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a2515498-8dee-48f0-a413-a2530e881c4a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:07.030675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a2515498-8dee-48f0-a413-a2530e881c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:07.095724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1181/2354] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:07.103894 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74e083-db14-4f26-bfd6-4ca0f4ce8bbd None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:07.104163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74e083-db14-4f26-bfd6-4ca0f4ce8bbd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:07.104461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74e083-db14-4f26-bfd6-4ca0f4ce8bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:07.123128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0f74e083-db14-4f26-bfd6-4ca0f4ce8bbd None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:07.124527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0f74e083-db14-4f26-bfd6-4ca0f4ce8bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:07.133929 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1174/2355] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:07.142473 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515498-8dee-48f0-a413-a2530e881c4a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:07.152838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515498-8dee-48f0-a413-a2530e881c4a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:07.158253 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af852c9-702c-4688-8ac0-b8a667012e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:07.159027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af852c9-702c-4688-8ac0-b8a667012e7e admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:07.159391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af852c9-702c-4688-8ac0-b8a667012e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:07.159721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af852c9-702c-4688-8ac0-b8a667012e7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:07.160450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af852c9-702c-4688-8ac0-b8a667012e7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:21:07.160752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af852c9-702c-4688-8ac0-b8a667012e7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:07.162866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af852c9-702c-4688-8ac0-b8a667012e7e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:07.180861 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1182/2356] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:21:07.182348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74e083-db14-4f26-bfd6-4ca0f4ce8bbd None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:07.192780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74e083-db14-4f26-bfd6-4ca0f4ce8bbd None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:07.198018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa19660-f910-439c-be70-69ad4d221f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:07.198949 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa19660-f910-439c-be70-69ad4d221f41 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:07.199213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa19660-f910-439c-be70-69ad4d221f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:07.199497 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa19660-f910-439c-be70-69ad4d221f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:07.200297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa19660-f910-439c-be70-69ad4d221f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:07.202342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa19660-f910-439c-be70-69ad4d221f41 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:07.229719 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1175/2357] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:21:07 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:07.234512 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af852c9-702c-4688-8ac0-b8a667012e7e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:07.245791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af852c9-702c-4688-8ac0-b8a667012e7e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:07.311528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a0449-282a-4ce3-a2d2-4a658bd3f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:07.312252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a0449-282a-4ce3-a2d2-4a658bd3f5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:07.312541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a0449-282a-4ce3-a2d2-4a658bd3f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:07.312820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a0449-282a-4ce3-a2d2-4a658bd3f5c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:07.313540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a0449-282a-4ce3-a2d2-4a658bd3f5c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:07.315502 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a0449-282a-4ce3-a2d2-4a658bd3f5c7 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:07.341473 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1183/2358] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:21:07 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:07.345618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa19660-f910-439c-be70-69ad4d221f41 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:07.356833 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa19660-f910-439c-be70-69ad4d221f41 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:07.362774 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502e7a-0925-475e-8f0d-286b917d0496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:07.363454 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502e7a-0925-475e-8f0d-286b917d0496 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:07.363736 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502e7a-0925-475e-8f0d-286b917d0496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:07.364005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502e7a-0925-475e-8f0d-286b917d0496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:07.364737 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502e7a-0925-475e-8f0d-286b917d0496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:07.366310 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502e7a-0925-475e-8f0d-286b917d0496 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:07.379541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1176/2359] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:07.382213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a0449-282a-4ce3-a2d2-4a658bd3f5c7 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:07.392543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a0449-282a-4ce3-a2d2-4a658bd3f5c7 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:07.397721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d3c2b-4d5d-40c1-9a34-9c906e4d361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:07.398524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d3c2b-4d5d-40c1-9a34-9c906e4d361d admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:07.398946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d3c2b-4d5d-40c1-9a34-9c906e4d361d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:07.399296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d3c2b-4d5d-40c1-9a34-9c906e4d361d admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:07.400443 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d3c2b-4d5d-40c1-9a34-9c906e4d361d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:07.402128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d3c2b-4d5d-40c1-9a34-9c906e4d361d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:07.413661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1184/2360] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:07.418306 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502e7a-0925-475e-8f0d-286b917d0496 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:07.430484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502e7a-0925-475e-8f0d-286b917d0496 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:07.435841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422d20e-cd31-47f4-807a-36a20bdfb00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:07.436757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422d20e-cd31-47f4-807a-36a20bdfb00d admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:07.437173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422d20e-cd31-47f4-807a-36a20bdfb00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:07.437326 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422d20e-cd31-47f4-807a-36a20bdfb00d admin admin] PATH_INFO: `/v3/projects/bf2d0a64561046d79982f86c5035fc13/users/c256d7e5e8884bad9e42072a76306d18/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:07.454566 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422d20e-cd31-47f4-807a-36a20bdfb00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2d0a64561046d79982f86c5035fc13, user_id=c256d7e5e8884bad9e42072a76306d18, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:07.457688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422d20e-cd31-47f4-807a-36a20bdfb00d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:07.477699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1177/2361] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:07 2022] PUT /identity/v3/projects/bf2d0a64561046d79982f86c5035fc13/users/c256d7e5e8884bad9e42072a76306d18/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:07.488593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767efabf-b3d9-4ece-b180-428152b81420 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:07.489128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767efabf-b3d9-4ece-b180-428152b81420 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:07.489220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767efabf-b3d9-4ece-b180-428152b81420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:07.518425 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-767efabf-b3d9-4ece-b180-428152b81420 None None] MFA Rules not processed for user `c256d7e5e8884bad9e42072a76306d18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:07.519734 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-767efabf-b3d9-4ece-b180-428152b81420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:07.543193 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:07.609929 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1185/2362] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:07.615251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422d20e-cd31-47f4-807a-36a20bdfb00d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:07.685004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422d20e-cd31-47f4-807a-36a20bdfb00d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:07.690358 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb83f5c-97af-4a38-a0cb-219b60087027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:07.691077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83f5c-97af-4a38-a0cb-219b60087027 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:07.691357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83f5c-97af-4a38-a0cb-219b60087027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:07.691638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83f5c-97af-4a38-a0cb-219b60087027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:07.692343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb83f5c-97af-4a38-a0cb-219b60087027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:07.694303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb83f5c-97af-4a38-a0cb-219b60087027 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:07.723936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1178/2363] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:21:07 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:07.729356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767efabf-b3d9-4ece-b180-428152b81420 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:07.740705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767efabf-b3d9-4ece-b180-428152b81420 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:07.801937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc17ca6-ba93-403e-b8c7-c050e5d18cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:07.802668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc17ca6-ba93-403e-b8c7-c050e5d18cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:07.802977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc17ca6-ba93-403e-b8c7-c050e5d18cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:07.803255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc17ca6-ba93-403e-b8c7-c050e5d18cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:07.803984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc17ca6-ba93-403e-b8c7-c050e5d18cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:07.805934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc17ca6-ba93-403e-b8c7-c050e5d18cd7 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:07.827151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1186/2364] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:21:07 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:07.831384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb83f5c-97af-4a38-a0cb-219b60087027 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:07.842461 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb83f5c-97af-4a38-a0cb-219b60087027 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:07.851663 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8cdfa-93c0-4498-9e35-a08a41e35fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:07.852626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8cdfa-93c0-4498-9e35-a08a41e35fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:07.853438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8cdfa-93c0-4498-9e35-a08a41e35fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:07.853895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8cdfa-93c0-4498-9e35-a08a41e35fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:07.855172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8cdfa-93c0-4498-9e35-a08a41e35fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:07.857840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8cdfa-93c0-4498-9e35-a08a41e35fb1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:07.869928 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1179/2365] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:07.874300 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc17ca6-ba93-403e-b8c7-c050e5d18cd7 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:07.886211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc17ca6-ba93-403e-b8c7-c050e5d18cd7 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:07.891128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b8a60-7841-4199-a9f2-ebde6eb6ebf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:07.891936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b8a60-7841-4199-a9f2-ebde6eb6ebf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:07.892287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b8a60-7841-4199-a9f2-ebde6eb6ebf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:07.892630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b8a60-7841-4199-a9f2-ebde6eb6ebf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:07.893455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b8a60-7841-4199-a9f2-ebde6eb6ebf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:07.895255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b8a60-7841-4199-a9f2-ebde6eb6ebf3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:07.909667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1187/2366] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:07.914077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8cdfa-93c0-4498-9e35-a08a41e35fb1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:07.932393 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8cdfa-93c0-4498-9e35-a08a41e35fb1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:07.939895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eab490-3b4f-4525-bc07-8a8540b8a227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:07.941307 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab490-3b4f-4525-bc07-8a8540b8a227 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:07.941762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab490-3b4f-4525-bc07-8a8540b8a227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:07.942205 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab490-3b4f-4525-bc07-8a8540b8a227 admin admin] PATH_INFO: `/v3/projects/80f1077189cf498fade4bcbcf6f18e73/users/e9e4b30bf95d420a982b0f02031af0d0/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:07.966474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eab490-3b4f-4525-bc07-8a8540b8a227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f1077189cf498fade4bcbcf6f18e73, user_id=e9e4b30bf95d420a982b0f02031af0d0, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:07.971519 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eab490-3b4f-4525-bc07-8a8540b8a227 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:07.992783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1180/2367] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:07 2022] PUT /identity/v3/projects/80f1077189cf498fade4bcbcf6f18e73/users/e9e4b30bf95d420a982b0f02031af0d0/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:08.003608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330df0e9-185b-4072-a3dc-3e7a3dc4e2d8 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:08.003720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330df0e9-185b-4072-a3dc-3e7a3dc4e2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:08.003941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330df0e9-185b-4072-a3dc-3e7a3dc4e2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:08.034123 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-330df0e9-185b-4072-a3dc-3e7a3dc4e2d8 None None] MFA Rules not processed for user `e9e4b30bf95d420a982b0f02031af0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:08.035362 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-330df0e9-185b-4072-a3dc-3e7a3dc4e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:08.108316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1188/2368] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:08.113163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eab490-3b4f-4525-bc07-8a8540b8a227 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:08.164129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:08.186698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eab490-3b4f-4525-bc07-8a8540b8a227 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:08.191753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3428dd-7102-40b3-9d0f-99dc60927a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:08.192446 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3428dd-7102-40b3-9d0f-99dc60927a49 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:08.192694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3428dd-7102-40b3-9d0f-99dc60927a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:08.192965 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3428dd-7102-40b3-9d0f-99dc60927a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:08.193685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3428dd-7102-40b3-9d0f-99dc60927a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:08.195617 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3428dd-7102-40b3-9d0f-99dc60927a49 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:08.226568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1181/2369] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:21:08 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:08.231562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330df0e9-185b-4072-a3dc-3e7a3dc4e2d8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:08.243717 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330df0e9-185b-4072-a3dc-3e7a3dc4e2d8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:08.279694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:08.313199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c9c9f-2ceb-4d52-8fb0-78a571bc7643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:08.313873 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c9c9f-2ceb-4d52-8fb0-78a571bc7643 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:08.314339 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c9c9f-2ceb-4d52-8fb0-78a571bc7643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:08.314839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c9c9f-2ceb-4d52-8fb0-78a571bc7643 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:08.315563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c9c9f-2ceb-4d52-8fb0-78a571bc7643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:08.317518 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c9c9f-2ceb-4d52-8fb0-78a571bc7643 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:08.346422 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1189/2370] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:21:08 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:21:08.348182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3428dd-7102-40b3-9d0f-99dc60927a49 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:08.361912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3428dd-7102-40b3-9d0f-99dc60927a49 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:08.369189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f413bf3-6d34-4003-9fe6-d1c43f40d4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:08.370207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f413bf3-6d34-4003-9fe6-d1c43f40d4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:08.370489 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f413bf3-6d34-4003-9fe6-d1c43f40d4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:08.370790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f413bf3-6d34-4003-9fe6-d1c43f40d4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:08.371523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f413bf3-6d34-4003-9fe6-d1c43f40d4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:08.373357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f413bf3-6d34-4003-9fe6-d1c43f40d4b4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:08.384899 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1182/2371] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:08.390073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c9c9f-2ceb-4d52-8fb0-78a571bc7643 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:08.401541 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c9c9f-2ceb-4d52-8fb0-78a571bc7643 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:08.407061 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb73d17-ed02-4262-bdf9-d9ca607dd86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:08.407958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb73d17-ed02-4262-bdf9-d9ca607dd86d admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:08.408270 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb73d17-ed02-4262-bdf9-d9ca607dd86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:08.408539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb73d17-ed02-4262-bdf9-d9ca607dd86d admin admin] PATH_INFO: `/v3/projects/7cfa32dccfaf4029a75d8005bddb331f/users/438b99634beb4f51a63e59cb96838fc2/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:08.426390 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb73d17-ed02-4262-bdf9-d9ca607dd86d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfa32dccfaf4029a75d8005bddb331f, user_id=438b99634beb4f51a63e59cb96838fc2, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:08.429062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb73d17-ed02-4262-bdf9-d9ca607dd86d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:08.444069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1190/2372] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:08 2022] PUT /identity/v3/projects/7cfa32dccfaf4029a75d8005bddb331f/users/438b99634beb4f51a63e59cb96838fc2/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:08.448702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f413bf3-6d34-4003-9fe6-d1c43f40d4b4 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:08.462390 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f413bf3-6d34-4003-9fe6-d1c43f40d4b4 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:08.528578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8511158-6f95-4430-8f97-618f46ea54a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:08.529463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8511158-6f95-4430-8f97-618f46ea54a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:08.529824 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8511158-6f95-4430-8f97-618f46ea54a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:08.530166 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8511158-6f95-4430-8f97-618f46ea54a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:08.531154 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8511158-6f95-4430-8f97-618f46ea54a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:08.533450 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8511158-6f95-4430-8f97-618f46ea54a2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:08.548226 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1183/2373] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:08.552584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb73d17-ed02-4262-bdf9-d9ca607dd86d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:08.565490 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb73d17-ed02-4262-bdf9-d9ca607dd86d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:08.573833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c9ae3-66bc-4f5c-b982-e50b9be17e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:08.575344 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c9ae3-66bc-4f5c-b982-e50b9be17e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:08.575875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c9ae3-66bc-4f5c-b982-e50b9be17e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:08.576232 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c9ae3-66bc-4f5c-b982-e50b9be17e44 admin admin] PATH_INFO: `/v3/projects/7cfa32dccfaf4029a75d8005bddb331f/users/438b99634beb4f51a63e59cb96838fc2/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:08.578972 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c9ae3-66bc-4f5c-b982-e50b9be17e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfa32dccfaf4029a75d8005bddb331f, user_id=438b99634beb4f51a63e59cb96838fc2, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:08.582242 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c9ae3-66bc-4f5c-b982-e50b9be17e44 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:08.595742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1191/2374] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:08 2022] PUT /identity/v3/projects/7cfa32dccfaf4029a75d8005bddb331f/users/438b99634beb4f51a63e59cb96838fc2/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:08.607844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b14fa1-1c46-4a28-9610-9ea3cf2187d9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:08.608344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b14fa1-1c46-4a28-9610-9ea3cf2187d9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:08.608732 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b14fa1-1c46-4a28-9610-9ea3cf2187d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:08.645645 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-50b14fa1-1c46-4a28-9610-9ea3cf2187d9 None None] MFA Rules not processed for user `438b99634beb4f51a63e59cb96838fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:08.647029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-50b14fa1-1c46-4a28-9610-9ea3cf2187d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:08.730274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1184/2375] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:08.743262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c9ae3-66bc-4f5c-b982-e50b9be17e44 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:08.745423 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-789c9ae3-66bc-4f5c-b982-e50b9be17e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:08.810691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c9ae3-66bc-4f5c-b982-e50b9be17e44 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:08.814503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feef95-701f-4937-bc09-6820a64ec3af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:08.815200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feef95-701f-4937-bc09-6820a64ec3af service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:08.815483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feef95-701f-4937-bc09-6820a64ec3af service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:08.815760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feef95-701f-4937-bc09-6820a64ec3af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:08.825508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10feef95-701f-4937-bc09-6820a64ec3af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:08.827948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10feef95-701f-4937-bc09-6820a64ec3af service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:08.838542 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1192/2376] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:08.918927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b14fa1-1c46-4a28-9610-9ea3cf2187d9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:08.929921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b14fa1-1c46-4a28-9610-9ea3cf2187d9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:08.933823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12814a54-8c23-4d59-9553-362d95bd524e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:08.934474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814a54-8c23-4d59-9553-362d95bd524e service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:08.934790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814a54-8c23-4d59-9553-362d95bd524e service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:08.935066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814a54-8c23-4d59-9553-362d95bd524e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:08.969898 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:09.001859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12814a54-8c23-4d59-9553-362d95bd524e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:09.003377 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12814a54-8c23-4d59-9553-362d95bd524e service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:09.013607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1185/2377] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:09.180469 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feef95-701f-4937-bc09-6820a64ec3af service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:09.182055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-10feef95-701f-4937-bc09-6820a64ec3af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:09.271032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feef95-701f-4937-bc09-6820a64ec3af service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:09.276517 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74a968-8acb-472c-8fc9-d32e8329e0c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:09.277224 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74a968-8acb-472c-8fc9-d32e8329e0c5 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:09.277625 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74a968-8acb-472c-8fc9-d32e8329e0c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:09.277845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74a968-8acb-472c-8fc9-d32e8329e0c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:09.280611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3b74a968-8acb-472c-8fc9-d32e8329e0c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:09.306256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:09.403768 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74a968-8acb-472c-8fc9-d32e8329e0c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:09.405643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74a968-8acb-472c-8fc9-d32e8329e0c5 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:09.424713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1193/2378] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:12.117790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12814a54-8c23-4d59-9553-362d95bd524e service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:12.190600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12814a54-8c23-4d59-9553-362d95bd524e service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:12.196849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c0861-f7dd-4b45-abab-254352b89be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:12.198120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0861-f7dd-4b45-abab-254352b89be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:12.198519 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0861-f7dd-4b45-abab-254352b89be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:12.198914 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0861-f7dd-4b45-abab-254352b89be4 admin admin] PATH_INFO: `/v3/users/c256d7e5e8884bad9e42072a76306d18` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:12.200623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c0861-f7dd-4b45-abab-254352b89be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c256d7e5e8884bad9e42072a76306d18)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:12.203708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c0861-f7dd-4b45-abab-254352b89be4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:12.260469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1f7c0861-f7dd-4b45-abab-254352b89be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c256d7e5e8884bad9e42072a76306d18'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:12.261203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1f7c0861-f7dd-4b45-abab-254352b89be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c256d7e5e8884bad9e42072a76306d18'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:12.273474 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1f7c0861-f7dd-4b45-abab-254352b89be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c256d7e5e8884bad9e42072a76306d18'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:12.280357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1f7c0861-f7dd-4b45-abab-254352b89be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c256d7e5e8884bad9e42072a76306d18'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:12.281178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1f7c0861-f7dd-4b45-abab-254352b89be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c256d7e5e8884bad9e42072a76306d18'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:12.295965 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1186/2379] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:21:12 2022] DELETE /identity/v3/users/c256d7e5e8884bad9e42072a76306d18 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:12.300702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3555524-6596-4a5b-b3f4-d70c96dab2dc None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:12.301217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3555524-6596-4a5b-b3f4-d70c96dab2dc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:12.301217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3555524-6596-4a5b-b3f4-d70c96dab2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:12.319241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d3555524-6596-4a5b-b3f4-d70c96dab2dc None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:12.320438 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d3555524-6596-4a5b-b3f4-d70c96dab2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:12.384472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1194/2380] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:12.395258 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c0861-f7dd-4b45-abab-254352b89be4 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:12.397478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1f7c0861-f7dd-4b45-abab-254352b89be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:12.478478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c0861-f7dd-4b45-abab-254352b89be4 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:12.482501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5514dac-6c7c-4dac-993e-507c563ad00c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:12.483199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5514dac-6c7c-4dac-993e-507c563ad00c service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:12.483478 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5514dac-6c7c-4dac-993e-507c563ad00c service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:12.483749 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5514dac-6c7c-4dac-993e-507c563ad00c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:12.491430 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:12.494438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5514dac-6c7c-4dac-993e-507c563ad00c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:12.496174 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5514dac-6c7c-4dac-993e-507c563ad00c service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:12.508553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1187/2381] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:12.809442 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3555524-6596-4a5b-b3f4-d70c96dab2dc None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:12.811918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d3555524-6596-4a5b-b3f4-d70c96dab2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:12.835181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3555524-6596-4a5b-b3f4-d70c96dab2dc None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:12.841903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:12.842854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:12.843131 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:12.843479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] PATH_INFO: `/v3/projects/bf2d0a64561046d79982f86c5035fc13` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:12.844837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2d0a64561046d79982f86c5035fc13)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:12.847312 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:12.900987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2d0a64561046d79982f86c5035fc13', 'request_id': 'req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:12.909782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2d0a64561046d79982f86c5035fc13', 'request_id': 'req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:12.916653 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2d0a64561046d79982f86c5035fc13', 'request_id': 'req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:12.928343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] The token cache is being invalidate because project bf2d0a64561046d79982f86c5035fc13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:21:12.928633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:12.929416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:12.931609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1195/2382] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:21:12 2022] DELETE /identity/v3/projects/bf2d0a64561046d79982f86c5035fc13 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:12.935724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5514dac-6c7c-4dac-993e-507c563ad00c service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:12.946868 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5514dac-6c7c-4dac-993e-507c563ad00c service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:13.013616 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055c5e0-bcb0-4c4a-b360-6126227c5357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:13.015082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055c5e0-bcb0-4c4a-b360-6126227c5357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:13.015402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055c5e0-bcb0-4c4a-b360-6126227c5357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:13.015685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055c5e0-bcb0-4c4a-b360-6126227c5357 admin admin] PATH_INFO: `/v3/users/e9e4b30bf95d420a982b0f02031af0d0` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:13.016968 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055c5e0-bcb0-4c4a-b360-6126227c5357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e4b30bf95d420a982b0f02031af0d0)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:13.018956 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055c5e0-bcb0-4c4a-b360-6126227c5357 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:13.074134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1055c5e0-bcb0-4c4a-b360-6126227c5357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e4b30bf95d420a982b0f02031af0d0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.074936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1055c5e0-bcb0-4c4a-b360-6126227c5357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e4b30bf95d420a982b0f02031af0d0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.088176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1055c5e0-bcb0-4c4a-b360-6126227c5357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e4b30bf95d420a982b0f02031af0d0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.097722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1055c5e0-bcb0-4c4a-b360-6126227c5357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e4b30bf95d420a982b0f02031af0d0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.098443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1055c5e0-bcb0-4c4a-b360-6126227c5357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e4b30bf95d420a982b0f02031af0d0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.113210 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1188/2383] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:21:12 2022] DELETE /identity/v3/users/e9e4b30bf95d420a982b0f02031af0d0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:13.435221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:13.437124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:13.452070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c48ba7-e6ae-4ad7-abb8-74e552dddc65 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:13.497862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:13.514918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:13.516332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:13.516608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:13.516888 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] PATH_INFO: `/v3/projects/80f1077189cf498fade4bcbcf6f18e73` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:13.518137 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f1077189cf498fade4bcbcf6f18e73)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:13.520097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:13.571735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f1077189cf498fade4bcbcf6f18e73', 'request_id': 'req-1b795089-26bd-4ee2-bb88-cd1c4db74852'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.583467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f1077189cf498fade4bcbcf6f18e73', 'request_id': 'req-1b795089-26bd-4ee2-bb88-cd1c4db74852'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.590646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f1077189cf498fade4bcbcf6f18e73', 'request_id': 'req-1b795089-26bd-4ee2-bb88-cd1c4db74852'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.605624 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] The token cache is being invalidate because project 80f1077189cf498fade4bcbcf6f18e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:21:13.605915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.606620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.608277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1196/2384] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:21:13 2022] DELETE /identity/v3/projects/80f1077189cf498fade4bcbcf6f18e73 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:13.612549 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055c5e0-bcb0-4c4a-b360-6126227c5357 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:13.614120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1055c5e0-bcb0-4c4a-b360-6126227c5357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:13.632530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055c5e0-bcb0-4c4a-b360-6126227c5357 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:13.707173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf037bc-df18-4718-af90-6b3ccac65ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:13.708558 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf037bc-df18-4718-af90-6b3ccac65ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:13.708931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf037bc-df18-4718-af90-6b3ccac65ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:13.709343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf037bc-df18-4718-af90-6b3ccac65ecc admin admin] PATH_INFO: `/v3/users/438b99634beb4f51a63e59cb96838fc2` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:13.710917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf037bc-df18-4718-af90-6b3ccac65ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=438b99634beb4f51a63e59cb96838fc2)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:13.713948 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf037bc-df18-4718-af90-6b3ccac65ecc admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:13.731812 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:13.773049 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-aaf037bc-df18-4718-af90-6b3ccac65ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '438b99634beb4f51a63e59cb96838fc2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.773890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-aaf037bc-df18-4718-af90-6b3ccac65ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '438b99634beb4f51a63e59cb96838fc2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.791105 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-aaf037bc-df18-4718-af90-6b3ccac65ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '438b99634beb4f51a63e59cb96838fc2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.803624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-aaf037bc-df18-4718-af90-6b3ccac65ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '438b99634beb4f51a63e59cb96838fc2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.804567 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-aaf037bc-df18-4718-af90-6b3ccac65ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '438b99634beb4f51a63e59cb96838fc2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:13.822701 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1189/2385] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:21:13 2022] DELETE /identity/v3/users/438b99634beb4f51a63e59cb96838fc2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:14.146022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:14.149779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:14.180376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b795089-26bd-4ee2-bb88-cd1c4db74852 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:14.267565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f3412-6e7b-4198-b60d-cfcd05084ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:14.268397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f3412-6e7b-4198-b60d-cfcd05084ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:14.268695 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f3412-6e7b-4198-b60d-cfcd05084ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:14.269007 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f3412-6e7b-4198-b60d-cfcd05084ef9 admin admin] PATH_INFO: `/v3/projects/7cfa32dccfaf4029a75d8005bddb331f` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:14.270294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f3412-6e7b-4198-b60d-cfcd05084ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cfa32dccfaf4029a75d8005bddb331f)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:14.272306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f3412-6e7b-4198-b60d-cfcd05084ef9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:14.335784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-481f3412-6e7b-4198-b60d-cfcd05084ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cfa32dccfaf4029a75d8005bddb331f', 'request_id': 'req-481f3412-6e7b-4198-b60d-cfcd05084ef9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:14.344684 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-481f3412-6e7b-4198-b60d-cfcd05084ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cfa32dccfaf4029a75d8005bddb331f', 'request_id': 'req-481f3412-6e7b-4198-b60d-cfcd05084ef9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:14.351955 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-481f3412-6e7b-4198-b60d-cfcd05084ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cfa32dccfaf4029a75d8005bddb331f', 'request_id': 'req-481f3412-6e7b-4198-b60d-cfcd05084ef9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:14.364857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-481f3412-6e7b-4198-b60d-cfcd05084ef9 admin admin] The token cache is being invalidate because project 7cfa32dccfaf4029a75d8005bddb331f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:21:14.364857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-481f3412-6e7b-4198-b60d-cfcd05084ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:14.365736 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-481f3412-6e7b-4198-b60d-cfcd05084ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:14.367736 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1197/2386] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:21:14 2022] DELETE /identity/v3/projects/7cfa32dccfaf4029a75d8005bddb331f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:21:14.373982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe9dbd-c8a1-4cfb-b6ef-3ff57c148f7c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:14.374361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe9dbd-c8a1-4cfb-b6ef-3ff57c148f7c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:14.374849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe9dbd-c8a1-4cfb-b6ef-3ff57c148f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:14.396862 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e6fe9dbd-c8a1-4cfb-b6ef-3ff57c148f7c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:14.398754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e6fe9dbd-c8a1-4cfb-b6ef-3ff57c148f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:14.483222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1190/2387] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:14.492592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778c58a-8656-40ad-8c72-90f71eb08d98 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:14.493195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778c58a-8656-40ad-8c72-90f71eb08d98 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:14.493195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778c58a-8656-40ad-8c72-90f71eb08d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:14.502288 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:14.515132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8778c58a-8656-40ad-8c72-90f71eb08d98 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:14.517418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8778c58a-8656-40ad-8c72-90f71eb08d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:14.526522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1198/2388] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:14.531181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe9dbd-c8a1-4cfb-b6ef-3ff57c148f7c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:14.542245 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe9dbd-c8a1-4cfb-b6ef-3ff57c148f7c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:14.548753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c174b-1675-4952-a38f-b73504a1122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:14.549908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c174b-1675-4952-a38f-b73504a1122d admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:14.549908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c174b-1675-4952-a38f-b73504a1122d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:14.550181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c174b-1675-4952-a38f-b73504a1122d admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:14.550743 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c174b-1675-4952-a38f-b73504a1122d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:21:14.551224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c174b-1675-4952-a38f-b73504a1122d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:14.557071 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c174b-1675-4952-a38f-b73504a1122d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:14.583970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1191/2389] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:21:14.590346 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778c58a-8656-40ad-8c72-90f71eb08d98 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:14.618455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778c58a-8656-40ad-8c72-90f71eb08d98 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:14.624097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bc7a5-11f8-4609-af96-77d051848585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:14.624861 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc7a5-11f8-4609-af96-77d051848585 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:14.625201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc7a5-11f8-4609-af96-77d051848585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:14.625482 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc7a5-11f8-4609-af96-77d051848585 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:14.626247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bc7a5-11f8-4609-af96-77d051848585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:14.628288 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bc7a5-11f8-4609-af96-77d051848585 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:14.665981 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1199/2390] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:21:14 2022] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:14.672404 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c174b-1675-4952-a38f-b73504a1122d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:14.683633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c174b-1675-4952-a38f-b73504a1122d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:14.768832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31f02c-03a4-4dcc-a293-bf04c06580e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:14.769546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31f02c-03a4-4dcc-a293-bf04c06580e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:14.769856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31f02c-03a4-4dcc-a293-bf04c06580e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:14.770340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31f02c-03a4-4dcc-a293-bf04c06580e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:14.771164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31f02c-03a4-4dcc-a293-bf04c06580e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:14.773537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31f02c-03a4-4dcc-a293-bf04c06580e1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:14.809596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1192/2391] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:21:14 2022] POST /identity/v3/users => generated 283 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:21:14.814976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bc7a5-11f8-4609-af96-77d051848585 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:14.834528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bc7a5-11f8-4609-af96-77d051848585 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:14.843320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79954330-5d6a-4c65-bab3-c9bfd13480f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:14.844720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79954330-5d6a-4c65-bab3-c9bfd13480f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:14.845302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79954330-5d6a-4c65-bab3-c9bfd13480f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:14.845800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79954330-5d6a-4c65-bab3-c9bfd13480f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:14.847419 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79954330-5d6a-4c65-bab3-c9bfd13480f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:14.850698 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79954330-5d6a-4c65-bab3-c9bfd13480f0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:14.872731 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1200/2392] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:14.876995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31f02c-03a4-4dcc-a293-bf04c06580e1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:14.896369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31f02c-03a4-4dcc-a293-bf04c06580e1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:14.904765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ca9da-0c85-4139-a6c6-b8711512e259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:14.906108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ca9da-0c85-4139-a6c6-b8711512e259 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:14.906515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ca9da-0c85-4139-a6c6-b8711512e259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:14.907132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ca9da-0c85-4139-a6c6-b8711512e259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:14.908460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ca9da-0c85-4139-a6c6-b8711512e259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:14.911182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ca9da-0c85-4139-a6c6-b8711512e259 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:14.923293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:14.935479 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1193/2393] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:21:14.939182 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79954330-5d6a-4c65-bab3-c9bfd13480f0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:14.963680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79954330-5d6a-4c65-bab3-c9bfd13480f0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:14.974859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5d5cf-b587-4850-ab3f-09ffdac68046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:14.976580 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5d5cf-b587-4850-ab3f-09ffdac68046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:14.977198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5d5cf-b587-4850-ab3f-09ffdac68046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:14.978866 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5d5cf-b587-4850-ab3f-09ffdac68046 admin admin] PATH_INFO: `/v3/projects/fe21201961144a89be0dc3854ded0a2a/users/de7d2986100c481eb36f1782f4c30528/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:15.003430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5d5cf-b587-4850-ab3f-09ffdac68046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe21201961144a89be0dc3854ded0a2a, user_id=de7d2986100c481eb36f1782f4c30528, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:15.006297 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5d5cf-b587-4850-ab3f-09ffdac68046 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:15.029120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1201/2394] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:14 2022] PUT /identity/v3/projects/fe21201961144a89be0dc3854ded0a2a/users/de7d2986100c481eb36f1782f4c30528/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:15.043158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342f8f2-13ed-4a35-9452-a45e4e08c585 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:15.043949 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342f8f2-13ed-4a35-9452-a45e4e08c585 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:15.044523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342f8f2-13ed-4a35-9452-a45e4e08c585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:15.086636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5342f8f2-13ed-4a35-9452-a45e4e08c585 None None] MFA Rules not processed for user `de7d2986100c481eb36f1782f4c30528`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:15.088543 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5342f8f2-13ed-4a35-9452-a45e4e08c585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:15.200376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1194/2395] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:15.214158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5d5cf-b587-4850-ab3f-09ffdac68046 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:15.217263 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-eae5d5cf-b587-4850-ab3f-09ffdac68046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:15.317768 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5d5cf-b587-4850-ab3f-09ffdac68046 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:15.322820 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c380a-a1c1-4516-8874-755aca09b7df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10611bf25b9e4604ad769a6902f7f457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:15.323968 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c380a-a1c1-4516-8874-755aca09b7df service glance] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:15.324250 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c380a-a1c1-4516-8874-755aca09b7df service glance] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:15.324558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c380a-a1c1-4516-8874-755aca09b7df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:15.335032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c380a-a1c1-4516-8874-755aca09b7df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:15.336503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c380a-a1c1-4516-8874-755aca09b7df service glance] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:15.347417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1202/2396] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:19.986521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342f8f2-13ed-4a35-9452-a45e4e08c585 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:19.988125 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5342f8f2-13ed-4a35-9452-a45e4e08c585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:20.062602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342f8f2-13ed-4a35-9452-a45e4e08c585 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:20.066530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc5b52-ccd9-436a-8a37-52d99a82550e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:20.067246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5b52-ccd9-436a-8a37-52d99a82550e service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:20.067529 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5b52-ccd9-436a-8a37-52d99a82550e service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:20.067807 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5b52-ccd9-436a-8a37-52d99a82550e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:20.069744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-43bc5b52-ccd9-436a-8a37-52d99a82550e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:20.080375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc5b52-ccd9-436a-8a37-52d99a82550e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:20.081857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc5b52-ccd9-436a-8a37-52d99a82550e service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:20.091224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1195/2397] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:22.689627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c380a-a1c1-4516-8874-755aca09b7df service glance] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:22.691460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-691c380a-a1c1-4516-8874-755aca09b7df service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:22.704025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c380a-a1c1-4516-8874-755aca09b7df service glance] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:22.707847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16344182-bf5f-415e-abb4-f1451f59c954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:22.708494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16344182-bf5f-415e-abb4-f1451f59c954 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:22.708773 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16344182-bf5f-415e-abb4-f1451f59c954 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:22.709050 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16344182-bf5f-415e-abb4-f1451f59c954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:22.711016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-16344182-bf5f-415e-abb4-f1451f59c954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:22.778045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16344182-bf5f-415e-abb4-f1451f59c954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:22.779518 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16344182-bf5f-415e-abb4-f1451f59c954 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:22.789703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1203/2398] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:23.115897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc5b52-ccd9-436a-8a37-52d99a82550e service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:23.126702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc5b52-ccd9-436a-8a37-52d99a82550e service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:23.131132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a6b1a-b898-4e3f-8403-2282f42b552b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:23.131802 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6b1a-b898-4e3f-8403-2282f42b552b service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:23.132088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6b1a-b898-4e3f-8403-2282f42b552b service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:23.132367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6b1a-b898-4e3f-8403-2282f42b552b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:23.134244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c44a6b1a-b898-4e3f-8403-2282f42b552b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:23.144453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a6b1a-b898-4e3f-8403-2282f42b552b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:23.145900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a6b1a-b898-4e3f-8403-2282f42b552b service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:23.154433 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1196/2399] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:21:23.486779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16344182-bf5f-415e-abb4-f1451f59c954 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:23.488461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-16344182-bf5f-415e-abb4-f1451f59c954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:23.533481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:23.571412 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16344182-bf5f-415e-abb4-f1451f59c954 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:23.580055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dedef3-03cf-4bd1-8018-a31d750d8465 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06c172bcd99f469f83728c98d061a7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:23.580490 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dedef3-03cf-4bd1-8018-a31d750d8465 service placement] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:23.580724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dedef3-03cf-4bd1-8018-a31d750d8465 service placement] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:23.581189 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dedef3-03cf-4bd1-8018-a31d750d8465 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:23.583916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-48dedef3-03cf-4bd1-8018-a31d750d8465 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:23.611166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dedef3-03cf-4bd1-8018-a31d750d8465 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:23.614193 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dedef3-03cf-4bd1-8018-a31d750d8465 service placement] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:23.635922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1204/2400] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:24.985973 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a6b1a-b898-4e3f-8403-2282f42b552b service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:24.994602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a6b1a-b898-4e3f-8403-2282f42b552b service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:24.998260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21777f7-21fe-430b-a518-ea566311d278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:24.999287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21777f7-21fe-430b-a518-ea566311d278 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:24.999572 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21777f7-21fe-430b-a518-ea566311d278 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:24.999849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21777f7-21fe-430b-a518-ea566311d278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:25.001761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a21777f7-21fe-430b-a518-ea566311d278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:25.015304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21777f7-21fe-430b-a518-ea566311d278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:25.016754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21777f7-21fe-430b-a518-ea566311d278 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:25.027984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1197/2401] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:28.084769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dedef3-03cf-4bd1-8018-a31d750d8465 service placement] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:28.086275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-48dedef3-03cf-4bd1-8018-a31d750d8465 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:28.103952 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dedef3-03cf-4bd1-8018-a31d750d8465 service placement] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:28.109002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8f498-55f8-41fa-9e37-73a58dde7275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:28.110006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8f498-55f8-41fa-9e37-73a58dde7275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:28.110442 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8f498-55f8-41fa-9e37-73a58dde7275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:28.110842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8f498-55f8-41fa-9e37-73a58dde7275 admin admin] PATH_INFO: `/v3/users/2b092b666ad84405a6ed07827fcd8a87` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:28.112174 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8f498-55f8-41fa-9e37-73a58dde7275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b092b666ad84405a6ed07827fcd8a87)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:28.114266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8f498-55f8-41fa-9e37-73a58dde7275 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:28.165572 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ecb8f498-55f8-41fa-9e37-73a58dde7275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b092b666ad84405a6ed07827fcd8a87'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:28.173036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ecb8f498-55f8-41fa-9e37-73a58dde7275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b092b666ad84405a6ed07827fcd8a87'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:28.173748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ecb8f498-55f8-41fa-9e37-73a58dde7275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b092b666ad84405a6ed07827fcd8a87'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:28.188534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ecb8f498-55f8-41fa-9e37-73a58dde7275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b092b666ad84405a6ed07827fcd8a87'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:28.189411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ecb8f498-55f8-41fa-9e37-73a58dde7275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b092b666ad84405a6ed07827fcd8a87'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:28.204826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1205/2402] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:21:28 2022] DELETE /identity/v3/users/2b092b666ad84405a6ed07827fcd8a87 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:28.424378 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21777f7-21fe-430b-a518-ea566311d278 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:28.434791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21777f7-21fe-430b-a518-ea566311d278 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:28.539021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787407b8-67b4-4ece-bbfb-747633cff51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:28.540531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787407b8-67b4-4ece-bbfb-747633cff51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:28.541042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787407b8-67b4-4ece-bbfb-747633cff51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:28.541560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787407b8-67b4-4ece-bbfb-747633cff51e admin admin] PATH_INFO: `/v3/projects/c9e53a28bd134bceb81cf364b7f1b7d6` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:28.543211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787407b8-67b4-4ece-bbfb-747633cff51e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e53a28bd134bceb81cf364b7f1b7d6)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:28.546047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787407b8-67b4-4ece-bbfb-747633cff51e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:28.556125 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:28.609986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-787407b8-67b4-4ece-bbfb-747633cff51e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e53a28bd134bceb81cf364b7f1b7d6', 'request_id': 'req-787407b8-67b4-4ece-bbfb-747633cff51e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:28.625695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-787407b8-67b4-4ece-bbfb-747633cff51e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e53a28bd134bceb81cf364b7f1b7d6', 'request_id': 'req-787407b8-67b4-4ece-bbfb-747633cff51e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:28.638135 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-787407b8-67b4-4ece-bbfb-747633cff51e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e53a28bd134bceb81cf364b7f1b7d6', 'request_id': 'req-787407b8-67b4-4ece-bbfb-747633cff51e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:28.666614 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-787407b8-67b4-4ece-bbfb-747633cff51e admin admin] The token cache is being invalidate because project c9e53a28bd134bceb81cf364b7f1b7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:21:28.667081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-787407b8-67b4-4ece-bbfb-747633cff51e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:28.667919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-787407b8-67b4-4ece-bbfb-747633cff51e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:28.675524 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1198/2403] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:21:28 2022] DELETE /identity/v3/projects/c9e53a28bd134bceb81cf364b7f1b7d6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:28.677723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbe387-58bb-4326-a1f7-6d4084e6de3e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:28.677856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbe387-58bb-4326-a1f7-6d4084e6de3e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:28.678133 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbe387-58bb-4326-a1f7-6d4084e6de3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:28.723489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-68fbe387-58bb-4326-a1f7-6d4084e6de3e None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:28.724752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-68fbe387-58bb-4326-a1f7-6d4084e6de3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:28.980335 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1206/2404] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:28.987024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea64fe-3a48-4e67-b0f4-5fe8c74f281f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:28.987363 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea64fe-3a48-4e67-b0f4-5fe8c74f281f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:28.988141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea64fe-3a48-4e67-b0f4-5fe8c74f281f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.014480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbe387-58bb-4326-a1f7-6d4084e6de3e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:29.017139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-68fbe387-58bb-4326-a1f7-6d4084e6de3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:29.045778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e9ea64fe-3a48-4e67-b0f4-5fe8c74f281f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:29.047629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbe387-58bb-4326-a1f7-6d4084e6de3e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:29.048573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e9ea64fe-3a48-4e67-b0f4-5fe8c74f281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:29.052333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d420b-1972-4202-bd3d-747926523fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:29.053364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d420b-1972-4202-bd3d-747926523fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.053646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d420b-1972-4202-bd3d-747926523fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.066194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d420b-1972-4202-bd3d-747926523fe7 admin admin] PATH_INFO: `/v3/users/491d61d97e114e5988bab922a0f366bc` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.077426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d420b-1972-4202-bd3d-747926523fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=491d61d97e114e5988bab922a0f366bc)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:29.077797 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1199/2405] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:29.077797 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea64fe-3a48-4e67-b0f4-5fe8c74f281f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:29.077997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d420b-1972-4202-bd3d-747926523fe7 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:29.088931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea64fe-3a48-4e67-b0f4-5fe8c74f281f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:29.110740 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad7489-b076-4818-b486-8e1475bd78e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:29.111662 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad7489-b076-4818-b486-8e1475bd78e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.112104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad7489-b076-4818-b486-8e1475bd78e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.112482 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad7489-b076-4818-b486-8e1475bd78e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.113477 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad7489-b076-4818-b486-8e1475bd78e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:21:29.113982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad7489-b076-4818-b486-8e1475bd78e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:29.116394 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad7489-b076-4818-b486-8e1475bd78e2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:29.136837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:29.142985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1200/2406] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:21:29.145457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad7489-b076-4818-b486-8e1475bd78e2 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:29.157098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0c8d420b-1972-4202-bd3d-747926523fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491d61d97e114e5988bab922a0f366bc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:29.168067 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0c8d420b-1972-4202-bd3d-747926523fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491d61d97e114e5988bab922a0f366bc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:29.169341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0c8d420b-1972-4202-bd3d-747926523fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491d61d97e114e5988bab922a0f366bc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:29.169480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad7489-b076-4818-b486-8e1475bd78e2 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:29.185890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8e5c7-83e5-4cf4-9d36-f08184943d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:29.186790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8e5c7-83e5-4cf4-9d36-f08184943d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.187265 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8e5c7-83e5-4cf4-9d36-f08184943d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.187466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8e5c7-83e5-4cf4-9d36-f08184943d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.188111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8e5c7-83e5-4cf4-9d36-f08184943d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:29.190361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8e5c7-83e5-4cf4-9d36-f08184943d08 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:29.190977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0c8d420b-1972-4202-bd3d-747926523fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491d61d97e114e5988bab922a0f366bc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:29.191725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0c8d420b-1972-4202-bd3d-747926523fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491d61d97e114e5988bab922a0f366bc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:29.209834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1207/2407] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:21:29 2022] DELETE /identity/v3/users/491d61d97e114e5988bab922a0f366bc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:29.230810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1201/2408] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:21:29 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:29.233133 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d420b-1972-4202-bd3d-747926523fe7 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:29.235035 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0c8d420b-1972-4202-bd3d-747926523fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:29.315854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d420b-1972-4202-bd3d-747926523fe7 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:29.383735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc3fa7-ddb6-488e-9260-097648489c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:29.384622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc3fa7-ddb6-488e-9260-097648489c47 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.384816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc3fa7-ddb6-488e-9260-097648489c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.385080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc3fa7-ddb6-488e-9260-097648489c47 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.385856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc3fa7-ddb6-488e-9260-097648489c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:29.387974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc3fa7-ddb6-488e-9260-097648489c47 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:29.411705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8e5c7-83e5-4cf4-9d36-f08184943d08 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:29.414191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-87e8e5c7-83e5-4cf4-9d36-f08184943d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:29.414863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1208/2409] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:21:29 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:21:29.416566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc3fa7-ddb6-488e-9260-097648489c47 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:29.428616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc3fa7-ddb6-488e-9260-097648489c47 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:29.432896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8e5c7-83e5-4cf4-9d36-f08184943d08 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:29.435372 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0bbae-54b8-4017-9b0d-f74d7b360514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:29.436248 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0bbae-54b8-4017-9b0d-f74d7b360514 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.436596 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0bbae-54b8-4017-9b0d-f74d7b360514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.436875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0bbae-54b8-4017-9b0d-f74d7b360514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.437622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0bbae-54b8-4017-9b0d-f74d7b360514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:29.439929 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0bbae-54b8-4017-9b0d-f74d7b360514 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:29.448287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18326d06-f2d0-4e4f-bc07-69d63a2f935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:29.449441 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326d06-f2d0-4e4f-bc07-69d63a2f935a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.449868 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326d06-f2d0-4e4f-bc07-69d63a2f935a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.450332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326d06-f2d0-4e4f-bc07-69d63a2f935a admin admin] PATH_INFO: `/v3/projects/a3468bc2f0694b9ba4fcfbf5b68bda94` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.451712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18326d06-f2d0-4e4f-bc07-69d63a2f935a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3468bc2f0694b9ba4fcfbf5b68bda94)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:29.453724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18326d06-f2d0-4e4f-bc07-69d63a2f935a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:29.462167 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1209/2410] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:21:29.467616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0bbae-54b8-4017-9b0d-f74d7b360514 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:29.479237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0bbae-54b8-4017-9b0d-f74d7b360514 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:29.484186 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987a394-1cbf-4f8d-b3aa-0a38e2574fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:29.485104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987a394-1cbf-4f8d-b3aa-0a38e2574fad admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.485497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987a394-1cbf-4f8d-b3aa-0a38e2574fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.485811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987a394-1cbf-4f8d-b3aa-0a38e2574fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.486575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987a394-1cbf-4f8d-b3aa-0a38e2574fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:29.488662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987a394-1cbf-4f8d-b3aa-0a38e2574fad admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:29.503592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1210/2411] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:21:29.508560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987a394-1cbf-4f8d-b3aa-0a38e2574fad admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:29.512215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-18326d06-f2d0-4e4f-bc07-69d63a2f935a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3468bc2f0694b9ba4fcfbf5b68bda94', 'request_id': 'req-18326d06-f2d0-4e4f-bc07-69d63a2f935a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:29.519608 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987a394-1cbf-4f8d-b3aa-0a38e2574fad admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:29.520093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-18326d06-f2d0-4e4f-bc07-69d63a2f935a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3468bc2f0694b9ba4fcfbf5b68bda94', 'request_id': 'req-18326d06-f2d0-4e4f-bc07-69d63a2f935a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:29.526212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-18326d06-f2d0-4e4f-bc07-69d63a2f935a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3468bc2f0694b9ba4fcfbf5b68bda94', 'request_id': 'req-18326d06-f2d0-4e4f-bc07-69d63a2f935a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:29.538244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-18326d06-f2d0-4e4f-bc07-69d63a2f935a admin admin] The token cache is being invalidate because project a3468bc2f0694b9ba4fcfbf5b68bda94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:21:29.538515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-18326d06-f2d0-4e4f-bc07-69d63a2f935a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:29.539242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-18326d06-f2d0-4e4f-bc07-69d63a2f935a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:29.541123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1202/2412] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:21:29 2022] DELETE /identity/v3/projects/a3468bc2f0694b9ba4fcfbf5b68bda94 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:21:29.544166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:29.546163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5f2fc-63d6-4c6e-980d-49d73560181b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.546460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5f2fc-63d6-4c6e-980d-49d73560181b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.546759 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5f2fc-63d6-4c6e-980d-49d73560181b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.567852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-65d5f2fc-63d6-4c6e-980d-49d73560181b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:29.568981 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-65d5f2fc-63d6-4c6e-980d-49d73560181b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:29.589924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d5af9-b777-41fe-be72-cfce2d1aeadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:29.590205 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d5af9-b777-41fe-be72-cfce2d1aeadb admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.590391 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d5af9-b777-41fe-be72-cfce2d1aeadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.590687 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d5af9-b777-41fe-be72-cfce2d1aeadb admin admin] PATH_INFO: `/v3/projects/923446cad6024d159e1ad8af7dc461ee/users/0090c568e1aa4855bb7ec30dd28f7a0a/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.614882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:29.616687 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d5af9-b777-41fe-be72-cfce2d1aeadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=923446cad6024d159e1ad8af7dc461ee, user_id=0090c568e1aa4855bb7ec30dd28f7a0a, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:29.619915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d5af9-b777-41fe-be72-cfce2d1aeadb admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:29.639070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1211/2413] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:29 2022] PUT /identity/v3/projects/923446cad6024d159e1ad8af7dc461ee/users/0090c568e1aa4855bb7ec30dd28f7a0a/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:21:29.649795 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f0ecb-0c86-410f-b23c-afdb2db1e485 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.650083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f0ecb-0c86-410f-b23c-afdb2db1e485 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.650366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f0ecb-0c86-410f-b23c-afdb2db1e485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.654340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1203/2414] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:29.662234 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0351e2-04f2-45c7-9366-aec0a056e85b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.662520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0351e2-04f2-45c7-9366-aec0a056e85b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.662825 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0351e2-04f2-45c7-9366-aec0a056e85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.680676 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-103f0ecb-0c86-410f-b23c-afdb2db1e485 None None] MFA Rules not processed for user `0090c568e1aa4855bb7ec30dd28f7a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:29.681904 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-103f0ecb-0c86-410f-b23c-afdb2db1e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:29.682524 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-af0351e2-04f2-45c7-9366-aec0a056e85b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:29.683738 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-af0351e2-04f2-45c7-9366-aec0a056e85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:29.748971 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1204/2415] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:21:29.752638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1212/2416] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:21:29.753306 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0351e2-04f2-45c7-9366-aec0a056e85b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:29.762989 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0351e2-04f2-45c7-9366-aec0a056e85b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:29.766057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f0ecb-0c86-410f-b23c-afdb2db1e485 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:29.767933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-103f0ecb-0c86-410f-b23c-afdb2db1e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:29.768553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7f725-7f0d-4b77-9449-7ac7e3bdf4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:29.769248 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7f725-7f0d-4b77-9449-7ac7e3bdf4ce admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.769541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7f725-7f0d-4b77-9449-7ac7e3bdf4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.769802 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7f725-7f0d-4b77-9449-7ac7e3bdf4ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.770545 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7f725-7f0d-4b77-9449-7ac7e3bdf4ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:21:29.770882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7f725-7f0d-4b77-9449-7ac7e3bdf4ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:29.772498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7f725-7f0d-4b77-9449-7ac7e3bdf4ce admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:29.785875 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1205/2417] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:21:29.790812 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7f725-7f0d-4b77-9449-7ac7e3bdf4ce admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:29.801366 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7f725-7f0d-4b77-9449-7ac7e3bdf4ce admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:29.806202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2a17a-7870-41d3-8cef-ccbc433f5c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:29.806918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2a17a-7870-41d3-8cef-ccbc433f5c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.807201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2a17a-7870-41d3-8cef-ccbc433f5c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.807472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2a17a-7870-41d3-8cef-ccbc433f5c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.808174 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2a17a-7870-41d3-8cef-ccbc433f5c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:29.810089 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2a17a-7870-41d3-8cef-ccbc433f5c88 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:29.831124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f0ecb-0c86-410f-b23c-afdb2db1e485 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:29.834954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da8c65-fbfc-46df-af89-5db84c06ae65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:29.835668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da8c65-fbfc-46df-af89-5db84c06ae65 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.836089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da8c65-fbfc-46df-af89-5db84c06ae65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.836409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da8c65-fbfc-46df-af89-5db84c06ae65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.839698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1206/2418] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:21:29 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:21:29.844004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2a17a-7870-41d3-8cef-ccbc433f5c88 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:29.846864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da8c65-fbfc-46df-af89-5db84c06ae65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:29.848526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da8c65-fbfc-46df-af89-5db84c06ae65 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:29.860236 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1213/2419] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:21:29.912137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2a17a-7870-41d3-8cef-ccbc433f5c88 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:29.916986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1f500-681a-47df-9405-e3cb6103222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:29.917744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1f500-681a-47df-9405-e3cb6103222f admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.918115 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1f500-681a-47df-9405-e3cb6103222f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.918577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1f500-681a-47df-9405-e3cb6103222f admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.919248 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1f500-681a-47df-9405-e3cb6103222f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:29.922831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1f500-681a-47df-9405-e3cb6103222f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:29.955171 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1207/2420] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:21:29 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:29.956459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da8c65-fbfc-46df-af89-5db84c06ae65 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:29.967424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da8c65-fbfc-46df-af89-5db84c06ae65 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:29.972551 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4322a1-b1ee-423b-bf91-a1a92ad3d6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:29.973237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4322a1-b1ee-423b-bf91-a1a92ad3d6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:29.973520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4322a1-b1ee-423b-bf91-a1a92ad3d6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:29.973799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4322a1-b1ee-423b-bf91-a1a92ad3d6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:29.974539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4322a1-b1ee-423b-bf91-a1a92ad3d6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:29.976200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4322a1-b1ee-423b-bf91-a1a92ad3d6f2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:29.990208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1214/2421] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:29.991565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1f500-681a-47df-9405-e3cb6103222f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:30.003009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1f500-681a-47df-9405-e3cb6103222f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:30.007928 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f86d7-5372-47f9-b7e7-0b923a51d067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:30.008648 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f86d7-5372-47f9-b7e7-0b923a51d067 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:30.008931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f86d7-5372-47f9-b7e7-0b923a51d067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:30.009201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f86d7-5372-47f9-b7e7-0b923a51d067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:30.009962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f86d7-5372-47f9-b7e7-0b923a51d067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:30.011786 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f86d7-5372-47f9-b7e7-0b923a51d067 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:30.023648 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1208/2422] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:30.028470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4322a1-b1ee-423b-bf91-a1a92ad3d6f2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:30.040377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4322a1-b1ee-423b-bf91-a1a92ad3d6f2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:30.048911 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1965b8-4a1b-4767-8eca-a4dbb8dc6c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:30.050054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1965b8-4a1b-4767-8eca-a4dbb8dc6c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:30.050337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1965b8-4a1b-4767-8eca-a4dbb8dc6c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:30.050639 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1965b8-4a1b-4767-8eca-a4dbb8dc6c8a admin admin] PATH_INFO: `/v3/projects/ed312a09d710480a8037ec5f6a6bc44a/users/9d4a0a4983ce470497811f92aa35a73e/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:30.066924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1965b8-4a1b-4767-8eca-a4dbb8dc6c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed312a09d710480a8037ec5f6a6bc44a, user_id=9d4a0a4983ce470497811f92aa35a73e, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:30.069576 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1965b8-4a1b-4767-8eca-a4dbb8dc6c8a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:30.097667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1215/2423] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:30 2022] PUT /identity/v3/projects/ed312a09d710480a8037ec5f6a6bc44a/users/9d4a0a4983ce470497811f92aa35a73e/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:30.106370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ba4b8-207b-4d5c-ad79-e9a9803565c0 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:30.106854 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ba4b8-207b-4d5c-ad79-e9a9803565c0 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:30.107209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ba4b8-207b-4d5c-ad79-e9a9803565c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:30.163361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e16ba4b8-207b-4d5c-ad79-e9a9803565c0 None None] MFA Rules not processed for user `9d4a0a4983ce470497811f92aa35a73e`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:30.165336 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e16ba4b8-207b-4d5c-ad79-e9a9803565c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:30.184583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:30.305666 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1209/2424] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:30.363202 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1965b8-4a1b-4767-8eca-a4dbb8dc6c8a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:30.365275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-aa1965b8-4a1b-4767-8eca-a4dbb8dc6c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:30.378789 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:30.449884 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1965b8-4a1b-4767-8eca-a4dbb8dc6c8a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:30.455872 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c2cee-452a-4620-9960-88da739de841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:30.456560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c2cee-452a-4620-9960-88da739de841 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:30.456824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c2cee-452a-4620-9960-88da739de841 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:30.457108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c2cee-452a-4620-9960-88da739de841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:30.466518 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c2cee-452a-4620-9960-88da739de841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:30.468256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c2cee-452a-4620-9960-88da739de841 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:30.478029 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1216/2425] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:30.698682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ba4b8-207b-4d5c-ad79-e9a9803565c0 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:30.770348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ba4b8-207b-4d5c-ad79-e9a9803565c0 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:30.775822 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f99a51-eb83-4b58-9d8c-44bde5e1aa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:30.776708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f99a51-eb83-4b58-9d8c-44bde5e1aa78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:30.776993 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f99a51-eb83-4b58-9d8c-44bde5e1aa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:30.777272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f99a51-eb83-4b58-9d8c-44bde5e1aa78 admin admin] PATH_INFO: `/v3/users/9d4a0a4983ce470497811f92aa35a73e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:30.778546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f99a51-eb83-4b58-9d8c-44bde5e1aa78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4a0a4983ce470497811f92aa35a73e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:30.780542 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f99a51-eb83-4b58-9d8c-44bde5e1aa78 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:30.839200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-40f99a51-eb83-4b58-9d8c-44bde5e1aa78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4a0a4983ce470497811f92aa35a73e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:30.839987 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-40f99a51-eb83-4b58-9d8c-44bde5e1aa78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4a0a4983ce470497811f92aa35a73e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:30.853969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-40f99a51-eb83-4b58-9d8c-44bde5e1aa78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4a0a4983ce470497811f92aa35a73e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:30.861561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-40f99a51-eb83-4b58-9d8c-44bde5e1aa78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4a0a4983ce470497811f92aa35a73e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:30.862312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-40f99a51-eb83-4b58-9d8c-44bde5e1aa78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4a0a4983ce470497811f92aa35a73e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:30.876533 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1210/2426] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:21:30 2022] DELETE /identity/v3/users/9d4a0a4983ce470497811f92aa35a73e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:30.881380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b1668-5c44-4bc0-bfd8-b64a2accf802 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:30.881665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b1668-5c44-4bc0-bfd8-b64a2accf802 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:30.881949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b1668-5c44-4bc0-bfd8-b64a2accf802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:30.900672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2d3b1668-5c44-4bc0-bfd8-b64a2accf802 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:30.901918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2d3b1668-5c44-4bc0-bfd8-b64a2accf802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:30.972776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1217/2427] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:30.978957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f99a51-eb83-4b58-9d8c-44bde5e1aa78 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:30.981013 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-40f99a51-eb83-4b58-9d8c-44bde5e1aa78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:31.031568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:31.062491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f99a51-eb83-4b58-9d8c-44bde5e1aa78 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:31.067959 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810d7ae-0bf8-4afd-9370-99cb601bed16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:31.068884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810d7ae-0bf8-4afd-9370-99cb601bed16 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:31.069245 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810d7ae-0bf8-4afd-9370-99cb601bed16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:31.069570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810d7ae-0bf8-4afd-9370-99cb601bed16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:31.080272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810d7ae-0bf8-4afd-9370-99cb601bed16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:31.081804 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810d7ae-0bf8-4afd-9370-99cb601bed16 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:31.091783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1211/2428] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:31.541646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b1668-5c44-4bc0-bfd8-b64a2accf802 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:31.543351 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2d3b1668-5c44-4bc0-bfd8-b64a2accf802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:31.560597 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b1668-5c44-4bc0-bfd8-b64a2accf802 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:31.581620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672d2d4-498a-4b69-a36c-3d383d06dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:31.583712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d2d4-498a-4b69-a36c-3d383d06dbab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:31.584119 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d2d4-498a-4b69-a36c-3d383d06dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:31.584861 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d2d4-498a-4b69-a36c-3d383d06dbab admin admin] PATH_INFO: `/v3/projects/ed312a09d710480a8037ec5f6a6bc44a` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:31.588432 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672d2d4-498a-4b69-a36c-3d383d06dbab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed312a09d710480a8037ec5f6a6bc44a)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:31.592522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672d2d4-498a-4b69-a36c-3d383d06dbab admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:31.692368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e672d2d4-498a-4b69-a36c-3d383d06dbab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed312a09d710480a8037ec5f6a6bc44a', 'request_id': 'req-e672d2d4-498a-4b69-a36c-3d383d06dbab'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:31.703093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e672d2d4-498a-4b69-a36c-3d383d06dbab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed312a09d710480a8037ec5f6a6bc44a', 'request_id': 'req-e672d2d4-498a-4b69-a36c-3d383d06dbab'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:31.711099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e672d2d4-498a-4b69-a36c-3d383d06dbab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed312a09d710480a8037ec5f6a6bc44a', 'request_id': 'req-e672d2d4-498a-4b69-a36c-3d383d06dbab'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:31.734383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e672d2d4-498a-4b69-a36c-3d383d06dbab admin admin] The token cache is being invalidate because project ed312a09d710480a8037ec5f6a6bc44a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:21:31.734796 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e672d2d4-498a-4b69-a36c-3d383d06dbab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:31.735526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e672d2d4-498a-4b69-a36c-3d383d06dbab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:31.737230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1218/2429] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:21:31 2022] DELETE /identity/v3/projects/ed312a09d710480a8037ec5f6a6bc44a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:21:31.743251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0803a-980a-4f20-a0e0-3fe681ce7242 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:31.743758 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0803a-980a-4f20-a0e0-3fe681ce7242 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:31.743867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0803a-980a-4f20-a0e0-3fe681ce7242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:31.763413 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-10a0803a-980a-4f20-a0e0-3fe681ce7242 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:31.764935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-10a0803a-980a-4f20-a0e0-3fe681ce7242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:31.842369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1212/2430] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:31.850854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bad66-6a2a-4cf4-ba24-a30ba5b95463 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:31.851156 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bad66-6a2a-4cf4-ba24-a30ba5b95463 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:31.851586 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bad66-6a2a-4cf4-ba24-a30ba5b95463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:31.877121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0c8bad66-6a2a-4cf4-ba24-a30ba5b95463 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:31.878940 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0c8bad66-6a2a-4cf4-ba24-a30ba5b95463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:31.890539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1219/2431] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:21:31.895151 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0803a-980a-4f20-a0e0-3fe681ce7242 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:31.906613 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0803a-980a-4f20-a0e0-3fe681ce7242 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:31.915411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2aad3-c413-4f3f-a558-c2d0f6509bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:31.916089 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2aad3-c413-4f3f-a558-c2d0f6509bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:31.916372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2aad3-c413-4f3f-a558-c2d0f6509bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:31.916650 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2aad3-c413-4f3f-a558-c2d0f6509bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:31.917480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2aad3-c413-4f3f-a558-c2d0f6509bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:21:31.917794 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2aad3-c413-4f3f-a558-c2d0f6509bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:31.919448 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2aad3-c413-4f3f-a558-c2d0f6509bd5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:31.933467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1213/2432] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:21:31.938457 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bad66-6a2a-4cf4-ba24-a30ba5b95463 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:31.948362 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bad66-6a2a-4cf4-ba24-a30ba5b95463 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:31.953165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be21e95-ed20-4705-a1e0-38b01f48fa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:31.953832 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be21e95-ed20-4705-a1e0-38b01f48fa88 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:31.954114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be21e95-ed20-4705-a1e0-38b01f48fa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:31.954388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be21e95-ed20-4705-a1e0-38b01f48fa88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:31.955145 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be21e95-ed20-4705-a1e0-38b01f48fa88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:31.957057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be21e95-ed20-4705-a1e0-38b01f48fa88 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:31.962153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:31.989337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1220/2433] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:21:31 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:21:31.993564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2aad3-c413-4f3f-a558-c2d0f6509bd5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:32.005800 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2aad3-c413-4f3f-a558-c2d0f6509bd5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:32.068964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e364b1-35bb-48f2-99fd-2eebd04d316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:32.069659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e364b1-35bb-48f2-99fd-2eebd04d316c admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:32.069948 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e364b1-35bb-48f2-99fd-2eebd04d316c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:32.070222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e364b1-35bb-48f2-99fd-2eebd04d316c admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:32.070968 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e364b1-35bb-48f2-99fd-2eebd04d316c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:32.073186 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e364b1-35bb-48f2-99fd-2eebd04d316c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:32.095778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1214/2434] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:21:31 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:32.100671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be21e95-ed20-4705-a1e0-38b01f48fa88 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:32.112491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be21e95-ed20-4705-a1e0-38b01f48fa88 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:32.117716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8ebf3-002a-4b25-980b-1c59bca0b0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:32.119281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8ebf3-002a-4b25-980b-1c59bca0b0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:32.119570 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8ebf3-002a-4b25-980b-1c59bca0b0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:32.119850 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8ebf3-002a-4b25-980b-1c59bca0b0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:32.120620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8ebf3-002a-4b25-980b-1c59bca0b0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:32.122267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8ebf3-002a-4b25-980b-1c59bca0b0b3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:32.134213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1221/2435] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:32.138885 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e364b1-35bb-48f2-99fd-2eebd04d316c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:32.150146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e364b1-35bb-48f2-99fd-2eebd04d316c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:32.155624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c655fff-6784-4f12-90b4-b1920108c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:32.156317 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655fff-6784-4f12-90b4-b1920108c5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:32.156600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655fff-6784-4f12-90b4-b1920108c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:32.156881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655fff-6784-4f12-90b4-b1920108c5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:32.157626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c655fff-6784-4f12-90b4-b1920108c5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:32.159289 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c655fff-6784-4f12-90b4-b1920108c5a2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:32.170879 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1215/2436] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:32.175495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8ebf3-002a-4b25-980b-1c59bca0b0b3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:32.185892 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8ebf3-002a-4b25-980b-1c59bca0b0b3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:32.191567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001833f8-9d6b-4392-adce-dee2d2dcf0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:32.193111 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001833f8-9d6b-4392-adce-dee2d2dcf0f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:32.194095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001833f8-9d6b-4392-adce-dee2d2dcf0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:32.194396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001833f8-9d6b-4392-adce-dee2d2dcf0f1 admin admin] PATH_INFO: `/v3/projects/51d260c797c8434e803bd98f18401b5d/users/00117065f3de478c81365045c925fcd6/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:32.214996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001833f8-9d6b-4392-adce-dee2d2dcf0f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d260c797c8434e803bd98f18401b5d, user_id=00117065f3de478c81365045c925fcd6, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:32.217723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001833f8-9d6b-4392-adce-dee2d2dcf0f1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:32.232881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1222/2437] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:32 2022] PUT /identity/v3/projects/51d260c797c8434e803bd98f18401b5d/users/00117065f3de478c81365045c925fcd6/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:32.243625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c389-25a3-4211-a646-8b544ed11bcf None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:32.243917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c389-25a3-4211-a646-8b544ed11bcf None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:32.244203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c389-25a3-4211-a646-8b544ed11bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:32.280826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5582c389-25a3-4211-a646-8b544ed11bcf None None] MFA Rules not processed for user `00117065f3de478c81365045c925fcd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:32.282076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5582c389-25a3-4211-a646-8b544ed11bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:32.329011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:32.370702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1216/2438] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:32.375818 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001833f8-9d6b-4392-adce-dee2d2dcf0f1 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:32.457000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001833f8-9d6b-4392-adce-dee2d2dcf0f1 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:32.464569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10bbc0-ea86-40cf-b48d-39c47aee0323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:32.465794 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10bbc0-ea86-40cf-b48d-39c47aee0323 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:32.466268 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10bbc0-ea86-40cf-b48d-39c47aee0323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:32.466778 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10bbc0-ea86-40cf-b48d-39c47aee0323 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:32.468230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10bbc0-ea86-40cf-b48d-39c47aee0323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:32.472965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10bbc0-ea86-40cf-b48d-39c47aee0323 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:32.508501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1223/2439] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:21:32 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:32.512918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582c389-25a3-4211-a646-8b544ed11bcf None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:32.524100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582c389-25a3-4211-a646-8b544ed11bcf None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:32.585487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f085a-e607-4a1e-b066-840b4acd8806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:32.586171 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f085a-e607-4a1e-b066-840b4acd8806 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:32.586452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f085a-e607-4a1e-b066-840b4acd8806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:32.586768 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f085a-e607-4a1e-b066-840b4acd8806 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:32.587493 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f085a-e607-4a1e-b066-840b4acd8806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:32.589426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f085a-e607-4a1e-b066-840b4acd8806 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:32.611595 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1217/2440] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:21:32 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:21:32.615899 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10bbc0-ea86-40cf-b48d-39c47aee0323 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:32.627965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10bbc0-ea86-40cf-b48d-39c47aee0323 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:32.633724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6359e-5e36-4087-a3b3-1f88d40352a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:32.634401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6359e-5e36-4087-a3b3-1f88d40352a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:32.634678 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6359e-5e36-4087-a3b3-1f88d40352a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:32.634987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6359e-5e36-4087-a3b3-1f88d40352a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:32.635720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6359e-5e36-4087-a3b3-1f88d40352a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:32.637372 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6359e-5e36-4087-a3b3-1f88d40352a2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:32.650894 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1224/2441] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:32.655488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f085a-e607-4a1e-b066-840b4acd8806 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:32.667540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f085a-e607-4a1e-b066-840b4acd8806 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:32.674029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20944f-232e-43b9-96fe-bea01b4f1617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:32.674963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20944f-232e-43b9-96fe-bea01b4f1617 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:32.675246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20944f-232e-43b9-96fe-bea01b4f1617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:32.675522 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20944f-232e-43b9-96fe-bea01b4f1617 admin admin] PATH_INFO: `/v3/projects/f9f0036830414a1f8fdcc2c4cb80c912/users/9f6efd938ccf42c79f17dfc0f517b6e6/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:32.699241 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20944f-232e-43b9-96fe-bea01b4f1617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f0036830414a1f8fdcc2c4cb80c912, user_id=9f6efd938ccf42c79f17dfc0f517b6e6, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:32.702354 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20944f-232e-43b9-96fe-bea01b4f1617 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:32.720180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1218/2442] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:32 2022] PUT /identity/v3/projects/f9f0036830414a1f8fdcc2c4cb80c912/users/9f6efd938ccf42c79f17dfc0f517b6e6/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:32.724675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6359e-5e36-4087-a3b3-1f88d40352a2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:32.736211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6359e-5e36-4087-a3b3-1f88d40352a2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:32.811548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a0de9-7a18-4727-8fe1-4755784edc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:32.812960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a0de9-7a18-4727-8fe1-4755784edc0b admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:32.813351 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a0de9-7a18-4727-8fe1-4755784edc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:32.813725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a0de9-7a18-4727-8fe1-4755784edc0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:32.814584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a0de9-7a18-4727-8fe1-4755784edc0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:32.816361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a0de9-7a18-4727-8fe1-4755784edc0b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:32.833407 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1225/2443] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:32.837854 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20944f-232e-43b9-96fe-bea01b4f1617 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:32.848890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20944f-232e-43b9-96fe-bea01b4f1617 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:32.854234 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc96a88-2086-425d-921a-a896c7e3afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:32.855412 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc96a88-2086-425d-921a-a896c7e3afd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:32.855909 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc96a88-2086-425d-921a-a896c7e3afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:32.856395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc96a88-2086-425d-921a-a896c7e3afd9 admin admin] PATH_INFO: `/v3/projects/f9f0036830414a1f8fdcc2c4cb80c912/users/9f6efd938ccf42c79f17dfc0f517b6e6/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:32.858828 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc96a88-2086-425d-921a-a896c7e3afd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f0036830414a1f8fdcc2c4cb80c912, user_id=9f6efd938ccf42c79f17dfc0f517b6e6, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:32.862138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc96a88-2086-425d-921a-a896c7e3afd9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:32.890141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1219/2444] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:32 2022] PUT /identity/v3/projects/f9f0036830414a1f8fdcc2c4cb80c912/users/9f6efd938ccf42c79f17dfc0f517b6e6/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:32.902505 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04954ae7-06f0-4ac0-b5df-ac530e60557c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:32.902901 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04954ae7-06f0-4ac0-b5df-ac530e60557c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:32.903190 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04954ae7-06f0-4ac0-b5df-ac530e60557c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:32.945643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-04954ae7-06f0-4ac0-b5df-ac530e60557c None None] MFA Rules not processed for user `9f6efd938ccf42c79f17dfc0f517b6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:32.946924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-04954ae7-06f0-4ac0-b5df-ac530e60557c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:32.965396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:33.056879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1226/2445] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:33.069449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc96a88-2086-425d-921a-a896c7e3afd9 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:33.071880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7fc96a88-2086-425d-921a-a896c7e3afd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:33.148462 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc96a88-2086-425d-921a-a896c7e3afd9 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:33.153194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2e25d-5e3c-450d-9c0a-39edca7098a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:33.153867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e25d-5e3c-450d-9c0a-39edca7098a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:33.154137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e25d-5e3c-450d-9c0a-39edca7098a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:33.154454 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e25d-5e3c-450d-9c0a-39edca7098a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:33.166634 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2e25d-5e3c-450d-9c0a-39edca7098a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:33.168156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2e25d-5e3c-450d-9c0a-39edca7098a2 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:33.180286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1220/2446] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:33.265443 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04954ae7-06f0-4ac0-b5df-ac530e60557c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:33.276852 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04954ae7-06f0-4ac0-b5df-ac530e60557c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:33.281167 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64100711-6c19-49c8-b43c-25b6cf07ebd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:33.281889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64100711-6c19-49c8-b43c-25b6cf07ebd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:33.282489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64100711-6c19-49c8-b43c-25b6cf07ebd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:33.282489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64100711-6c19-49c8-b43c-25b6cf07ebd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:33.364840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64100711-6c19-49c8-b43c-25b6cf07ebd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:33.367573 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64100711-6c19-49c8-b43c-25b6cf07ebd4 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:33.391655 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1227/2447] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:39.062082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2e25d-5e3c-450d-9c0a-39edca7098a2 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:39.064359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4fa2e25d-5e3c-450d-9c0a-39edca7098a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:39.096882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:39.148051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2e25d-5e3c-450d-9c0a-39edca7098a2 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:39.154225 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c16ecb-83c9-46c9-ab11-9152048622dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:39.155319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16ecb-83c9-46c9-ab11-9152048622dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:39.155597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16ecb-83c9-46c9-ab11-9152048622dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:39.155873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16ecb-83c9-46c9-ab11-9152048622dd admin admin] PATH_INFO: `/v3/users/0090c568e1aa4855bb7ec30dd28f7a0a` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:39.157179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c16ecb-83c9-46c9-ab11-9152048622dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0090c568e1aa4855bb7ec30dd28f7a0a)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:39.159312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c16ecb-83c9-46c9-ab11-9152048622dd admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:39.247113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d8c16ecb-83c9-46c9-ab11-9152048622dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0090c568e1aa4855bb7ec30dd28f7a0a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:39.247113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d8c16ecb-83c9-46c9-ab11-9152048622dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0090c568e1aa4855bb7ec30dd28f7a0a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:39.263044 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d8c16ecb-83c9-46c9-ab11-9152048622dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0090c568e1aa4855bb7ec30dd28f7a0a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:39.272153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d8c16ecb-83c9-46c9-ab11-9152048622dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0090c568e1aa4855bb7ec30dd28f7a0a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:39.272901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d8c16ecb-83c9-46c9-ab11-9152048622dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0090c568e1aa4855bb7ec30dd28f7a0a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:39.289711 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1221/2448] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:21:39 2022] DELETE /identity/v3/users/0090c568e1aa4855bb7ec30dd28f7a0a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:39.295307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d42585-34e4-4c1a-9b4e-a945754ad1d1 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:39.296204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d42585-34e4-4c1a-9b4e-a945754ad1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:39.296426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d42585-34e4-4c1a-9b4e-a945754ad1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:39.326388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b3d42585-34e4-4c1a-9b4e-a945754ad1d1 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:39.328886 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b3d42585-34e4-4c1a-9b4e-a945754ad1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:39.417049 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1228/2449] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:21:39.430393 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c16ecb-83c9-46c9-ab11-9152048622dd admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:39.432550 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d8c16ecb-83c9-46c9-ab11-9152048622dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:39.529229 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c16ecb-83c9-46c9-ab11-9152048622dd admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:39.533911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d7872-8151-40b4-bbfb-115104c3a4c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:39.534724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d7872-8151-40b4-bbfb-115104c3a4c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:39.535168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d7872-8151-40b4-bbfb-115104c3a4c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:39.535344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d7872-8151-40b4-bbfb-115104c3a4c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:39.547266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d7872-8151-40b4-bbfb-115104c3a4c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:39.548932 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d7872-8151-40b4-bbfb-115104c3a4c7 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:39.561141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1222/2450] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:21:39.971302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d42585-34e4-4c1a-9b4e-a945754ad1d1 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:39.973638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b3d42585-34e4-4c1a-9b4e-a945754ad1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:40.007046 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d42585-34e4-4c1a-9b4e-a945754ad1d1 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:40.016305 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bac97-edb3-42ea-bc8e-f11b17768454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:40.017867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bac97-edb3-42ea-bc8e-f11b17768454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:40.018341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bac97-edb3-42ea-bc8e-f11b17768454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:40.018808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bac97-edb3-42ea-bc8e-f11b17768454 admin admin] PATH_INFO: `/v3/projects/923446cad6024d159e1ad8af7dc461ee` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:40.026413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bac97-edb3-42ea-bc8e-f11b17768454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=923446cad6024d159e1ad8af7dc461ee)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:40.026413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bac97-edb3-42ea-bc8e-f11b17768454 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:40.081674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:40.091057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-520bac97-edb3-42ea-bc8e-f11b17768454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923446cad6024d159e1ad8af7dc461ee', 'request_id': 'req-520bac97-edb3-42ea-bc8e-f11b17768454'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:40.107016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-520bac97-edb3-42ea-bc8e-f11b17768454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923446cad6024d159e1ad8af7dc461ee', 'request_id': 'req-520bac97-edb3-42ea-bc8e-f11b17768454'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:40.117102 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-520bac97-edb3-42ea-bc8e-f11b17768454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923446cad6024d159e1ad8af7dc461ee', 'request_id': 'req-520bac97-edb3-42ea-bc8e-f11b17768454'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:40.135758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-520bac97-edb3-42ea-bc8e-f11b17768454 admin admin] The token cache is being invalidate because project 923446cad6024d159e1ad8af7dc461ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:21:40.136097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-520bac97-edb3-42ea-bc8e-f11b17768454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:40.136788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-520bac97-edb3-42ea-bc8e-f11b17768454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:40.138487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1229/2451] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:21:39 2022] DELETE /identity/v3/projects/923446cad6024d159e1ad8af7dc461ee => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:40.144221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d18f9-c9d0-4ff0-9fdb-66fad65fac9a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:40.144906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d18f9-c9d0-4ff0-9fdb-66fad65fac9a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:40.144906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d18f9-c9d0-4ff0-9fdb-66fad65fac9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:40.167861 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-741d18f9-c9d0-4ff0-9fdb-66fad65fac9a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:40.170337 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-741d18f9-c9d0-4ff0-9fdb-66fad65fac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:40.241419 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:40.285656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1223/2452] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:40.288856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a1646-0e7b-4353-a15c-05afe3c5d01f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:40.289036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a1646-0e7b-4353-a15c-05afe3c5d01f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:40.289452 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a1646-0e7b-4353-a15c-05afe3c5d01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:40.315183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-070a1646-0e7b-4353-a15c-05afe3c5d01f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:40.317531 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-070a1646-0e7b-4353-a15c-05afe3c5d01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:40.328574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1230/2453] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:21:40.333944 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d18f9-c9d0-4ff0-9fdb-66fad65fac9a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:40.353528 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d18f9-c9d0-4ff0-9fdb-66fad65fac9a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:40.361938 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9ec9d-1d9c-4493-8329-c00cbfa5141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:40.363447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9ec9d-1d9c-4493-8329-c00cbfa5141c admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:40.364031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9ec9d-1d9c-4493-8329-c00cbfa5141c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:40.364669 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9ec9d-1d9c-4493-8329-c00cbfa5141c admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:40.366116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9ec9d-1d9c-4493-8329-c00cbfa5141c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:21:40.367157 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9ec9d-1d9c-4493-8329-c00cbfa5141c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:40.370504 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9ec9d-1d9c-4493-8329-c00cbfa5141c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:40.392599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1224/2454] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:21:40.397998 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a1646-0e7b-4353-a15c-05afe3c5d01f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:40.413862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a1646-0e7b-4353-a15c-05afe3c5d01f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:40.421322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4c39e-fa62-4747-8eeb-42fbb397eeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:40.422543 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4c39e-fa62-4747-8eeb-42fbb397eeda admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:40.423064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4c39e-fa62-4747-8eeb-42fbb397eeda admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:40.423540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4c39e-fa62-4747-8eeb-42fbb397eeda admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:40.424854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4c39e-fa62-4747-8eeb-42fbb397eeda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:40.428667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4c39e-fa62-4747-8eeb-42fbb397eeda admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:40.477120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1231/2455] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:21:40 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:21:40.481762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9ec9d-1d9c-4493-8329-c00cbfa5141c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:40.494714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9ec9d-1d9c-4493-8329-c00cbfa5141c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:40.567886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11403f9-c45a-4c21-a069-cace275a0929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:40.568634 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11403f9-c45a-4c21-a069-cace275a0929 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:40.569030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11403f9-c45a-4c21-a069-cace275a0929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:40.569392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11403f9-c45a-4c21-a069-cace275a0929 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:40.570271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11403f9-c45a-4c21-a069-cace275a0929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:40.572533 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11403f9-c45a-4c21-a069-cace275a0929 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:40.601506 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1225/2456] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:21:40 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:40.608834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4c39e-fa62-4747-8eeb-42fbb397eeda admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:40.624361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4c39e-fa62-4747-8eeb-42fbb397eeda admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:40.630080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693aa315-48fb-4e89-9bbe-2780bc2856df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:40.630812 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aa315-48fb-4e89-9bbe-2780bc2856df admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:40.631083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aa315-48fb-4e89-9bbe-2780bc2856df admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:40.631356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aa315-48fb-4e89-9bbe-2780bc2856df admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:40.632102 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693aa315-48fb-4e89-9bbe-2780bc2856df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:40.633724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693aa315-48fb-4e89-9bbe-2780bc2856df admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:40.645647 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1232/2457] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:40.650126 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11403f9-c45a-4c21-a069-cace275a0929 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:40.662464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11403f9-c45a-4c21-a069-cace275a0929 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:40.668383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729b2ea-ec33-4613-8272-2425b21e78ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:40.669084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b2ea-ec33-4613-8272-2425b21e78ee admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:40.669370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b2ea-ec33-4613-8272-2425b21e78ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:40.669975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b2ea-ec33-4613-8272-2425b21e78ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:40.670793 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729b2ea-ec33-4613-8272-2425b21e78ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:40.672424 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729b2ea-ec33-4613-8272-2425b21e78ee admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:40.684400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1226/2458] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:40.690162 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693aa315-48fb-4e89-9bbe-2780bc2856df admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:40.702199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693aa315-48fb-4e89-9bbe-2780bc2856df admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:40.708185 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e080e-cae0-4579-9c74-99fe68b5548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:40.709475 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e080e-cae0-4579-9c74-99fe68b5548c admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:40.709911 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e080e-cae0-4579-9c74-99fe68b5548c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:40.710379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e080e-cae0-4579-9c74-99fe68b5548c admin admin] PATH_INFO: `/v3/projects/6d67f4abcda849c3a6fe104c2a805051/users/6d68cd2d00bf4acf964f2bd0ecb4fe07/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:40.729997 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e080e-cae0-4579-9c74-99fe68b5548c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d67f4abcda849c3a6fe104c2a805051, user_id=6d68cd2d00bf4acf964f2bd0ecb4fe07, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:40.733355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e080e-cae0-4579-9c74-99fe68b5548c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:40.751688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1233/2459] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:40 2022] PUT /identity/v3/projects/6d67f4abcda849c3a6fe104c2a805051/users/6d68cd2d00bf4acf964f2bd0ecb4fe07/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:40.765261 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ab7d0-403c-417d-b45b-020685c0d82c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:40.765741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ab7d0-403c-417d-b45b-020685c0d82c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:40.766131 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ab7d0-403c-417d-b45b-020685c0d82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:40.803294 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5f4ab7d0-403c-417d-b45b-020685c0d82c None None] MFA Rules not processed for user `6d68cd2d00bf4acf964f2bd0ecb4fe07`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:40.804663 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5f4ab7d0-403c-417d-b45b-020685c0d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:40.894104 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1227/2460] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:40.900310 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e080e-cae0-4579-9c74-99fe68b5548c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:40.990865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e080e-cae0-4579-9c74-99fe68b5548c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:40.997314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d426a5f-acf9-4b81-8898-31662ef2c122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:40.998750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d426a5f-acf9-4b81-8898-31662ef2c122 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:40.998750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d426a5f-acf9-4b81-8898-31662ef2c122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:40.999022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d426a5f-acf9-4b81-8898-31662ef2c122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:40.999789 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d426a5f-acf9-4b81-8898-31662ef2c122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:41.001853 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d426a5f-acf9-4b81-8898-31662ef2c122 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:41.039238 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1234/2461] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:21:40 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:21:41.045113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ab7d0-403c-417d-b45b-020685c0d82c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:41.067831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ab7d0-403c-417d-b45b-020685c0d82c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:41.186919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:41.234011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc1bb4-e451-4011-98bb-9d93fe25ec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:41.235571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1bb4-e451-4011-98bb-9d93fe25ec7f admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:41.236275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1bb4-e451-4011-98bb-9d93fe25ec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:41.237262 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1bb4-e451-4011-98bb-9d93fe25ec7f admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:41.238941 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc1bb4-e451-4011-98bb-9d93fe25ec7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:41.246871 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc1bb4-e451-4011-98bb-9d93fe25ec7f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:41.293279 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1228/2462] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:21:41 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:41.295675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d426a5f-acf9-4b81-8898-31662ef2c122 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:41.316607 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d426a5f-acf9-4b81-8898-31662ef2c122 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:41.343598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b67fc2-4822-4690-9787-1fe17ba638ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:41.350318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b67fc2-4822-4690-9787-1fe17ba638ba admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:41.350996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b67fc2-4822-4690-9787-1fe17ba638ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:41.351698 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b67fc2-4822-4690-9787-1fe17ba638ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:41.357686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b67fc2-4822-4690-9787-1fe17ba638ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:41.367075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b67fc2-4822-4690-9787-1fe17ba638ba admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:41.398552 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736a5db-7503-4e0b-973f-23099f39a212 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:41.399067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736a5db-7503-4e0b-973f-23099f39a212 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:41.399541 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736a5db-7503-4e0b-973f-23099f39a212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:41.411176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1235/2463] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:41.412984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b67fc2-4822-4690-9787-1fe17ba638ba admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:41.430681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d736a5db-7503-4e0b-973f-23099f39a212 None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:41.432079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d736a5db-7503-4e0b-973f-23099f39a212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:41.463872 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b67fc2-4822-4690-9787-1fe17ba638ba admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:41.494369 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e05061-a6e7-4963-a237-261a4c113a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:41.497299 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e05061-a6e7-4963-a237-261a4c113a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:41.498164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e05061-a6e7-4963-a237-261a4c113a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:41.499674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e05061-a6e7-4963-a237-261a4c113a97 admin admin] PATH_INFO: `/v3/projects/d39bfb23465843c480fe5ad2a3743e48/users/c2d37b7828f646aa9df73ca4ba844358/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:41.551164 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e05061-a6e7-4963-a237-261a4c113a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39bfb23465843c480fe5ad2a3743e48, user_id=c2d37b7828f646aa9df73ca4ba844358, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:41.558206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e05061-a6e7-4963-a237-261a4c113a97 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:41.579010 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1229/2464] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:21:41.580077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736a5db-7503-4e0b-973f-23099f39a212 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:41.583388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d736a5db-7503-4e0b-973f-23099f39a212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:41.604644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736a5db-7503-4e0b-973f-23099f39a212 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:41.627334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1236/2465] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:41 2022] PUT /identity/v3/projects/d39bfb23465843c480fe5ad2a3743e48/users/c2d37b7828f646aa9df73ca4ba844358/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:21:41.629195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e05061-a6e7-4963-a237-261a4c113a97 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:41.692293 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:41.724721 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada67f27-90e9-4add-ab5e-c37444cde81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:41.726153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada67f27-90e9-4add-ab5e-c37444cde81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:41.726596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada67f27-90e9-4add-ab5e-c37444cde81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:41.727073 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada67f27-90e9-4add-ab5e-c37444cde81a admin admin] PATH_INFO: `/v3/users/de7d2986100c481eb36f1782f4c30528` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:41.729855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada67f27-90e9-4add-ab5e-c37444cde81a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7d2986100c481eb36f1782f4c30528)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:41.734961 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada67f27-90e9-4add-ab5e-c37444cde81a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:41.778867 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e05061-a6e7-4963-a237-261a4c113a97 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:41.786626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9524933-f54c-416e-bc95-36920e088522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:41.787755 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9524933-f54c-416e-bc95-36920e088522 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:41.788208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9524933-f54c-416e-bc95-36920e088522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:41.788628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9524933-f54c-416e-bc95-36920e088522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:41.789575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9524933-f54c-416e-bc95-36920e088522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:41.791974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9524933-f54c-416e-bc95-36920e088522 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:41.805373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1237/2466] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:41.806561 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9524933-f54c-416e-bc95-36920e088522 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:41.808515 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f9524933-f54c-416e-bc95-36920e088522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:41.810823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ada67f27-90e9-4add-ab5e-c37444cde81a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7d2986100c481eb36f1782f4c30528'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:41.811994 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ada67f27-90e9-4add-ab5e-c37444cde81a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7d2986100c481eb36f1782f4c30528'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:41.827813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ada67f27-90e9-4add-ab5e-c37444cde81a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7d2986100c481eb36f1782f4c30528'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:41.837984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ada67f27-90e9-4add-ab5e-c37444cde81a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7d2986100c481eb36f1782f4c30528'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:41.839097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ada67f27-90e9-4add-ab5e-c37444cde81a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7d2986100c481eb36f1782f4c30528'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:41.845444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:41.865822 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1230/2467] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:21:41 2022] DELETE /identity/v3/users/de7d2986100c481eb36f1782f4c30528 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:41.867148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada67f27-90e9-4add-ab5e-c37444cde81a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:41.869001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ada67f27-90e9-4add-ab5e-c37444cde81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:41.926462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9524933-f54c-416e-bc95-36920e088522 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:41.988852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada67f27-90e9-4add-ab5e-c37444cde81a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:41.994037 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fbedc-6bc5-46cc-9a9f-92447f4029ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:41.995059 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fbedc-6bc5-46cc-9a9f-92447f4029ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:41.995459 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fbedc-6bc5-46cc-9a9f-92447f4029ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:41.995748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fbedc-6bc5-46cc-9a9f-92447f4029ea admin admin] PATH_INFO: `/v3/projects/d39bfb23465843c480fe5ad2a3743e48/users/c2d37b7828f646aa9df73ca4ba844358/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:41.998283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fbedc-6bc5-46cc-9a9f-92447f4029ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39bfb23465843c480fe5ad2a3743e48, user_id=c2d37b7828f646aa9df73ca4ba844358, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:42.001348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fbedc-6bc5-46cc-9a9f-92447f4029ea admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:42.014077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b619c-5e97-4945-85b9-0c8353f36720 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:42.015414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1231/2468] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:41 2022] PUT /identity/v3/projects/d39bfb23465843c480fe5ad2a3743e48/users/c2d37b7828f646aa9df73ca4ba844358/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:42.015595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b619c-5e97-4945-85b9-0c8353f36720 service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:42.015595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b619c-5e97-4945-85b9-0c8353f36720 service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:42.016023 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b619c-5e97-4945-85b9-0c8353f36720 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:42.016476 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c943370-8774-4639-b257-e642d2483789 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:42.016763 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c943370-8774-4639-b257-e642d2483789 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:42.017037 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c943370-8774-4639-b257-e642d2483789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:42.026426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-915b619c-5e97-4945-85b9-0c8353f36720 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:42.037810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-6c943370-8774-4639-b257-e642d2483789 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:42.039916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6c943370-8774-4639-b257-e642d2483789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:42.097181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:42.100749 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b619c-5e97-4945-85b9-0c8353f36720 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:42.103495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b619c-5e97-4945-85b9-0c8353f36720 service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:42.117093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1238/2469] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:21:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:21:42.121574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4780f3-26bd-4e4e-8a16-dfe5de45c3ca None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:42.121876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4780f3-26bd-4e4e-8a16-dfe5de45c3ca None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:42.122390 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4780f3-26bd-4e4e-8a16-dfe5de45c3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:42.126548 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1232/2470] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:42.141107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c943370-8774-4639-b257-e642d2483789 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:42.143497 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6c943370-8774-4639-b257-e642d2483789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:42.179342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9e4780f3-26bd-4e4e-8a16-dfe5de45c3ca None None] MFA Rules not processed for user `c2d37b7828f646aa9df73ca4ba844358`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:42.181161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9e4780f3-26bd-4e4e-8a16-dfe5de45c3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:42.269655 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c943370-8774-4639-b257-e642d2483789 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:42.275676 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e020a8f-b3a1-44c4-9635-8cbf81d97098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:42.276849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e020a8f-b3a1-44c4-9635-8cbf81d97098 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:42.277627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e020a8f-b3a1-44c4-9635-8cbf81d97098 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:42.284840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e020a8f-b3a1-44c4-9635-8cbf81d97098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:42.293282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1239/2471] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:42.307941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4780f3-26bd-4e4e-8a16-dfe5de45c3ca None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:42.310142 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9e4780f3-26bd-4e4e-8a16-dfe5de45c3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:42.311828 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e020a8f-b3a1-44c4-9635-8cbf81d97098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:42.315009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e020a8f-b3a1-44c4-9635-8cbf81d97098 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:42.330610 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1233/2472] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:21:42.415199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4780f3-26bd-4e4e-8a16-dfe5de45c3ca None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:42.422598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5309e-8710-47d9-8ddb-e425d9593dd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:42.423609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5309e-8710-47d9-8ddb-e425d9593dd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:42.424048 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5309e-8710-47d9-8ddb-e425d9593dd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:42.424478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5309e-8710-47d9-8ddb-e425d9593dd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:42.441367 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5309e-8710-47d9-8ddb-e425d9593dd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:42.443210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5309e-8710-47d9-8ddb-e425d9593dd0 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:42.459934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1240/2473] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:21:43.006155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e020a8f-b3a1-44c4-9635-8cbf81d97098 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:43.007814 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6e020a8f-b3a1-44c4-9635-8cbf81d97098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:43.039897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e020a8f-b3a1-44c4-9635-8cbf81d97098 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:43.051018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de51510-da0d-4589-92e6-ce0fbd573d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:43.053785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de51510-da0d-4589-92e6-ce0fbd573d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:43.054098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de51510-da0d-4589-92e6-ce0fbd573d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:43.054382 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de51510-da0d-4589-92e6-ce0fbd573d2c admin admin] PATH_INFO: `/v3/projects/fe21201961144a89be0dc3854ded0a2a` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:43.055915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de51510-da0d-4589-92e6-ce0fbd573d2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe21201961144a89be0dc3854ded0a2a)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:43.058645 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de51510-da0d-4589-92e6-ce0fbd573d2c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:43.121676 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:43.181948 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2de51510-da0d-4589-92e6-ce0fbd573d2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe21201961144a89be0dc3854ded0a2a', 'request_id': 'req-2de51510-da0d-4589-92e6-ce0fbd573d2c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:43.211332 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2de51510-da0d-4589-92e6-ce0fbd573d2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe21201961144a89be0dc3854ded0a2a', 'request_id': 'req-2de51510-da0d-4589-92e6-ce0fbd573d2c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:43.214309 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5309e-8710-47d9-8ddb-e425d9593dd0 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:43.216714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-25f5309e-8710-47d9-8ddb-e425d9593dd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:43.243316 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2de51510-da0d-4589-92e6-ce0fbd573d2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe21201961144a89be0dc3854ded0a2a', 'request_id': 'req-2de51510-da0d-4589-92e6-ce0fbd573d2c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:43.290065 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2de51510-da0d-4589-92e6-ce0fbd573d2c admin admin] The token cache is being invalidate because project fe21201961144a89be0dc3854ded0a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:21:43.290748 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2de51510-da0d-4589-92e6-ce0fbd573d2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:43.291965 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2de51510-da0d-4589-92e6-ce0fbd573d2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:43.307118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1234/2474] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:21:43 2022] DELETE /identity/v3/projects/fe21201961144a89be0dc3854ded0a2a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:43.330893 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54920f-6690-4c14-b201-2fda15041b87 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:43.331520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54920f-6690-4c14-b201-2fda15041b87 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:43.332197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54920f-6690-4c14-b201-2fda15041b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:43.398225 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5309e-8710-47d9-8ddb-e425d9593dd0 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:43.420184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1a54920f-6690-4c14-b201-2fda15041b87 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:43.426304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1a54920f-6690-4c14-b201-2fda15041b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:43.432484 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:43.548786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65afaad-ff57-4e58-a5c3-08d97f125cfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:43.549794 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65afaad-ff57-4e58-a5c3-08d97f125cfb service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:43.550255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65afaad-ff57-4e58-a5c3-08d97f125cfb service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:43.550907 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65afaad-ff57-4e58-a5c3-08d97f125cfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:43.553320 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e65afaad-ff57-4e58-a5c3-08d97f125cfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:43.567942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65afaad-ff57-4e58-a5c3-08d97f125cfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:43.569969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65afaad-ff57-4e58-a5c3-08d97f125cfb service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:43.583181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1241/2475] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:21:43.584473 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65afaad-ff57-4e58-a5c3-08d97f125cfb service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:43.585955 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e65afaad-ff57-4e58-a5c3-08d97f125cfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:43.694525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1235/2476] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:43.705122 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3507a-c230-43da-a170-bcffeb87c432 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:43.705714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3507a-c230-43da-a170-bcffeb87c432 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:43.706214 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65afaad-ff57-4e58-a5c3-08d97f125cfb service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:43.706421 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3507a-c230-43da-a170-bcffeb87c432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:43.714538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f256394-eed8-4f1f-97ed-d7487e51e6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:43.716829 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f256394-eed8-4f1f-97ed-d7487e51e6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:43.717581 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f256394-eed8-4f1f-97ed-d7487e51e6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:43.717991 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f256394-eed8-4f1f-97ed-d7487e51e6b7 admin admin] PATH_INFO: `/v3/users/6d68cd2d00bf4acf964f2bd0ecb4fe07` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:43.725029 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f256394-eed8-4f1f-97ed-d7487e51e6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d68cd2d00bf4acf964f2bd0ecb4fe07)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:43.730390 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f256394-eed8-4f1f-97ed-d7487e51e6b7 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:43.734729 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c1b3507a-c230-43da-a170-bcffeb87c432 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:43.735805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c1b3507a-c230-43da-a170-bcffeb87c432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:43.746770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1236/2477] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:43.754342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3507a-c230-43da-a170-bcffeb87c432 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:43.767077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3507a-c230-43da-a170-bcffeb87c432 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:43.776661 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e283a-7142-45d0-b87c-f8e31a2d401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:43.777641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e283a-7142-45d0-b87c-f8e31a2d401f admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:43.778017 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e283a-7142-45d0-b87c-f8e31a2d401f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:43.778452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e283a-7142-45d0-b87c-f8e31a2d401f admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:43.779504 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e283a-7142-45d0-b87c-f8e31a2d401f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:21:43.779991 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e283a-7142-45d0-b87c-f8e31a2d401f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:43.783832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e283a-7142-45d0-b87c-f8e31a2d401f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:43.806726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1237/2478] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:21:43.811639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e283a-7142-45d0-b87c-f8e31a2d401f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:43.826731 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8f256394-eed8-4f1f-97ed-d7487e51e6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d68cd2d00bf4acf964f2bd0ecb4fe07'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:43.826975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e283a-7142-45d0-b87c-f8e31a2d401f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:43.837981 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8f256394-eed8-4f1f-97ed-d7487e51e6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d68cd2d00bf4acf964f2bd0ecb4fe07'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:43.838948 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8f256394-eed8-4f1f-97ed-d7487e51e6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d68cd2d00bf4acf964f2bd0ecb4fe07'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:43.839334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bbc99-2124-487b-aab0-2d3ef01c1dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:43.840604 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bbc99-2124-487b-aab0-2d3ef01c1dcd admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:43.840990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bbc99-2124-487b-aab0-2d3ef01c1dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:43.841421 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bbc99-2124-487b-aab0-2d3ef01c1dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:43.842810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bbc99-2124-487b-aab0-2d3ef01c1dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:43.846082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bbc99-2124-487b-aab0-2d3ef01c1dcd admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:43.861459 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8f256394-eed8-4f1f-97ed-d7487e51e6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d68cd2d00bf4acf964f2bd0ecb4fe07'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:43.862392 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8f256394-eed8-4f1f-97ed-d7487e51e6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d68cd2d00bf4acf964f2bd0ecb4fe07'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:43.894150 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1242/2479] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:21:43 2022] DELETE /identity/v3/users/6d68cd2d00bf4acf964f2bd0ecb4fe07 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:43.899625 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d0b08-0835-4741-abf0-a047cae51b6d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:43.900061 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d0b08-0835-4741-abf0-a047cae51b6d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:43.900426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d0b08-0835-4741-abf0-a047cae51b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:43.906635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1238/2480] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:21:43 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:21:43.908328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bbc99-2124-487b-aab0-2d3ef01c1dcd admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:43.919239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fd3bbc99-2124-487b-aab0-2d3ef01c1dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:43.926808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c06d0b08-0835-4741-abf0-a047cae51b6d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:43.927800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c06d0b08-0835-4741-abf0-a047cae51b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:43.966849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:44.070709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1243/2481] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:21:44.080933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d0b08-0835-4741-abf0-a047cae51b6d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:44.086126 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c06d0b08-0835-4741-abf0-a047cae51b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:44.086735 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bbc99-2124-487b-aab0-2d3ef01c1dcd admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:44.096255 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93450d4e-6d01-42d2-bbba-bebad79eff38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:44.097553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93450d4e-6d01-42d2-bbba-bebad79eff38 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:44.097982 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93450d4e-6d01-42d2-bbba-bebad79eff38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:44.098360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93450d4e-6d01-42d2-bbba-bebad79eff38 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:44.099344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93450d4e-6d01-42d2-bbba-bebad79eff38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:44.102843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93450d4e-6d01-42d2-bbba-bebad79eff38 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:44.158633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1239/2482] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:21:43 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:44.165482 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93450d4e-6d01-42d2-bbba-bebad79eff38 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:44.178419 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:44.190194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93450d4e-6d01-42d2-bbba-bebad79eff38 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:44.207785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bdb1a-5507-4a4d-9e78-18674ed1c123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:44.208501 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bdb1a-5507-4a4d-9e78-18674ed1c123 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:44.208818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bdb1a-5507-4a4d-9e78-18674ed1c123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:44.209107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bdb1a-5507-4a4d-9e78-18674ed1c123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:44.210062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bdb1a-5507-4a4d-9e78-18674ed1c123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:44.211788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bdb1a-5507-4a4d-9e78-18674ed1c123 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:44.215098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d0b08-0835-4741-abf0-a047cae51b6d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:44.225778 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb62e55-1d9a-4c6d-9188-ec2fd220000d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:44.226863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62e55-1d9a-4c6d-9188-ec2fd220000d service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:44.227203 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62e55-1d9a-4c6d-9188-ec2fd220000d service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:44.227469 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62e55-1d9a-4c6d-9188-ec2fd220000d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:44.241954 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1240/2483] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:21:44.243585 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bdb1a-5507-4a4d-9e78-18674ed1c123 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:44.248994 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb62e55-1d9a-4c6d-9188-ec2fd220000d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:44.253756 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb62e55-1d9a-4c6d-9188-ec2fd220000d service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:44.256154 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bdb1a-5507-4a4d-9e78-18674ed1c123 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:44.267874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2bcb1-f4da-4144-8c6a-b108c770b315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:44.268644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2bcb1-f4da-4144-8c6a-b108c770b315 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:44.268934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2bcb1-f4da-4144-8c6a-b108c770b315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:44.269219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2bcb1-f4da-4144-8c6a-b108c770b315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:44.269981 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2bcb1-f4da-4144-8c6a-b108c770b315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:44.273051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2bcb1-f4da-4144-8c6a-b108c770b315 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:44.278539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1244/2484] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:44.297283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1241/2485] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:21:44.304548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb62e55-1d9a-4c6d-9188-ec2fd220000d service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:44.362187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb62e55-1d9a-4c6d-9188-ec2fd220000d service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:44.387796 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c1d79-9026-40fc-8ea5-0e206199b841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:44.393881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c1d79-9026-40fc-8ea5-0e206199b841 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:44.396452 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c1d79-9026-40fc-8ea5-0e206199b841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:44.397506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c1d79-9026-40fc-8ea5-0e206199b841 admin admin] PATH_INFO: `/v3/projects/394590a1bfdc474e9ff2cb1bf2d69f0d/users/9cad08b5d46a4fce898e8978f1e84edb/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:44.482504 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c1d79-9026-40fc-8ea5-0e206199b841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=394590a1bfdc474e9ff2cb1bf2d69f0d, user_id=9cad08b5d46a4fce898e8978f1e84edb, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:44.485829 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c1d79-9026-40fc-8ea5-0e206199b841 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:44.527273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1245/2486] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:44 2022] PUT /identity/v3/projects/394590a1bfdc474e9ff2cb1bf2d69f0d/users/9cad08b5d46a4fce898e8978f1e84edb/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:44.528823 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988ac3-3918-4e23-9311-9bdc2561266d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:44.529372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988ac3-3918-4e23-9311-9bdc2561266d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:44.530045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988ac3-3918-4e23-9311-9bdc2561266d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:44.584830 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3e988ac3-3918-4e23-9311-9bdc2561266d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:44.586264 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3e988ac3-3918-4e23-9311-9bdc2561266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:44.797944 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1242/2487] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:21:44.806268 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c1d79-9026-40fc-8ea5-0e206199b841 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:44.895523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e988ac3-3918-4e23-9311-9bdc2561266d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:44.898612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3e988ac3-3918-4e23-9311-9bdc2561266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:44.904550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c1d79-9026-40fc-8ea5-0e206199b841 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:44.917302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e988ac3-3918-4e23-9311-9bdc2561266d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:44.918562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e28fba-f332-4554-9062-66cccdb06743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:44.921424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e28fba-f332-4554-9062-66cccdb06743 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:44.921889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e28fba-f332-4554-9062-66cccdb06743 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:44.922235 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e28fba-f332-4554-9062-66cccdb06743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:44.926925 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:44.928366 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:44.928670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:44.928950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] PATH_INFO: `/v3/projects/6d67f4abcda849c3a6fe104c2a805051` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:44.931117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d67f4abcda849c3a6fe104c2a805051)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:44.934147 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:44.950012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e28fba-f332-4554-9062-66cccdb06743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:44.952852 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e28fba-f332-4554-9062-66cccdb06743 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:44.971036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1246/2488] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:45.023310 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d67f4abcda849c3a6fe104c2a805051', 'request_id': 'req-404b72bb-3e09-48a4-a7fc-44145ac886dd'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:45.039130 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d67f4abcda849c3a6fe104c2a805051', 'request_id': 'req-404b72bb-3e09-48a4-a7fc-44145ac886dd'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:45.048141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d67f4abcda849c3a6fe104c2a805051', 'request_id': 'req-404b72bb-3e09-48a4-a7fc-44145ac886dd'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:45.075360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] The token cache is being invalidate because project 6d67f4abcda849c3a6fe104c2a805051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:21:45.076575 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:45.078331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:45.080411 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1243/2489] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:21:44 2022] DELETE /identity/v3/projects/6d67f4abcda849c3a6fe104c2a805051 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:21:45.085509 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e28fba-f332-4554-9062-66cccdb06743 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:45.099715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e28fba-f332-4554-9062-66cccdb06743 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:45.211284 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:45.254868 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc00876-05c9-4885-a1b7-33f041c31afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:45.256745 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc00876-05c9-4885-a1b7-33f041c31afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:45.257434 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc00876-05c9-4885-a1b7-33f041c31afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:45.258253 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc00876-05c9-4885-a1b7-33f041c31afb admin admin] PATH_INFO: `/v3/users/c2d37b7828f646aa9df73ca4ba844358` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:45.261383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc00876-05c9-4885-a1b7-33f041c31afb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d37b7828f646aa9df73ca4ba844358)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:45.266725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc00876-05c9-4885-a1b7-33f041c31afb admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:45.368342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0dc00876-05c9-4885-a1b7-33f041c31afb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d37b7828f646aa9df73ca4ba844358'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:45.390161 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0dc00876-05c9-4885-a1b7-33f041c31afb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d37b7828f646aa9df73ca4ba844358'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:45.391697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0dc00876-05c9-4885-a1b7-33f041c31afb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d37b7828f646aa9df73ca4ba844358'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:45.414942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0dc00876-05c9-4885-a1b7-33f041c31afb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d37b7828f646aa9df73ca4ba844358'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:45.416404 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0dc00876-05c9-4885-a1b7-33f041c31afb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d37b7828f646aa9df73ca4ba844358'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:45.450313 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1247/2490] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:21:45 2022] DELETE /identity/v3/users/c2d37b7828f646aa9df73ca4ba844358 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:46.711983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:46.714850 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:46.728162 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69ae80-2a4f-4557-b679-7dc4580e2078 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:46.729016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69ae80-2a4f-4557-b679-7dc4580e2078 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:46.729619 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69ae80-2a4f-4557-b679-7dc4580e2078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:46.767356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b72bb-3e09-48a4-a7fc-44145ac886dd admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:46.825211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3b69ae80-2a4f-4557-b679-7dc4580e2078 None None] MFA Rules not processed for user `9cad08b5d46a4fce898e8978f1e84edb`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:46.840429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3b69ae80-2a4f-4557-b679-7dc4580e2078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:46.907037 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153772f1-4ffc-4149-97f7-8cedfbfecc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:46.908092 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153772f1-4ffc-4149-97f7-8cedfbfecc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:46.908476 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153772f1-4ffc-4149-97f7-8cedfbfecc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:46.908853 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153772f1-4ffc-4149-97f7-8cedfbfecc94 admin admin] PATH_INFO: `/v3/projects/d39bfb23465843c480fe5ad2a3743e48` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:46.911115 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153772f1-4ffc-4149-97f7-8cedfbfecc94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39bfb23465843c480fe5ad2a3743e48)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:46.913254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153772f1-4ffc-4149-97f7-8cedfbfecc94 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:46.935007 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:47.020745 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1248/2491] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:21:47.033182 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69ae80-2a4f-4557-b679-7dc4580e2078 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:47.039793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3b69ae80-2a4f-4557-b679-7dc4580e2078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:47.051878 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-153772f1-4ffc-4149-97f7-8cedfbfecc94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39bfb23465843c480fe5ad2a3743e48', 'request_id': 'req-153772f1-4ffc-4149-97f7-8cedfbfecc94'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:47.063323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-153772f1-4ffc-4149-97f7-8cedfbfecc94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39bfb23465843c480fe5ad2a3743e48', 'request_id': 'req-153772f1-4ffc-4149-97f7-8cedfbfecc94'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:47.078966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-153772f1-4ffc-4149-97f7-8cedfbfecc94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39bfb23465843c480fe5ad2a3743e48', 'request_id': 'req-153772f1-4ffc-4149-97f7-8cedfbfecc94'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:47.091749 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-153772f1-4ffc-4149-97f7-8cedfbfecc94 admin admin] The token cache is being invalidate because project d39bfb23465843c480fe5ad2a3743e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:21:47.092285 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-153772f1-4ffc-4149-97f7-8cedfbfecc94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:47.093053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-153772f1-4ffc-4149-97f7-8cedfbfecc94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:21:47.099697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1244/2492] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:21:46 2022] DELETE /identity/v3/projects/d39bfb23465843c480fe5ad2a3743e48 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:47.101911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f40fbd-46b1-42bf-9c6e-a858996866d4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:47.102308 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f40fbd-46b1-42bf-9c6e-a858996866d4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:47.102727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f40fbd-46b1-42bf-9c6e-a858996866d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:47.141072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-88f40fbd-46b1-42bf-9c6e-a858996866d4 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:47.143977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-88f40fbd-46b1-42bf-9c6e-a858996866d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:47.213981 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69ae80-2a4f-4557-b679-7dc4580e2078 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:47.227839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:47.293477 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1245/2493] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:21:47.297460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb9494-7a51-4193-9f9f-c0df363f53a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:47.298141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb9494-7a51-4193-9f9f-c0df363f53a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:47.298428 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb9494-7a51-4193-9f9f-c0df363f53a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:47.298736 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb9494-7a51-4193-9f9f-c0df363f53a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:47.300905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-16bb9494-7a51-4193-9f9f-c0df363f53a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:47.305341 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47c06f-3f90-47a2-8c78-5bbea1df3859 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:47.305779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47c06f-3f90-47a2-8c78-5bbea1df3859 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:47.306482 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47c06f-3f90-47a2-8c78-5bbea1df3859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:47.343146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2e47c06f-3f90-47a2-8c78-5bbea1df3859 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:47.344418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2e47c06f-3f90-47a2-8c78-5bbea1df3859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:47.353428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1246/2494] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:47.366996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47c06f-3f90-47a2-8c78-5bbea1df3859 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:47.384521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47c06f-3f90-47a2-8c78-5bbea1df3859 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:47.389530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8b3a0-0f24-443c-8d2d-8360c9eed80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:47.390364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8b3a0-0f24-443c-8d2d-8360c9eed80f admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:47.390670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8b3a0-0f24-443c-8d2d-8360c9eed80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:47.390960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8b3a0-0f24-443c-8d2d-8360c9eed80f admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:47.391708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8b3a0-0f24-443c-8d2d-8360c9eed80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:21:47.392017 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8b3a0-0f24-443c-8d2d-8360c9eed80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:47.393658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8b3a0-0f24-443c-8d2d-8360c9eed80f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:47.402332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb9494-7a51-4193-9f9f-c0df363f53a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:47.405270 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb9494-7a51-4193-9f9f-c0df363f53a1 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:47.417570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1247/2495] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:21:47.418910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8b3a0-0f24-443c-8d2d-8360c9eed80f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:47.431147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1249/2496] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:47.435211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8b3a0-0f24-443c-8d2d-8360c9eed80f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:47.441887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc401492-2003-4acf-971a-e16a4ed1f420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:47.443060 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc401492-2003-4acf-971a-e16a4ed1f420 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:47.443336 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc401492-2003-4acf-971a-e16a4ed1f420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:47.443778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc401492-2003-4acf-971a-e16a4ed1f420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:47.444496 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc401492-2003-4acf-971a-e16a4ed1f420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:47.447454 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc401492-2003-4acf-971a-e16a4ed1f420 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:47.498271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1248/2497] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:21:47 2022] POST /identity/v3/projects => generated 357 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:47.504902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb9494-7a51-4193-9f9f-c0df363f53a1 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:47.525093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb9494-7a51-4193-9f9f-c0df363f53a1 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:47.657116 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24706396-d528-4fdb-adf5-04d1c7f5d9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:47.662909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24706396-d528-4fdb-adf5-04d1c7f5d9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:47.663548 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24706396-d528-4fdb-adf5-04d1c7f5d9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:47.664074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24706396-d528-4fdb-adf5-04d1c7f5d9a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:47.666187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24706396-d528-4fdb-adf5-04d1c7f5d9a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:47.670767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24706396-d528-4fdb-adf5-04d1c7f5d9a1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:47.728754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1250/2498] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:21:47 2022] POST /identity/v3/users => generated 279 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:21:47.730817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc401492-2003-4acf-971a-e16a4ed1f420 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:47.766210 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc401492-2003-4acf-971a-e16a4ed1f420 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:47.784072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19f72d-7391-448a-acde-d1025290bf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:47.785564 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19f72d-7391-448a-acde-d1025290bf0b admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:47.786016 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19f72d-7391-448a-acde-d1025290bf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:47.786485 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19f72d-7391-448a-acde-d1025290bf0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:47.787618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19f72d-7391-448a-acde-d1025290bf0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:47.797630 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19f72d-7391-448a-acde-d1025290bf0b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:47.829824 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1249/2499] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:47.835406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24706396-d528-4fdb-adf5-04d1c7f5d9a1 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:47.865143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24706396-d528-4fdb-adf5-04d1c7f5d9a1 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:47.894494 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa36d59-05b4-46d3-8263-103eeb71fa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:47.895492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa36d59-05b4-46d3-8263-103eeb71fa1c admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:47.895785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa36d59-05b4-46d3-8263-103eeb71fa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:47.896063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa36d59-05b4-46d3-8263-103eeb71fa1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:47.896831 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa36d59-05b4-46d3-8263-103eeb71fa1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:47.898492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa36d59-05b4-46d3-8263-103eeb71fa1c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:47.928209 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1251/2500] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:21:47.933383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19f72d-7391-448a-acde-d1025290bf0b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:47.968510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19f72d-7391-448a-acde-d1025290bf0b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:47.995126 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ffd73-b2de-4712-90cb-eddb4d22f00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:47.996803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ffd73-b2de-4712-90cb-eddb4d22f00b admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:47.997283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ffd73-b2de-4712-90cb-eddb4d22f00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:47.997698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ffd73-b2de-4712-90cb-eddb4d22f00b admin admin] PATH_INFO: `/v3/projects/bb61c85b841a4cf5b69df4d8aece256d/users/0e8173c2c0a14d5e8f66b6ad211be50a/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:48.036778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ffd73-b2de-4712-90cb-eddb4d22f00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb61c85b841a4cf5b69df4d8aece256d, user_id=0e8173c2c0a14d5e8f66b6ad211be50a, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:48.043682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ffd73-b2de-4712-90cb-eddb4d22f00b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:48.081270 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1250/2501] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:47 2022] PUT /identity/v3/projects/bb61c85b841a4cf5b69df4d8aece256d/users/0e8173c2c0a14d5e8f66b6ad211be50a/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:48.093233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6efe14-527c-4310-821a-b558bc884548 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:48.093550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6efe14-527c-4310-821a-b558bc884548 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:48.093799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6efe14-527c-4310-821a-b558bc884548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:48.141539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-be6efe14-527c-4310-821a-b558bc884548 None None] MFA Rules not processed for user `0e8173c2c0a14d5e8f66b6ad211be50a`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:48.144047 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-be6efe14-527c-4310-821a-b558bc884548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:48.235495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:48.308194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1252/2502] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:48 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:48.313372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ffd73-b2de-4712-90cb-eddb4d22f00b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:48.347554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:48.402058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ffd73-b2de-4712-90cb-eddb4d22f00b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:48.408059 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6415c4-2b12-4b13-b754-76102c9d6f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:48.409053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6415c4-2b12-4b13-b754-76102c9d6f85 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:48.409053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6415c4-2b12-4b13-b754-76102c9d6f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:48.409283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6415c4-2b12-4b13-b754-76102c9d6f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:48.409972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6415c4-2b12-4b13-b754-76102c9d6f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:48.411927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6415c4-2b12-4b13-b754-76102c9d6f85 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:48.449004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1251/2503] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:21:48 2022] POST /identity/v3/projects => generated 357 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:48.454503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6efe14-527c-4310-821a-b558bc884548 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:48.471240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6efe14-527c-4310-821a-b558bc884548 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:48.549000 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d927646-4035-4532-a6d3-44ba93a9dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:48.550430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927646-4035-4532-a6d3-44ba93a9dd9b admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:48.551004 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927646-4035-4532-a6d3-44ba93a9dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:48.551246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927646-4035-4532-a6d3-44ba93a9dd9b admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:48.551860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d927646-4035-4532-a6d3-44ba93a9dd9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:48.554083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d927646-4035-4532-a6d3-44ba93a9dd9b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:48.582019 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1253/2504] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:21:48 2022] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:21:48.586509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6415c4-2b12-4b13-b754-76102c9d6f85 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:48.612471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6415c4-2b12-4b13-b754-76102c9d6f85 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:48.621123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0364f6b-5933-49e5-8cf0-ee6347ad1d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:48.621885 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0364f6b-5933-49e5-8cf0-ee6347ad1d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:48.622227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0364f6b-5933-49e5-8cf0-ee6347ad1d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:48.622544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0364f6b-5933-49e5-8cf0-ee6347ad1d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:48.623507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0364f6b-5933-49e5-8cf0-ee6347ad1d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:48.625308 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0364f6b-5933-49e5-8cf0-ee6347ad1d05 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:48.643067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1252/2505] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:21:48.646275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d927646-4035-4532-a6d3-44ba93a9dd9b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:48.659899 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d927646-4035-4532-a6d3-44ba93a9dd9b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:48.665614 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63573840-cbf7-4da5-8ff4-79cc09b7e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:48.666535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63573840-cbf7-4da5-8ff4-79cc09b7e36a admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:48.666853 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63573840-cbf7-4da5-8ff4-79cc09b7e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:48.667130 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63573840-cbf7-4da5-8ff4-79cc09b7e36a admin admin] PATH_INFO: `/v3/projects/40b2bd4934f9476bae85374bd58d9354/users/eabef8f1308c4206b6deea04b2be366d/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:48.686875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63573840-cbf7-4da5-8ff4-79cc09b7e36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b2bd4934f9476bae85374bd58d9354, user_id=eabef8f1308c4206b6deea04b2be366d, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:48.690361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63573840-cbf7-4da5-8ff4-79cc09b7e36a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:48.709448 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1254/2506] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:48 2022] PUT /identity/v3/projects/40b2bd4934f9476bae85374bd58d9354/users/eabef8f1308c4206b6deea04b2be366d/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:21:48.713705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0364f6b-5933-49e5-8cf0-ee6347ad1d05 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:48.729484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0364f6b-5933-49e5-8cf0-ee6347ad1d05 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:48.814356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc32d7-0097-4325-9026-c8db2d021140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:48.815234 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc32d7-0097-4325-9026-c8db2d021140 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:48.815513 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc32d7-0097-4325-9026-c8db2d021140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:48.815789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc32d7-0097-4325-9026-c8db2d021140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:48.816530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc32d7-0097-4325-9026-c8db2d021140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:48.818141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc32d7-0097-4325-9026-c8db2d021140 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:48.836737 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1253/2507] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:21:48.840911 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63573840-cbf7-4da5-8ff4-79cc09b7e36a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:48.852355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63573840-cbf7-4da5-8ff4-79cc09b7e36a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:48.857374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33b79c-ed83-4788-bff2-f91aa612a017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:48.858282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33b79c-ed83-4788-bff2-f91aa612a017 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:48.858569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33b79c-ed83-4788-bff2-f91aa612a017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:48.858885 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33b79c-ed83-4788-bff2-f91aa612a017 admin admin] PATH_INFO: `/v3/projects/40b2bd4934f9476bae85374bd58d9354/users/eabef8f1308c4206b6deea04b2be366d/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:48.860955 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33b79c-ed83-4788-bff2-f91aa612a017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b2bd4934f9476bae85374bd58d9354, user_id=eabef8f1308c4206b6deea04b2be366d, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:48.864388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33b79c-ed83-4788-bff2-f91aa612a017 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:48.876898 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1255/2508] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:21:48 2022] PUT /identity/v3/projects/40b2bd4934f9476bae85374bd58d9354/users/eabef8f1308c4206b6deea04b2be366d/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:21:48.888473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e0afa-c97e-4311-ab82-a36b2718f84e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:48.888948 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e0afa-c97e-4311-ab82-a36b2718f84e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:48.889321 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e0afa-c97e-4311-ab82-a36b2718f84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:48.921651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-539e0afa-c97e-4311-ab82-a36b2718f84e None None] MFA Rules not processed for user `eabef8f1308c4206b6deea04b2be366d`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:48.923074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-539e0afa-c97e-4311-ab82-a36b2718f84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:49.029819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1254/2509] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:48 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:49.030073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb7400-bbc4-407c-9ed7-24bf8735f7d9 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:49.030223 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb7400-bbc4-407c-9ed7-24bf8735f7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:49.030504 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb7400-bbc4-407c-9ed7-24bf8735f7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:49.042206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e0afa-c97e-4311-ab82-a36b2718f84e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:49.043891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-539e0afa-c97e-4311-ab82-a36b2718f84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:49.061534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f8bb7400-bbc4-407c-9ed7-24bf8735f7d9 None None] MFA Rules not processed for user `9cad08b5d46a4fce898e8978f1e84edb`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:21:49.062809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f8bb7400-bbc4-407c-9ed7-24bf8735f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:49.066819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:49.114005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e0afa-c97e-4311-ab82-a36b2718f84e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:49.117820 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5be86-e5d6-4cbb-aa88-d826420b3656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:49.118502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5be86-e5d6-4cbb-aa88-d826420b3656 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:49.118809 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5be86-e5d6-4cbb-aa88-d826420b3656 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:49.119090 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5be86-e5d6-4cbb-aa88-d826420b3656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:49.131932 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5be86-e5d6-4cbb-aa88-d826420b3656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:49.133584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5be86-e5d6-4cbb-aa88-d826420b3656 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:49.148745 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1255/2510] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:49 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:49.178576 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1256/2511] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:21:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:21:49.249372 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5be86-e5d6-4cbb-aa88-d826420b3656 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:49.263766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5be86-e5d6-4cbb-aa88-d826420b3656 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:49.270123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc8458-ae39-442a-ad9f-8e6078814706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:49.272308 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8458-ae39-442a-ad9f-8e6078814706 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:49.273041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8458-ae39-442a-ad9f-8e6078814706 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:49.273754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8458-ae39-442a-ad9f-8e6078814706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:49.426932 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc8458-ae39-442a-ad9f-8e6078814706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:49.429361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc8458-ae39-442a-ad9f-8e6078814706 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:49.443717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1256/2512] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:49 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:21:49.505371 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb7400-bbc4-407c-9ed7-24bf8735f7d9 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:49.507206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f8bb7400-bbc4-407c-9ed7-24bf8735f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:49.562488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:21:49.607318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb7400-bbc4-407c-9ed7-24bf8735f7d9 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:49.611575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40d247-e37d-4296-a48c-e9aa095e1bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:49.612246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40d247-e37d-4296-a48c-e9aa095e1bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:49.612527 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40d247-e37d-4296-a48c-e9aa095e1bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:49.612799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40d247-e37d-4296-a48c-e9aa095e1bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:49.615277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1e40d247-e37d-4296-a48c-e9aa095e1bc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:49.628409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40d247-e37d-4296-a48c-e9aa095e1bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:49.630886 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40d247-e37d-4296-a48c-e9aa095e1bc8 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:49.650176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1257/2513] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:53.494367 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc8458-ae39-442a-ad9f-8e6078814706 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:21:53.497374 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-79fc8458-ae39-442a-ad9f-8e6078814706 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:53.622204 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc8458-ae39-442a-ad9f-8e6078814706 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:21:53.628056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3717e47-a218-479c-b949-d334881ab4d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:21:53.628056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717e47-a218-479c-b949-d334881ab4d8 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:21:53.628056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717e47-a218-479c-b949-d334881ab4d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:21:53.629275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717e47-a218-479c-b949-d334881ab4d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:21:53.632767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d3717e47-a218-479c-b949-d334881ab4d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:21:53.658716 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3717e47-a218-479c-b949-d334881ab4d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:21:53.661134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3717e47-a218-479c-b949-d334881ab4d8 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:21:53.676778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1257/2514] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:21:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:21:59.639065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=11 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:03.411709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e52c0-9570-475d-8093-29eb1dbaffbe None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:03.412355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e52c0-9570-475d-8093-29eb1dbaffbe None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:03.412355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e52c0-9570-475d-8093-29eb1dbaffbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:03.432251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f84e52c0-9570-475d-8093-29eb1dbaffbe None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:03.436536 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f84e52c0-9570-475d-8093-29eb1dbaffbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:03.517642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1258/2515] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:22:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:03.532137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3717e47-a218-479c-b949-d334881ab4d8 service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:03.534756 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d3717e47-a218-479c-b949-d334881ab4d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:03.599047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:03.657612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3717e47-a218-479c-b949-d334881ab4d8 service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:03.663071 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fce9e2-cd87-4a36-b042-53bcbee713a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:03.663955 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fce9e2-cd87-4a36-b042-53bcbee713a6 service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:03.664241 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fce9e2-cd87-4a36-b042-53bcbee713a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:03.664510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fce9e2-cd87-4a36-b042-53bcbee713a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:03.677333 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fce9e2-cd87-4a36-b042-53bcbee713a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:03.681750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fce9e2-cd87-4a36-b042-53bcbee713a6 service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:03.691991 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1258/2516] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:22:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:22:06.036766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e52c0-9570-475d-8093-29eb1dbaffbe None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:06.136444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e52c0-9570-475d-8093-29eb1dbaffbe None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:06.142047 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82cae0-2064-4b18-b95b-4b993603b181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:06.143171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82cae0-2064-4b18-b95b-4b993603b181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:06.143562 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82cae0-2064-4b18-b95b-4b993603b181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:06.143939 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82cae0-2064-4b18-b95b-4b993603b181 admin admin] PATH_INFO: `/v3/users/0e8173c2c0a14d5e8f66b6ad211be50a` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:06.145433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82cae0-2064-4b18-b95b-4b993603b181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8173c2c0a14d5e8f66b6ad211be50a)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:06.147588 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82cae0-2064-4b18-b95b-4b993603b181 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:06.327569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5c82cae0-2064-4b18-b95b-4b993603b181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8173c2c0a14d5e8f66b6ad211be50a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:06.341239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5c82cae0-2064-4b18-b95b-4b993603b181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8173c2c0a14d5e8f66b6ad211be50a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:06.342445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5c82cae0-2064-4b18-b95b-4b993603b181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8173c2c0a14d5e8f66b6ad211be50a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:06.359098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5c82cae0-2064-4b18-b95b-4b993603b181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8173c2c0a14d5e8f66b6ad211be50a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:06.360485 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5c82cae0-2064-4b18-b95b-4b993603b181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8173c2c0a14d5e8f66b6ad211be50a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:06.394766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80165-18f6-4f85-a887-714d1ee8b34f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:06.395733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80165-18f6-4f85-a887-714d1ee8b34f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:06.396207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80165-18f6-4f85-a887-714d1ee8b34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:06.397689 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1259/2517] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:22:06 2022] DELETE /identity/v3/users/0e8173c2c0a14d5e8f66b6ad211be50a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:06.424254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-19f80165-18f6-4f85-a887-714d1ee8b34f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:06.425981 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-19f80165-18f6-4f85-a887-714d1ee8b34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:06.574084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1259/2518] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:06.596245 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82cae0-2064-4b18-b95b-4b993603b181 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:06.598857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5c82cae0-2064-4b18-b95b-4b993603b181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:06.643545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:06.693570 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82cae0-2064-4b18-b95b-4b993603b181 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:06.698022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457142a-ccd1-48c8-ae24-0a1b724c7a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:06.698994 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457142a-ccd1-48c8-ae24-0a1b724c7a97 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:06.699462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457142a-ccd1-48c8-ae24-0a1b724c7a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:06.699910 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457142a-ccd1-48c8-ae24-0a1b724c7a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:06.711786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457142a-ccd1-48c8-ae24-0a1b724c7a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:06.713984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457142a-ccd1-48c8-ae24-0a1b724c7a97 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:06.728227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1260/2519] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:06.760170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f80165-18f6-4f85-a887-714d1ee8b34f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:06.764483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-19f80165-18f6-4f85-a887-714d1ee8b34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:06.785495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f80165-18f6-4f85-a887-714d1ee8b34f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:06.790731 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ee655-43ee-4988-859e-ff72d6925d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:06.791670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee655-43ee-4988-859e-ff72d6925d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:06.791953 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee655-43ee-4988-859e-ff72d6925d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:06.792279 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee655-43ee-4988-859e-ff72d6925d18 admin admin] PATH_INFO: `/v3/users/00117065f3de478c81365045c925fcd6` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:06.793508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ee655-43ee-4988-859e-ff72d6925d18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00117065f3de478c81365045c925fcd6)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:06.795968 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ee655-43ee-4988-859e-ff72d6925d18 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:06.905370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e95ee655-43ee-4988-859e-ff72d6925d18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00117065f3de478c81365045c925fcd6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:06.905370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e95ee655-43ee-4988-859e-ff72d6925d18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00117065f3de478c81365045c925fcd6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:06.944229 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e95ee655-43ee-4988-859e-ff72d6925d18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00117065f3de478c81365045c925fcd6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:06.959712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e95ee655-43ee-4988-859e-ff72d6925d18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00117065f3de478c81365045c925fcd6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:06.962310 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e95ee655-43ee-4988-859e-ff72d6925d18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00117065f3de478c81365045c925fcd6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:07.005505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1260/2520] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:22:06 2022] DELETE /identity/v3/users/00117065f3de478c81365045c925fcd6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:07.012141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2625c-b0b8-4e15-a199-37ac7391f1dc None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:07.012713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2625c-b0b8-4e15-a199-37ac7391f1dc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:07.013092 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2625c-b0b8-4e15-a199-37ac7391f1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:07.038201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-28d2625c-b0b8-4e15-a199-37ac7391f1dc None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:07.039641 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-28d2625c-b0b8-4e15-a199-37ac7391f1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:07.133238 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1261/2521] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:07.151909 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ee655-43ee-4988-859e-ff72d6925d18 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:07.153507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2625c-b0b8-4e15-a199-37ac7391f1dc None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:07.153644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e95ee655-43ee-4988-859e-ff72d6925d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:07.155750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-28d2625c-b0b8-4e15-a199-37ac7391f1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:07.181015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ee655-43ee-4988-859e-ff72d6925d18 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:07.191178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:07.193779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:07.196213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:07.196213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] PATH_INFO: `/v3/projects/bb61c85b841a4cf5b69df4d8aece256d` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:07.211314 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb61c85b841a4cf5b69df4d8aece256d)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:07.214704 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:07.295449 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2625c-b0b8-4e15-a199-37ac7391f1dc None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:07.311342 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d2d7e-dcb7-482a-9177-1a7d31852bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:07.312068 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d2d7e-dcb7-482a-9177-1a7d31852bad service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:07.312361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d2d7e-dcb7-482a-9177-1a7d31852bad service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:07.312646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d2d7e-dcb7-482a-9177-1a7d31852bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:07.327663 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d2d7e-dcb7-482a-9177-1a7d31852bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:07.332018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d2d7e-dcb7-482a-9177-1a7d31852bad service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:07.334349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:07.354836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb61c85b841a4cf5b69df4d8aece256d', 'request_id': 'req-42488eb3-9931-4375-94a2-720bdecd707d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:07.357116 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1262/2522] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:22:07.389780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb61c85b841a4cf5b69df4d8aece256d', 'request_id': 'req-42488eb3-9931-4375-94a2-720bdecd707d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:07.397918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb61c85b841a4cf5b69df4d8aece256d', 'request_id': 'req-42488eb3-9931-4375-94a2-720bdecd707d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:07.413585 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] The token cache is being invalidate because project bb61c85b841a4cf5b69df4d8aece256d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:22:07.414446 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:07.415407 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:07.417665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1261/2523] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:22:07 2022] DELETE /identity/v3/projects/bb61c85b841a4cf5b69df4d8aece256d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:07.422379 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d2d7e-dcb7-482a-9177-1a7d31852bad service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:07.442507 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d2d7e-dcb7-482a-9177-1a7d31852bad service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:07.549745 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7755635-57af-4b29-9769-5516099229cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:07.552702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7755635-57af-4b29-9769-5516099229cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:07.553076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7755635-57af-4b29-9769-5516099229cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:07.553756 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7755635-57af-4b29-9769-5516099229cd admin admin] PATH_INFO: `/v3/users/eabef8f1308c4206b6deea04b2be366d` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:07.555538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7755635-57af-4b29-9769-5516099229cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=eabef8f1308c4206b6deea04b2be366d)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:07.558388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7755635-57af-4b29-9769-5516099229cd admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:07.579569 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:07.662932 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d7755635-57af-4b29-9769-5516099229cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eabef8f1308c4206b6deea04b2be366d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:07.688863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d7755635-57af-4b29-9769-5516099229cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eabef8f1308c4206b6deea04b2be366d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:07.690399 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d7755635-57af-4b29-9769-5516099229cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eabef8f1308c4206b6deea04b2be366d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:07.723202 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d7755635-57af-4b29-9769-5516099229cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eabef8f1308c4206b6deea04b2be366d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:07.726716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d7755635-57af-4b29-9769-5516099229cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eabef8f1308c4206b6deea04b2be366d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:07.764455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1263/2524] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:22:07 2022] DELETE /identity/v3/users/eabef8f1308c4206b6deea04b2be366d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:08.012188 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:08.014375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:08.095711 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42488eb3-9931-4375-94a2-720bdecd707d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:08.243296 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:08.245030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:08.245480 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:08.247882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] PATH_INFO: `/v3/projects/51d260c797c8434e803bd98f18401b5d` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:08.252724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d260c797c8434e803bd98f18401b5d)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:08.255856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:08.347033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7755635-57af-4b29-9769-5516099229cd admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:08.348031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d260c797c8434e803bd98f18401b5d', 'request_id': 'req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.349374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d7755635-57af-4b29-9769-5516099229cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:08.362270 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d260c797c8434e803bd98f18401b5d', 'request_id': 'req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.371387 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7755635-57af-4b29-9769-5516099229cd admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:08.375849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d260c797c8434e803bd98f18401b5d', 'request_id': 'req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.399465 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] The token cache is being invalidate because project 51d260c797c8434e803bd98f18401b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:22:08.401314 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.402863 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.406691 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1262/2525] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:22:08 2022] DELETE /identity/v3/projects/51d260c797c8434e803bd98f18401b5d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:08.412253 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:08.415051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:08.506938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32ddf8-01c3-430f-923c-4be90402e27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:08.509592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32ddf8-01c3-430f-923c-4be90402e27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:08.510387 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32ddf8-01c3-430f-923c-4be90402e27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:08.512662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32ddf8-01c3-430f-923c-4be90402e27f admin admin] PATH_INFO: `/v3/projects/40b2bd4934f9476bae85374bd58d9354` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:08.516350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32ddf8-01c3-430f-923c-4be90402e27f admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b2bd4934f9476bae85374bd58d9354)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:08.529244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:08.535639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf476cc-d860-4b46-9bfb-4f0c872b28c7 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:08.547514 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcb100-c4ed-46da-b641-3e1c005d6468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:08.549561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcb100-c4ed-46da-b641-3e1c005d6468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:08.551035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcb100-c4ed-46da-b641-3e1c005d6468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:08.551954 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcb100-c4ed-46da-b641-3e1c005d6468 admin admin] PATH_INFO: `/v3/users/9f6efd938ccf42c79f17dfc0f517b6e6` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:08.553129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32ddf8-01c3-430f-923c-4be90402e27f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:08.554492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcb100-c4ed-46da-b641-3e1c005d6468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f6efd938ccf42c79f17dfc0f517b6e6)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:08.558754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcb100-c4ed-46da-b641-3e1c005d6468 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:08.684533 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b2fcb100-c4ed-46da-b641-3e1c005d6468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f6efd938ccf42c79f17dfc0f517b6e6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.685534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b2fcb100-c4ed-46da-b641-3e1c005d6468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f6efd938ccf42c79f17dfc0f517b6e6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.716787 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2b32ddf8-01c3-430f-923c-4be90402e27f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b2bd4934f9476bae85374bd58d9354', 'request_id': 'req-2b32ddf8-01c3-430f-923c-4be90402e27f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.721023 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b2fcb100-c4ed-46da-b641-3e1c005d6468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f6efd938ccf42c79f17dfc0f517b6e6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.733284 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2b32ddf8-01c3-430f-923c-4be90402e27f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b2bd4934f9476bae85374bd58d9354', 'request_id': 'req-2b32ddf8-01c3-430f-923c-4be90402e27f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.735389 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b2fcb100-c4ed-46da-b641-3e1c005d6468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f6efd938ccf42c79f17dfc0f517b6e6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.736181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b2fcb100-c4ed-46da-b641-3e1c005d6468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f6efd938ccf42c79f17dfc0f517b6e6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.746332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2b32ddf8-01c3-430f-923c-4be90402e27f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b2bd4934f9476bae85374bd58d9354', 'request_id': 'req-2b32ddf8-01c3-430f-923c-4be90402e27f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.759996 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1263/2526] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:22:08 2022] DELETE /identity/v3/users/9f6efd938ccf42c79f17dfc0f517b6e6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:22:08.760482 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2b32ddf8-01c3-430f-923c-4be90402e27f admin admin] The token cache is being invalidate because project 40b2bd4934f9476bae85374bd58d9354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:22:08.760834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2b32ddf8-01c3-430f-923c-4be90402e27f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.761702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-2b32ddf8-01c3-430f-923c-4be90402e27f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:08.767647 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1264/2527] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:22:08 2022] DELETE /identity/v3/projects/40b2bd4934f9476bae85374bd58d9354 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:22:08.772999 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a735a90-457c-461b-9287-3d6395ab0049 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:08.773304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a735a90-457c-461b-9287-3d6395ab0049 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:08.773585 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a735a90-457c-461b-9287-3d6395ab0049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:08.800236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2a735a90-457c-461b-9287-3d6395ab0049 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:08.801627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2a735a90-457c-461b-9287-3d6395ab0049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:09.008031 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1264/2528] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:09.018918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf2d33-5a3c-4988-b6d1-bec3629a848a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:09.019187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf2d33-5a3c-4988-b6d1-bec3629a848a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:09.019504 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf2d33-5a3c-4988-b6d1-bec3629a848a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:09.074216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5bdf2d33-5a3c-4988-b6d1-bec3629a848a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:09.075646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5bdf2d33-5a3c-4988-b6d1-bec3629a848a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:09.096654 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1265/2529] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:22:09.101044 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a735a90-457c-461b-9287-3d6395ab0049 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:09.115611 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a735a90-457c-461b-9287-3d6395ab0049 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:09.126061 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b12ec0-44d0-4989-bbac-be45f44964cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:09.126790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b12ec0-44d0-4989-bbac-be45f44964cb admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:09.127522 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b12ec0-44d0-4989-bbac-be45f44964cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:09.127746 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b12ec0-44d0-4989-bbac-be45f44964cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:09.128597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b12ec0-44d0-4989-bbac-be45f44964cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:22:09.128911 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b12ec0-44d0-4989-bbac-be45f44964cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:09.130582 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b12ec0-44d0-4989-bbac-be45f44964cb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:09.157444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1265/2530] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:22:09.162481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf2d33-5a3c-4988-b6d1-bec3629a848a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:09.178876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf2d33-5a3c-4988-b6d1-bec3629a848a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:09.185355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4b7e8-8ca9-4492-8339-7446cceedadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:09.186633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4b7e8-8ca9-4492-8339-7446cceedadd admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:09.186999 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4b7e8-8ca9-4492-8339-7446cceedadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:09.189462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4b7e8-8ca9-4492-8339-7446cceedadd admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:09.197141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4b7e8-8ca9-4492-8339-7446cceedadd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:09.199267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4b7e8-8ca9-4492-8339-7446cceedadd admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:09.212180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:09.252869 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1266/2531] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:22:09 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:22:09.256925 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b12ec0-44d0-4989-bbac-be45f44964cb admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:09.274066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b12ec0-44d0-4989-bbac-be45f44964cb admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:09.456197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1fc96-da7c-4eeb-87be-4d063210e53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:09.459183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1fc96-da7c-4eeb-87be-4d063210e53a admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:09.459183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1fc96-da7c-4eeb-87be-4d063210e53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:09.459183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1fc96-da7c-4eeb-87be-4d063210e53a admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:09.460813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1fc96-da7c-4eeb-87be-4d063210e53a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:09.468301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1fc96-da7c-4eeb-87be-4d063210e53a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:09.505696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:09.593570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1266/2532] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:22:09 2022] POST /identity/v3/users => generated 293 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:09.594902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4b7e8-8ca9-4492-8339-7446cceedadd admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:09.610460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4b7e8-8ca9-4492-8339-7446cceedadd admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:09.621837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355ae3e-95c5-4163-9689-8be5df077e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:09.623079 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355ae3e-95c5-4163-9689-8be5df077e18 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:09.624114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355ae3e-95c5-4163-9689-8be5df077e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:09.624114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355ae3e-95c5-4163-9689-8be5df077e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:09.626145 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355ae3e-95c5-4163-9689-8be5df077e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:09.629239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355ae3e-95c5-4163-9689-8be5df077e18 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:09.651769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1267/2533] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:09.651990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1fc96-da7c-4eeb-87be-4d063210e53a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:09.675981 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355ae3e-95c5-4163-9689-8be5df077e18 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:09.678192 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1355ae3e-95c5-4163-9689-8be5df077e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:09.680593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1fc96-da7c-4eeb-87be-4d063210e53a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:09.692546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaef0d-83db-4efe-8de1-4be80ee2c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:09.693251 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaef0d-83db-4efe-8de1-4be80ee2c4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:09.693592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaef0d-83db-4efe-8de1-4be80ee2c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:09.693819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaef0d-83db-4efe-8de1-4be80ee2c4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:09.694590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eaef0d-83db-4efe-8de1-4be80ee2c4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:09.696395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eaef0d-83db-4efe-8de1-4be80ee2c4c2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:09.702891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355ae3e-95c5-4163-9689-8be5df077e18 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:09.729018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1267/2534] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:09.735132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaef0d-83db-4efe-8de1-4be80ee2c4c2 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:09.737155 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605cb8a-67b5-4414-a80f-d2649d2492e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:09.738524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605cb8a-67b5-4414-a80f-d2649d2492e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:09.738855 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605cb8a-67b5-4414-a80f-d2649d2492e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:09.739185 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605cb8a-67b5-4414-a80f-d2649d2492e3 admin admin] PATH_INFO: `/v3/projects/f9f0036830414a1f8fdcc2c4cb80c912` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:09.740923 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605cb8a-67b5-4414-a80f-d2649d2492e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f0036830414a1f8fdcc2c4cb80c912)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:09.743843 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605cb8a-67b5-4414-a80f-d2649d2492e3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:09.753514 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaef0d-83db-4efe-8de1-4be80ee2c4c2 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:09.761139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04830e0-ad74-43c3-82b5-8a4ae25a59d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:09.763277 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04830e0-ad74-43c3-82b5-8a4ae25a59d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:09.764368 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04830e0-ad74-43c3-82b5-8a4ae25a59d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:09.764918 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04830e0-ad74-43c3-82b5-8a4ae25a59d1 admin admin] PATH_INFO: `/v3/projects/ac288d15cc394e9880391135282172de/users/97de481a92b9493b9f9f3f1c65fb28c1/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:09.788682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04830e0-ad74-43c3-82b5-8a4ae25a59d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac288d15cc394e9880391135282172de, user_id=97de481a92b9493b9f9f3f1c65fb28c1, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:09.794471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04830e0-ad74-43c3-82b5-8a4ae25a59d1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:09.820050 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1268/2535] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:09 2022] PUT /identity/v3/projects/ac288d15cc394e9880391135282172de/users/97de481a92b9493b9f9f3f1c65fb28c1/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:09.833909 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51585a8-7f3b-4804-925e-2c46292458a1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:09.834684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51585a8-7f3b-4804-925e-2c46292458a1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:09.834973 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51585a8-7f3b-4804-925e-2c46292458a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:09.869742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5605cb8a-67b5-4414-a80f-d2649d2492e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f0036830414a1f8fdcc2c4cb80c912', 'request_id': 'req-5605cb8a-67b5-4414-a80f-d2649d2492e3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:09.885193 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5605cb8a-67b5-4414-a80f-d2649d2492e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f0036830414a1f8fdcc2c4cb80c912', 'request_id': 'req-5605cb8a-67b5-4414-a80f-d2649d2492e3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:09.886887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c51585a8-7f3b-4804-925e-2c46292458a1 None None] MFA Rules not processed for user `97de481a92b9493b9f9f3f1c65fb28c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:09.888324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c51585a8-7f3b-4804-925e-2c46292458a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:09.897713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5605cb8a-67b5-4414-a80f-d2649d2492e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f0036830414a1f8fdcc2c4cb80c912', 'request_id': 'req-5605cb8a-67b5-4414-a80f-d2649d2492e3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:09.914878 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5605cb8a-67b5-4414-a80f-d2649d2492e3 admin admin] The token cache is being invalidate because project f9f0036830414a1f8fdcc2c4cb80c912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:22:09.914878 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5605cb8a-67b5-4414-a80f-d2649d2492e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:09.915984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5605cb8a-67b5-4414-a80f-d2649d2492e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:09.927067 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1268/2536] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:22:09 2022] DELETE /identity/v3/projects/f9f0036830414a1f8fdcc2c4cb80c912 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:09.929138 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64354d-ab8b-4828-849b-9521a50b773d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:09.929414 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64354d-ab8b-4828-849b-9521a50b773d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:09.929701 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64354d-ab8b-4828-849b-9521a50b773d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:09.954181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-fd64354d-ab8b-4828-849b-9521a50b773d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:09.956584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-fd64354d-ab8b-4828-849b-9521a50b773d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:10.004096 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1269/2537] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:22:10.008856 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51585a8-7f3b-4804-925e-2c46292458a1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:10.010271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c51585a8-7f3b-4804-925e-2c46292458a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:10.090942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1269/2538] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:10.106044 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eece3e-5af3-4c98-a7c8-01117315da6a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:10.106375 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eece3e-5af3-4c98-a7c8-01117315da6a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:10.108996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eece3e-5af3-4c98-a7c8-01117315da6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:10.134087 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c4eece3e-5af3-4c98-a7c8-01117315da6a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:10.135560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c4eece3e-5af3-4c98-a7c8-01117315da6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:10.148492 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51585a8-7f3b-4804-925e-2c46292458a1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:10.152839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1270/2539] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:22:10.164989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eece3e-5af3-4c98-a7c8-01117315da6a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:10.178052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9f811-4e4a-42d5-ac5d-42b671d66204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:10.178781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9f811-4e4a-42d5-ac5d-42b671d66204 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:10.179067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9f811-4e4a-42d5-ac5d-42b671d66204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:10.179343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9f811-4e4a-42d5-ac5d-42b671d66204 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:10.180066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9f811-4e4a-42d5-ac5d-42b671d66204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:10.187117 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9f811-4e4a-42d5-ac5d-42b671d66204 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:10.190680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eece3e-5af3-4c98-a7c8-01117315da6a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:10.204075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e4726-d4ba-4fe0-b2e6-ce1b042552c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:10.205134 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e4726-d4ba-4fe0-b2e6-ce1b042552c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:10.205648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e4726-d4ba-4fe0-b2e6-ce1b042552c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:10.206166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e4726-d4ba-4fe0-b2e6-ce1b042552c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:10.207212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e4726-d4ba-4fe0-b2e6-ce1b042552c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:22:10.212837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e4726-d4ba-4fe0-b2e6-ce1b042552c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:10.214924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e4726-d4ba-4fe0-b2e6-ce1b042552c0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:10.241882 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1271/2540] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:22:10.247808 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e4726-d4ba-4fe0-b2e6-ce1b042552c0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:10.259294 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1270/2541] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:22:10 2022] POST /identity/v3/projects => generated 385 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:10.260273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9f811-4e4a-42d5-ac5d-42b671d66204 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:10.265750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e4726-d4ba-4fe0-b2e6-ce1b042552c0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:10.314680 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:10.353275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9f811-4e4a-42d5-ac5d-42b671d66204 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:10.361846 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a068665-91fa-4703-97f6-0b3af2cfc2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:10.362983 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a068665-91fa-4703-97f6-0b3af2cfc2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:10.363276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a068665-91fa-4703-97f6-0b3af2cfc2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:10.363553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a068665-91fa-4703-97f6-0b3af2cfc2c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:10.364857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a068665-91fa-4703-97f6-0b3af2cfc2c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:10.371132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a068665-91fa-4703-97f6-0b3af2cfc2c4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:10.380806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:10.411670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1a16b-02a3-4b15-93b2-c2ba64dda818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:10.412646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1a16b-02a3-4b15-93b2-c2ba64dda818 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:10.412928 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1a16b-02a3-4b15-93b2-c2ba64dda818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:10.413204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1a16b-02a3-4b15-93b2-c2ba64dda818 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:10.413855 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1271/2542] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:22:10 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:10.413987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1a16b-02a3-4b15-93b2-c2ba64dda818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:10.415152 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a068665-91fa-4703-97f6-0b3af2cfc2c4 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:10.415912 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1a16b-02a3-4b15-93b2-c2ba64dda818 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:10.428829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a068665-91fa-4703-97f6-0b3af2cfc2c4 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:10.442730 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffb869-6f26-4482-b765-7c3a3d3fcd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:10.443440 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffb869-6f26-4482-b765-7c3a3d3fcd7a admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:10.443780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffb869-6f26-4482-b765-7c3a3d3fcd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:10.444064 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffb869-6f26-4482-b765-7c3a3d3fcd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:10.444810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffb869-6f26-4482-b765-7c3a3d3fcd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:10.446424 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffb869-6f26-4482-b765-7c3a3d3fcd7a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:10.460073 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1272/2543] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:22:10.464516 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffb869-6f26-4482-b765-7c3a3d3fcd7a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:10.479347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1272/2544] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:22:10 2022] POST /identity/v3/projects => generated 381 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:10.490711 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1a16b-02a3-4b15-93b2-c2ba64dda818 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:10.494916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffb869-6f26-4482-b765-7c3a3d3fcd7a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:10.581049 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1a16b-02a3-4b15-93b2-c2ba64dda818 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:10.586884 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b495b-3852-4395-ade6-0a6eb95549a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:10.587754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b495b-3852-4395-ade6-0a6eb95549a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:10.588102 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b495b-3852-4395-ade6-0a6eb95549a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:10.588383 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b495b-3852-4395-ade6-0a6eb95549a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:10.589174 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b495b-3852-4395-ade6-0a6eb95549a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:10.591455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b495b-3852-4395-ade6-0a6eb95549a2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:10.596007 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c2af0-c258-4293-9c96-18e73b0316b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:10.597227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c2af0-c258-4293-9c96-18e73b0316b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:10.604443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c2af0-c258-4293-9c96-18e73b0316b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:10.604656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c2af0-c258-4293-9c96-18e73b0316b7 admin admin] PATH_INFO: `/v3/projects/6a642ab9004145a1827a3d7f5b3e6723/users/65305fcfcad94a8ba0df77d98b4b6c1e/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:10.634375 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c2af0-c258-4293-9c96-18e73b0316b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a642ab9004145a1827a3d7f5b3e6723, user_id=65305fcfcad94a8ba0df77d98b4b6c1e, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:10.636321 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1273/2545] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:22:10 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:22:10.638572 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c2af0-c258-4293-9c96-18e73b0316b7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:10.641425 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b495b-3852-4395-ade6-0a6eb95549a2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:10.661637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b495b-3852-4395-ade6-0a6eb95549a2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:10.663060 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1273/2546] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:10 2022] PUT /identity/v3/projects/6a642ab9004145a1827a3d7f5b3e6723/users/65305fcfcad94a8ba0df77d98b4b6c1e/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:10.667283 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c2af0-c258-4293-9c96-18e73b0316b7 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:10.766269 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c2af0-c258-4293-9c96-18e73b0316b7 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:10.771806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b8891-0707-4ca0-b948-52064cc5dc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:10.772509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b8891-0707-4ca0-b948-52064cc5dc10 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:10.772787 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b8891-0707-4ca0-b948-52064cc5dc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:10.773106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b8891-0707-4ca0-b948-52064cc5dc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:10.773926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b8891-0707-4ca0-b948-52064cc5dc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:10.775765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b8891-0707-4ca0-b948-52064cc5dc10 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:10.797570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1274/2547] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:22:10.798409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bc4dc-c8e3-492f-a110-6b089ab154a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:10.798840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b8891-0707-4ca0-b948-52064cc5dc10 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:10.799171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bc4dc-c8e3-492f-a110-6b089ab154a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:10.799454 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bc4dc-c8e3-492f-a110-6b089ab154a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:10.799734 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bc4dc-c8e3-492f-a110-6b089ab154a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:10.800495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bc4dc-c8e3-492f-a110-6b089ab154a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:10.809609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bc4dc-c8e3-492f-a110-6b089ab154a1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:10.815163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b8891-0707-4ca0-b948-52064cc5dc10 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:10.821915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59ac46-d5ff-41c5-a516-fa9e16b1ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:10.823230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59ac46-d5ff-41c5-a516-fa9e16b1ee54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:10.824118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59ac46-d5ff-41c5-a516-fa9e16b1ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:10.824500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59ac46-d5ff-41c5-a516-fa9e16b1ee54 admin admin] PATH_INFO: `/v3/projects/6a642ab9004145a1827a3d7f5b3e6723/users/65305fcfcad94a8ba0df77d98b4b6c1e/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:10.826849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59ac46-d5ff-41c5-a516-fa9e16b1ee54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a642ab9004145a1827a3d7f5b3e6723, user_id=65305fcfcad94a8ba0df77d98b4b6c1e, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:10.829894 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59ac46-d5ff-41c5-a516-fa9e16b1ee54 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:10.831821 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1274/2548] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:10.835848 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bc4dc-c8e3-492f-a110-6b089ab154a1 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:10.844534 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1275/2549] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:10 2022] PUT /identity/v3/projects/6a642ab9004145a1827a3d7f5b3e6723/users/65305fcfcad94a8ba0df77d98b4b6c1e/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:22:10.862262 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1067e-5e58-45e3-b526-d69dbb8b743b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:10.862487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1067e-5e58-45e3-b526-d69dbb8b743b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:10.862803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1067e-5e58-45e3-b526-d69dbb8b743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:10.866812 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bc4dc-c8e3-492f-a110-6b089ab154a1 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:10.906950 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-63d1067e-5e58-45e3-b526-d69dbb8b743b None None] MFA Rules not processed for user `65305fcfcad94a8ba0df77d98b4b6c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:10.908806 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-63d1067e-5e58-45e3-b526-d69dbb8b743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:10.927092 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:10.983165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:10.993466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cda80-8596-48ee-a9b4-7ab499103e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:10.994313 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cda80-8596-48ee-a9b4-7ab499103e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:10.994767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cda80-8596-48ee-a9b4-7ab499103e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:10.995044 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cda80-8596-48ee-a9b4-7ab499103e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:10.995794 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2cda80-8596-48ee-a9b4-7ab499103e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:10.997537 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2cda80-8596-48ee-a9b4-7ab499103e38 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:11.014352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1275/2550] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:11.015968 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cda80-8596-48ee-a9b4-7ab499103e38 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:11.037031 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cda80-8596-48ee-a9b4-7ab499103e38 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:11.051374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06db7ef-4622-4ee8-b0ed-5989bc67d2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:11.055535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06db7ef-4622-4ee8-b0ed-5989bc67d2aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:11.055833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06db7ef-4622-4ee8-b0ed-5989bc67d2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:11.056287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06db7ef-4622-4ee8-b0ed-5989bc67d2aa admin admin] PATH_INFO: `/v3/projects/07c555a2a9b046a28d7aa23f1d5df2b2/users/7eb7283658534dcfb12af7eb65c8d73b/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:11.076697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1276/2551] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:11.091017 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1067e-5e58-45e3-b526-d69dbb8b743b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:11.093166 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-63d1067e-5e58-45e3-b526-d69dbb8b743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:11.097489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06db7ef-4622-4ee8-b0ed-5989bc67d2aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c555a2a9b046a28d7aa23f1d5df2b2, user_id=7eb7283658534dcfb12af7eb65c8d73b, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:11.102451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06db7ef-4622-4ee8-b0ed-5989bc67d2aa admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:11.142947 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1276/2552] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:11 2022] PUT /identity/v3/projects/07c555a2a9b046a28d7aa23f1d5df2b2/users/7eb7283658534dcfb12af7eb65c8d73b/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:11.158366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d891ef8-8325-4095-923c-8a11e125ffec None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:11.158910 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d891ef8-8325-4095-923c-8a11e125ffec None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:11.159416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d891ef8-8325-4095-923c-8a11e125ffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:11.212682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2d891ef8-8325-4095-923c-8a11e125ffec None None] MFA Rules not processed for user `7eb7283658534dcfb12af7eb65c8d73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:11.214592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2d891ef8-8325-4095-923c-8a11e125ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:11.433576 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1277/2553] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:11.438465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d891ef8-8325-4095-923c-8a11e125ffec None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:11.510532 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1067e-5e58-45e3-b526-d69dbb8b743b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:11.643178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d891ef8-8325-4095-923c-8a11e125ffec None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:11.650772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf65d39-9a77-4bcc-a1eb-91f1ff0c14fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:11.651703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf65d39-9a77-4bcc-a1eb-91f1ff0c14fe admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:11.652094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf65d39-9a77-4bcc-a1eb-91f1ff0c14fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:11.653146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf65d39-9a77-4bcc-a1eb-91f1ff0c14fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:11.653998 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf65d39-9a77-4bcc-a1eb-91f1ff0c14fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:11.659669 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf65d39-9a77-4bcc-a1eb-91f1ff0c14fe admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:11.685219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e8e61-1795-4f1e-9472-1213fb04b32f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:11.686934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e8e61-1795-4f1e-9472-1213fb04b32f service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:11.695420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e8e61-1795-4f1e-9472-1213fb04b32f service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:11.696035 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e8e61-1795-4f1e-9472-1213fb04b32f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:11.724794 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1278/2554] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:22:11 2022] POST /identity/v3/projects => generated 383 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:11.727010 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf65d39-9a77-4bcc-a1eb-91f1ff0c14fe admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:11.831172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e8e61-1795-4f1e-9472-1213fb04b32f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:11.833482 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e8e61-1795-4f1e-9472-1213fb04b32f service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:11.839052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:11.856279 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1277/2555] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 766 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:22:11.870094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf65d39-9a77-4bcc-a1eb-91f1ff0c14fe admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:11.875931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc4564-5418-46e8-a2d8-8dcc4e9c9ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:11.877086 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc4564-5418-46e8-a2d8-8dcc4e9c9ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:11.877429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc4564-5418-46e8-a2d8-8dcc4e9c9ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:11.877828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc4564-5418-46e8-a2d8-8dcc4e9c9ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:11.878715 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc4564-5418-46e8-a2d8-8dcc4e9c9ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:11.880914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc4564-5418-46e8-a2d8-8dcc4e9c9ff2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:11.887236 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e8e61-1795-4f1e-9472-1213fb04b32f service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:11.900825 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e8e61-1795-4f1e-9472-1213fb04b32f service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:11.910064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1279/2556] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:22:11 2022] POST /identity/v3/users => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:11.912062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc4564-5418-46e8-a2d8-8dcc4e9c9ff2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:11.916527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd494aa8-9959-4f28-83d2-c87e9c937bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:11.919222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd494aa8-9959-4f28-83d2-c87e9c937bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:11.920053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd494aa8-9959-4f28-83d2-c87e9c937bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:11.920546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd494aa8-9959-4f28-83d2-c87e9c937bc3 admin admin] PATH_INFO: `/v3/users/97de481a92b9493b9f9f3f1c65fb28c1` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:11.922139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd494aa8-9959-4f28-83d2-c87e9c937bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97de481a92b9493b9f9f3f1c65fb28c1)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:11.924051 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc4564-5418-46e8-a2d8-8dcc4e9c9ff2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:11.924288 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd494aa8-9959-4f28-83d2-c87e9c937bc3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:11.927907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:11.930893 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f3d88-b3d4-4f91-867a-a27167909a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:11.931521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f3d88-b3d4-4f91-867a-a27167909a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:11.931521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f3d88-b3d4-4f91-867a-a27167909a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:11.931706 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f3d88-b3d4-4f91-867a-a27167909a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:11.932436 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f3d88-b3d4-4f91-867a-a27167909a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:11.934084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f3d88-b3d4-4f91-867a-a27167909a09 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:11.950599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1280/2557] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:22:11.955133 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f3d88-b3d4-4f91-867a-a27167909a09 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:11.970280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f3d88-b3d4-4f91-867a-a27167909a09 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:11.976380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca57ce-5b1c-48f0-ad33-c20038e88d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:11.977532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca57ce-5b1c-48f0-ad33-c20038e88d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:11.977825 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca57ce-5b1c-48f0-ad33-c20038e88d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:11.978097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca57ce-5b1c-48f0-ad33-c20038e88d3b admin admin] PATH_INFO: `/v3/projects/eaf702ae68f345248f6092d553222c19/users/4773baf6f8fb404a8768ec3040ef3dc0/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:11.997107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fd494aa8-9959-4f28-83d2-c87e9c937bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97de481a92b9493b9f9f3f1c65fb28c1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:11.997788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca57ce-5b1c-48f0-ad33-c20038e88d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf702ae68f345248f6092d553222c19, user_id=4773baf6f8fb404a8768ec3040ef3dc0, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:11.997979 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fd494aa8-9959-4f28-83d2-c87e9c937bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97de481a92b9493b9f9f3f1c65fb28c1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:12.000626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca57ce-5b1c-48f0-ad33-c20038e88d3b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:12.013785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fd494aa8-9959-4f28-83d2-c87e9c937bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97de481a92b9493b9f9f3f1c65fb28c1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:12.020405 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1281/2558] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:11 2022] PUT /identity/v3/projects/eaf702ae68f345248f6092d553222c19/users/4773baf6f8fb404a8768ec3040ef3dc0/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:22:12.023531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fd494aa8-9959-4f28-83d2-c87e9c937bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97de481a92b9493b9f9f3f1c65fb28c1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:12.024310 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fd494aa8-9959-4f28-83d2-c87e9c937bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97de481a92b9493b9f9f3f1c65fb28c1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:12.024817 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca57ce-5b1c-48f0-ad33-c20038e88d3b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:12.026927 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4cca57ce-5b1c-48f0-ad33-c20038e88d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:12.041211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1278/2559] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:22:11 2022] DELETE /identity/v3/users/97de481a92b9493b9f9f3f1c65fb28c1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:22:12.046430 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22e3b-48fe-42ef-befb-7f671b538e67 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:12.046757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22e3b-48fe-42ef-befb-7f671b538e67 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:12.047096 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22e3b-48fe-42ef-befb-7f671b538e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:12.066009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-99c22e3b-48fe-42ef-befb-7f671b538e67 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:12.067226 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-99c22e3b-48fe-42ef-befb-7f671b538e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:12.106961 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca57ce-5b1c-48f0-ad33-c20038e88d3b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:12.139046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1279/2560] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:22:12.150590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c22e3b-48fe-42ef-befb-7f671b538e67 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:12.153159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-99c22e3b-48fe-42ef-befb-7f671b538e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:12.202215 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ebc9a-a78b-4d49-b59a-20bbc3b8fd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:12.202952 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ebc9a-a78b-4d49-b59a-20bbc3b8fd74 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:12.203235 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ebc9a-a78b-4d49-b59a-20bbc3b8fd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:12.203511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ebc9a-a78b-4d49-b59a-20bbc3b8fd74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:12.204486 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ebc9a-a78b-4d49-b59a-20bbc3b8fd74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:12.206885 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ebc9a-a78b-4d49-b59a-20bbc3b8fd74 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:12.226640 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1282/2561] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:12.228638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ebc9a-a78b-4d49-b59a-20bbc3b8fd74 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:12.231302 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c22e3b-48fe-42ef-befb-7f671b538e67 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:12.235643 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3be90-6019-4fe6-8ca4-5c482923789f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:12.236346 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3be90-6019-4fe6-8ca4-5c482923789f service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:12.236627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3be90-6019-4fe6-8ca4-5c482923789f service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:12.236886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3be90-6019-4fe6-8ca4-5c482923789f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:12.240877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ebc9a-a78b-4d49-b59a-20bbc3b8fd74 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:12.245691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac77d2c-cd01-423b-bcce-ecff4a885126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:12.246613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77d2c-cd01-423b-bcce-ecff4a885126 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:12.246989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77d2c-cd01-423b-bcce-ecff4a885126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:12.247225 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77d2c-cd01-423b-bcce-ecff4a885126 admin admin] PATH_INFO: `/v3/projects/eaf702ae68f345248f6092d553222c19/users/4773baf6f8fb404a8768ec3040ef3dc0/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:12.247651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3be90-6019-4fe6-8ca4-5c482923789f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:12.249241 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3be90-6019-4fe6-8ca4-5c482923789f service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:12.249620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac77d2c-cd01-423b-bcce-ecff4a885126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf702ae68f345248f6092d553222c19, user_id=4773baf6f8fb404a8768ec3040ef3dc0, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:12.252360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac77d2c-cd01-423b-bcce-ecff4a885126 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:12.260162 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1280/2562] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:22:12.267622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1283/2563] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:12 2022] PUT /identity/v3/projects/eaf702ae68f345248f6092d553222c19/users/4773baf6f8fb404a8768ec3040ef3dc0/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:22:12.284324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf4807-7cf7-4c53-b87a-8f5bf488bb91 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:12.285119 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf4807-7cf7-4c53-b87a-8f5bf488bb91 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:12.285826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf4807-7cf7-4c53-b87a-8f5bf488bb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:12.326353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4abf4807-7cf7-4c53-b87a-8f5bf488bb91 None None] MFA Rules not processed for user `4773baf6f8fb404a8768ec3040ef3dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:12.327867 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4abf4807-7cf7-4c53-b87a-8f5bf488bb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:12.342627 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:12.437904 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1281/2564] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:22:12.453085 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac77d2c-cd01-423b-bcce-ecff4a885126 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:12.455200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2ac77d2c-cd01-423b-bcce-ecff4a885126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:12.500388 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:12.533920 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac77d2c-cd01-423b-bcce-ecff4a885126 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:12.538018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eeeaf6-7aeb-4215-91f1-355d44c2a0c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:12.538859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eeeaf6-7aeb-4215-91f1-355d44c2a0c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:12.539208 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eeeaf6-7aeb-4215-91f1-355d44c2a0c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:12.539602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eeeaf6-7aeb-4215-91f1-355d44c2a0c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:12.550859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eeeaf6-7aeb-4215-91f1-355d44c2a0c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:12.552078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eeeaf6-7aeb-4215-91f1-355d44c2a0c1 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:12.563410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1284/2565] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:22:12.642609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf4807-7cf7-4c53-b87a-8f5bf488bb91 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:12.644097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4abf4807-7cf7-4c53-b87a-8f5bf488bb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:12.706506 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eeeaf6-7aeb-4215-91f1-355d44c2a0c1 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:12.715455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eeeaf6-7aeb-4215-91f1-355d44c2a0c1 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:12.719521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b309d-edb3-48bd-99cf-c67839ee0676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:12.720280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b309d-edb3-48bd-99cf-c67839ee0676 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:12.720625 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b309d-edb3-48bd-99cf-c67839ee0676 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:12.720963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b309d-edb3-48bd-99cf-c67839ee0676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:12.722903 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a44b309d-edb3-48bd-99cf-c67839ee0676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:12.736854 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf4807-7cf7-4c53-b87a-8f5bf488bb91 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:12.742722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:12.744238 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:12.744658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:12.744932 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] PATH_INFO: `/v3/projects/ac288d15cc394e9880391135282172de` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:12.746203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac288d15cc394e9880391135282172de)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:12.749785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:12.799233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b309d-edb3-48bd-99cf-c67839ee0676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:12.802037 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b309d-edb3-48bd-99cf-c67839ee0676 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:12.806026 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac288d15cc394e9880391135282172de', 'request_id': 'req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:12.816348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac288d15cc394e9880391135282172de', 'request_id': 'req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:12.825494 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac288d15cc394e9880391135282172de', 'request_id': 'req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:12.828538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1285/2566] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:22:12.853037 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] The token cache is being invalidate because project ac288d15cc394e9880391135282172de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:22:12.853499 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:12.854483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:12.857689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1282/2567] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:22:12 2022] DELETE /identity/v3/projects/ac288d15cc394e9880391135282172de => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:12.861990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b309d-edb3-48bd-99cf-c67839ee0676 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:12.875252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b309d-edb3-48bd-99cf-c67839ee0676 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:12.942547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d2380-1d93-4923-b70b-d404fbf2e311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:12.943905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d2380-1d93-4923-b70b-d404fbf2e311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:12.943905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d2380-1d93-4923-b70b-d404fbf2e311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:12.943905 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d2380-1d93-4923-b70b-d404fbf2e311 admin admin] PATH_INFO: `/v3/users/65305fcfcad94a8ba0df77d98b4b6c1e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:12.945992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d2380-1d93-4923-b70b-d404fbf2e311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65305fcfcad94a8ba0df77d98b4b6c1e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:12.947985 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d2380-1d93-4923-b70b-d404fbf2e311 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:13.006879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d9d2380-1d93-4923-b70b-d404fbf2e311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65305fcfcad94a8ba0df77d98b4b6c1e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:13.015192 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d9d2380-1d93-4923-b70b-d404fbf2e311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65305fcfcad94a8ba0df77d98b4b6c1e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:13.016240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d9d2380-1d93-4923-b70b-d404fbf2e311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65305fcfcad94a8ba0df77d98b4b6c1e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:13.037016 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:13.041670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d9d2380-1d93-4923-b70b-d404fbf2e311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65305fcfcad94a8ba0df77d98b4b6c1e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:13.042911 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d9d2380-1d93-4923-b70b-d404fbf2e311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65305fcfcad94a8ba0df77d98b4b6c1e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:13.064442 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1286/2568] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:22:12 2022] DELETE /identity/v3/users/65305fcfcad94a8ba0df77d98b4b6c1e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:22:13.413078 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:13.414879 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:13.433088 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779cfde-d4cd-4955-8bc9-a7c67cfe639b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:13.483506 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:13.503693 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a7bb6-9dd6-43b8-94e9-d7990da60884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:13.504636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7bb6-9dd6-43b8-94e9-d7990da60884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:13.504920 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7bb6-9dd6-43b8-94e9-d7990da60884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:13.505217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7bb6-9dd6-43b8-94e9-d7990da60884 admin admin] PATH_INFO: `/v3/projects/6a642ab9004145a1827a3d7f5b3e6723` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:13.506803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a7bb6-9dd6-43b8-94e9-d7990da60884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a642ab9004145a1827a3d7f5b3e6723)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:13.508957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a7bb6-9dd6-43b8-94e9-d7990da60884 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:13.566915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-819a7bb6-9dd6-43b8-94e9-d7990da60884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a642ab9004145a1827a3d7f5b3e6723', 'request_id': 'req-819a7bb6-9dd6-43b8-94e9-d7990da60884'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:13.577216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-819a7bb6-9dd6-43b8-94e9-d7990da60884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a642ab9004145a1827a3d7f5b3e6723', 'request_id': 'req-819a7bb6-9dd6-43b8-94e9-d7990da60884'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:13.584305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-819a7bb6-9dd6-43b8-94e9-d7990da60884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a642ab9004145a1827a3d7f5b3e6723', 'request_id': 'req-819a7bb6-9dd6-43b8-94e9-d7990da60884'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:13.597835 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-819a7bb6-9dd6-43b8-94e9-d7990da60884 admin admin] The token cache is being invalidate because project 6a642ab9004145a1827a3d7f5b3e6723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:22:13.598131 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-819a7bb6-9dd6-43b8-94e9-d7990da60884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:13.598908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-819a7bb6-9dd6-43b8-94e9-d7990da60884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:13.600679 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1283/2569] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:22:13 2022] DELETE /identity/v3/projects/6a642ab9004145a1827a3d7f5b3e6723 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:22:13.606249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11980d-b5a9-419a-a093-6ac447ffe086 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:13.606546 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11980d-b5a9-419a-a093-6ac447ffe086 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:13.606847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11980d-b5a9-419a-a093-6ac447ffe086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:13.627429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2a11980d-b5a9-419a-a093-6ac447ffe086 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:13.628681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2a11980d-b5a9-419a-a093-6ac447ffe086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:13.700785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1287/2570] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:13.711076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59342411-d9bc-48c7-bcad-b0d5886bff55 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:13.711625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59342411-d9bc-48c7-bcad-b0d5886bff55 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:13.711625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59342411-d9bc-48c7-bcad-b0d5886bff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:13.735469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-59342411-d9bc-48c7-bcad-b0d5886bff55 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:13.737099 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-59342411-d9bc-48c7-bcad-b0d5886bff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:13.746194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1284/2571] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:13.751658 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11980d-b5a9-419a-a093-6ac447ffe086 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:13.762251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11980d-b5a9-419a-a093-6ac447ffe086 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:13.767957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72066b68-a795-4b22-905d-a00825769b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:13.768644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72066b68-a795-4b22-905d-a00825769b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:13.768931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72066b68-a795-4b22-905d-a00825769b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:13.769225 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72066b68-a795-4b22-905d-a00825769b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:13.769989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72066b68-a795-4b22-905d-a00825769b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:22:13.770275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72066b68-a795-4b22-905d-a00825769b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:13.772040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72066b68-a795-4b22-905d-a00825769b29 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:13.784824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1288/2572] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:22:13.789727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59342411-d9bc-48c7-bcad-b0d5886bff55 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:13.800069 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59342411-d9bc-48c7-bcad-b0d5886bff55 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:13.805387 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412e277-65af-4f0b-83f5-bd452b2883de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:13.806045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412e277-65af-4f0b-83f5-bd452b2883de admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:13.806325 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412e277-65af-4f0b-83f5-bd452b2883de admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:13.806590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412e277-65af-4f0b-83f5-bd452b2883de admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:13.807326 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412e277-65af-4f0b-83f5-bd452b2883de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:13.809260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412e277-65af-4f0b-83f5-bd452b2883de admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:13.839921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1285/2573] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:22:13 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:13.844535 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72066b68-a795-4b22-905d-a00825769b29 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:13.854724 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72066b68-a795-4b22-905d-a00825769b29 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:13.919331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10d3b8-4d90-4804-b733-1e1d18573d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:13.920213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10d3b8-4d90-4804-b733-1e1d18573d9b admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:13.920481 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10d3b8-4d90-4804-b733-1e1d18573d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:13.920773 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10d3b8-4d90-4804-b733-1e1d18573d9b admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:13.921480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10d3b8-4d90-4804-b733-1e1d18573d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:13.923437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10d3b8-4d90-4804-b733-1e1d18573d9b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:13.945848 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1289/2574] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:22:13 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:13.950455 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412e277-65af-4f0b-83f5-bd452b2883de admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:13.961523 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412e277-65af-4f0b-83f5-bd452b2883de admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:13.966489 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512ff5e-68fa-4f24-a728-e4e77203f7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:13.967202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512ff5e-68fa-4f24-a728-e4e77203f7fb admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:13.967484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512ff5e-68fa-4f24-a728-e4e77203f7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:13.967756 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512ff5e-68fa-4f24-a728-e4e77203f7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:13.968500 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512ff5e-68fa-4f24-a728-e4e77203f7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:13.970122 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512ff5e-68fa-4f24-a728-e4e77203f7fb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:13.981409 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1286/2575] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:13.985862 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10d3b8-4d90-4804-b733-1e1d18573d9b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:13.996315 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10d3b8-4d90-4804-b733-1e1d18573d9b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:14.001338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d159650-d6b5-494c-b95f-9e9c1ca33f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:14.002075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d159650-d6b5-494c-b95f-9e9c1ca33f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:14.002352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d159650-d6b5-494c-b95f-9e9c1ca33f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:14.002982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d159650-d6b5-494c-b95f-9e9c1ca33f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:14.009192 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d159650-d6b5-494c-b95f-9e9c1ca33f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:14.010979 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d159650-d6b5-494c-b95f-9e9c1ca33f0c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:14.022550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1290/2576] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:14.030566 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512ff5e-68fa-4f24-a728-e4e77203f7fb admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:14.041780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512ff5e-68fa-4f24-a728-e4e77203f7fb admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:14.047749 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1e95e-2a97-4270-b556-66c472ef7244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:14.048647 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1e95e-2a97-4270-b556-66c472ef7244 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:14.048922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1e95e-2a97-4270-b556-66c472ef7244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:14.049193 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1e95e-2a97-4270-b556-66c472ef7244 admin admin] PATH_INFO: `/v3/projects/03278f9f9b2a4f9b8262e90ef6ef8a80/users/7433506088244841ad91075f0ed37f0d/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:14.065745 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1e95e-2a97-4270-b556-66c472ef7244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03278f9f9b2a4f9b8262e90ef6ef8a80, user_id=7433506088244841ad91075f0ed37f0d, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:14.070625 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1e95e-2a97-4270-b556-66c472ef7244 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:14.090912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1287/2577] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:14 2022] PUT /identity/v3/projects/03278f9f9b2a4f9b8262e90ef6ef8a80/users/7433506088244841ad91075f0ed37f0d/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:14.101638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1df85-3c33-4e71-b068-56004ee9d0b5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:14.101638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1df85-3c33-4e71-b068-56004ee9d0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:14.101992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1df85-3c33-4e71-b068-56004ee9d0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:14.130075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a4c1df85-3c33-4e71-b068-56004ee9d0b5 None None] MFA Rules not processed for user `7433506088244841ad91075f0ed37f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:14.131366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a4c1df85-3c33-4e71-b068-56004ee9d0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:14.182193 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:14.219372 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1291/2578] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:14.224144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1e95e-2a97-4270-b556-66c472ef7244 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:14.318803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1e95e-2a97-4270-b556-66c472ef7244 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:14.324420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7aab8-2a19-4f22-bc02-332b5d74b7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:14.325589 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7aab8-2a19-4f22-bc02-332b5d74b7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:14.326118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7aab8-2a19-4f22-bc02-332b5d74b7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:14.326611 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7aab8-2a19-4f22-bc02-332b5d74b7a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:14.328097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7aab8-2a19-4f22-bc02-332b5d74b7a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:14.330242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7aab8-2a19-4f22-bc02-332b5d74b7a9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:14.343355 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:14.373595 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1288/2579] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:22:14 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:14.374828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1df85-3c33-4e71-b068-56004ee9d0b5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:14.387456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1df85-3c33-4e71-b068-56004ee9d0b5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:14.470443 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd392570-5327-4d9e-a2fb-939220b9cd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:14.471246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd392570-5327-4d9e-a2fb-939220b9cd20 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:14.471620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd392570-5327-4d9e-a2fb-939220b9cd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:14.471963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd392570-5327-4d9e-a2fb-939220b9cd20 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:14.472782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd392570-5327-4d9e-a2fb-939220b9cd20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:14.474850 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd392570-5327-4d9e-a2fb-939220b9cd20 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:14.497162 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1292/2580] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:22:14 2022] POST /identity/v3/users => generated 302 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:14.501364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7aab8-2a19-4f22-bc02-332b5d74b7a9 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:14.512267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7aab8-2a19-4f22-bc02-332b5d74b7a9 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:14.516973 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b138a0e-3923-402c-8fd7-aae012292343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:14.517640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b138a0e-3923-402c-8fd7-aae012292343 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:14.517915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b138a0e-3923-402c-8fd7-aae012292343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:14.518188 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b138a0e-3923-402c-8fd7-aae012292343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:14.518963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b138a0e-3923-402c-8fd7-aae012292343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:14.520582 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b138a0e-3923-402c-8fd7-aae012292343 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:14.531889 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1289/2581] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:14.536058 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd392570-5327-4d9e-a2fb-939220b9cd20 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:14.548238 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd392570-5327-4d9e-a2fb-939220b9cd20 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:14.554017 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4e471-73bc-41aa-bb84-66926cae56c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:14.555213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4e471-73bc-41aa-bb84-66926cae56c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:14.555496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4e471-73bc-41aa-bb84-66926cae56c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:14.555779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4e471-73bc-41aa-bb84-66926cae56c0 admin admin] PATH_INFO: `/v3/projects/e059bcf85d484177b807100c624f0e80/users/716c99383ea8463090dd2482e2f504af/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:14.572928 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4e471-73bc-41aa-bb84-66926cae56c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e059bcf85d484177b807100c624f0e80, user_id=716c99383ea8463090dd2482e2f504af, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:14.575691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4e471-73bc-41aa-bb84-66926cae56c0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:14.604295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1293/2582] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:14 2022] PUT /identity/v3/projects/e059bcf85d484177b807100c624f0e80/users/716c99383ea8463090dd2482e2f504af/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:14.608578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b138a0e-3923-402c-8fd7-aae012292343 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:14.619272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b138a0e-3923-402c-8fd7-aae012292343 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:14.681857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a2b3f-7a21-4732-919d-ed83bb65eb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:14.682552 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a2b3f-7a21-4732-919d-ed83bb65eb5a admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:14.683057 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a2b3f-7a21-4732-919d-ed83bb65eb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:14.683242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a2b3f-7a21-4732-919d-ed83bb65eb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:14.683934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a2b3f-7a21-4732-919d-ed83bb65eb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:14.685908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a2b3f-7a21-4732-919d-ed83bb65eb5a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:14.698857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1290/2583] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:14.703223 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4e471-73bc-41aa-bb84-66926cae56c0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:14.716742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4e471-73bc-41aa-bb84-66926cae56c0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:14.722364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a39448-3951-4993-9374-1e867d57eceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:14.723351 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a39448-3951-4993-9374-1e867d57eceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:14.723640 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a39448-3951-4993-9374-1e867d57eceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:14.723920 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a39448-3951-4993-9374-1e867d57eceb admin admin] PATH_INFO: `/v3/projects/e059bcf85d484177b807100c624f0e80/users/716c99383ea8463090dd2482e2f504af/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:14.726175 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a39448-3951-4993-9374-1e867d57eceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e059bcf85d484177b807100c624f0e80, user_id=716c99383ea8463090dd2482e2f504af, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:14.729165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a39448-3951-4993-9374-1e867d57eceb admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:14.742413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1294/2584] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:14 2022] PUT /identity/v3/projects/e059bcf85d484177b807100c624f0e80/users/716c99383ea8463090dd2482e2f504af/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:14.754535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5e19-a296-48fe-8309-fa299940fd3d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:14.755355 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5e19-a296-48fe-8309-fa299940fd3d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:14.755355 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5e19-a296-48fe-8309-fa299940fd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:14.787880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c42b5e19-a296-48fe-8309-fa299940fd3d None None] MFA Rules not processed for user `716c99383ea8463090dd2482e2f504af`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:14.789266 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c42b5e19-a296-48fe-8309-fa299940fd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:14.879374 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1291/2585] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:14.891121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a39448-3951-4993-9374-1e867d57eceb admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:14.893185 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d0a39448-3951-4993-9374-1e867d57eceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:14.962612 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a39448-3951-4993-9374-1e867d57eceb admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:14.966671 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc95e5-3170-4d79-a037-303803a91cf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:14.967456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc95e5-3170-4d79-a037-303803a91cf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:14.967680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc95e5-3170-4d79-a037-303803a91cf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:14.968119 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc95e5-3170-4d79-a037-303803a91cf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:14.979606 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc95e5-3170-4d79-a037-303803a91cf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:14.981072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc95e5-3170-4d79-a037-303803a91cf5 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:14.994752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1295/2586] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:15.044984 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b5e19-a296-48fe-8309-fa299940fd3d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:15.046868 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c42b5e19-a296-48fe-8309-fa299940fd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:15.060737 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b5e19-a296-48fe-8309-fa299940fd3d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:15.064587 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc1be7-90b9-4864-8136-f3d5e34e00a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:15.065252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc1be7-90b9-4864-8136-f3d5e34e00a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:15.065540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc1be7-90b9-4864-8136-f3d5e34e00a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:15.065814 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc1be7-90b9-4864-8136-f3d5e34e00a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:15.159021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc1be7-90b9-4864-8136-f3d5e34e00a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:15.162009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc1be7-90b9-4864-8136-f3d5e34e00a0 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:15.171681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:15.190739 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1292/2587] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:15.514249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc95e5-3170-4d79-a037-303803a91cf5 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:15.516466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-eafc95e5-3170-4d79-a037-303803a91cf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:15.594974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:15.642443 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc95e5-3170-4d79-a037-303803a91cf5 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:15.649091 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ff6e6-a7b1-4c57-83ed-947264d3548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:15.650207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ff6e6-a7b1-4c57-83ed-947264d3548a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:15.650592 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ff6e6-a7b1-4c57-83ed-947264d3548a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:15.651005 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ff6e6-a7b1-4c57-83ed-947264d3548a admin admin] PATH_INFO: `/v3/users/7eb7283658534dcfb12af7eb65c8d73b` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:15.652373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ff6e6-a7b1-4c57-83ed-947264d3548a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb7283658534dcfb12af7eb65c8d73b)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:15.654443 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ff6e6-a7b1-4c57-83ed-947264d3548a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:15.755555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8e0ff6e6-a7b1-4c57-83ed-947264d3548a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb7283658534dcfb12af7eb65c8d73b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:15.763887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8e0ff6e6-a7b1-4c57-83ed-947264d3548a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb7283658534dcfb12af7eb65c8d73b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:15.764655 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8e0ff6e6-a7b1-4c57-83ed-947264d3548a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb7283658534dcfb12af7eb65c8d73b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:15.794324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8e0ff6e6-a7b1-4c57-83ed-947264d3548a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb7283658534dcfb12af7eb65c8d73b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:15.796282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8e0ff6e6-a7b1-4c57-83ed-947264d3548a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb7283658534dcfb12af7eb65c8d73b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:15.829442 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1296/2588] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:22:15 2022] DELETE /identity/v3/users/7eb7283658534dcfb12af7eb65c8d73b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:15.836584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bc594-ba02-45df-8cea-85685fd2cdd7 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:15.837342 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bc594-ba02-45df-8cea-85685fd2cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:15.837635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bc594-ba02-45df-8cea-85685fd2cdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:15.863435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d19bc594-ba02-45df-8cea-85685fd2cdd7 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:15.864757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d19bc594-ba02-45df-8cea-85685fd2cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:15.969369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1293/2589] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:15.984564 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ff6e6-a7b1-4c57-83ed-947264d3548a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:15.986612 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8e0ff6e6-a7b1-4c57-83ed-947264d3548a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:16.080708 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ff6e6-a7b1-4c57-83ed-947264d3548a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:16.088237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c6749-bf86-4f6b-8580-6d92bfdfc9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:16.089368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c6749-bf86-4f6b-8580-6d92bfdfc9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:16.090057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c6749-bf86-4f6b-8580-6d92bfdfc9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:16.090594 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c6749-bf86-4f6b-8580-6d92bfdfc9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:16.108865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c6749-bf86-4f6b-8580-6d92bfdfc9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:16.110858 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c6749-bf86-4f6b-8580-6d92bfdfc9e0 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:16.123471 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1297/2590] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:22:16.506640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bc594-ba02-45df-8cea-85685fd2cdd7 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:16.512007 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d19bc594-ba02-45df-8cea-85685fd2cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:16.552379 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bc594-ba02-45df-8cea-85685fd2cdd7 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:16.558765 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:16.559813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:16.560261 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:16.560546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] PATH_INFO: `/v3/projects/07c555a2a9b046a28d7aa23f1d5df2b2` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:16.562131 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c555a2a9b046a28d7aa23f1d5df2b2)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:16.564292 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:16.668221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c555a2a9b046a28d7aa23f1d5df2b2', 'request_id': 'req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:16.685181 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c555a2a9b046a28d7aa23f1d5df2b2', 'request_id': 'req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:16.694777 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c555a2a9b046a28d7aa23f1d5df2b2', 'request_id': 'req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:16.710884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] The token cache is being invalidate because project 07c555a2a9b046a28d7aa23f1d5df2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:22:16.711418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:16.712224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:16.714712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1294/2591] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:22:16 2022] DELETE /identity/v3/projects/07c555a2a9b046a28d7aa23f1d5df2b2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:16.720451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c6749-bf86-4f6b-8580-6d92bfdfc9e0 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:16.739809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c6749-bf86-4f6b-8580-6d92bfdfc9e0 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:16.828048 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e863bec-e7ea-40d6-98cc-fcd761a1ef42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:16.829052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e863bec-e7ea-40d6-98cc-fcd761a1ef42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:16.829430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e863bec-e7ea-40d6-98cc-fcd761a1ef42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:16.829813 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e863bec-e7ea-40d6-98cc-fcd761a1ef42 admin admin] PATH_INFO: `/v3/users/4773baf6f8fb404a8768ec3040ef3dc0` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:16.831477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e863bec-e7ea-40d6-98cc-fcd761a1ef42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4773baf6f8fb404a8768ec3040ef3dc0)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:16.833971 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e863bec-e7ea-40d6-98cc-fcd761a1ef42 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:16.836936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:16.941327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1e863bec-e7ea-40d6-98cc-fcd761a1ef42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4773baf6f8fb404a8768ec3040ef3dc0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:16.952790 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1e863bec-e7ea-40d6-98cc-fcd761a1ef42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4773baf6f8fb404a8768ec3040ef3dc0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:16.953695 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1e863bec-e7ea-40d6-98cc-fcd761a1ef42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4773baf6f8fb404a8768ec3040ef3dc0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:16.971801 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1e863bec-e7ea-40d6-98cc-fcd761a1ef42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4773baf6f8fb404a8768ec3040ef3dc0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:16.972568 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1e863bec-e7ea-40d6-98cc-fcd761a1ef42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4773baf6f8fb404a8768ec3040ef3dc0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:16.990578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1298/2592] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:22:16 2022] DELETE /identity/v3/users/4773baf6f8fb404a8768ec3040ef3dc0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:17.471146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:17.474843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:17.501692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa532d-16e9-4fdd-b708-fd4aba2bc63a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:17.615784 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d158f25-91a6-4be2-bf10-276e17b105e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:17.616962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d158f25-91a6-4be2-bf10-276e17b105e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:17.617922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d158f25-91a6-4be2-bf10-276e17b105e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:17.618640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d158f25-91a6-4be2-bf10-276e17b105e8 admin admin] PATH_INFO: `/v3/projects/eaf702ae68f345248f6092d553222c19` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:17.620837 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d158f25-91a6-4be2-bf10-276e17b105e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaf702ae68f345248f6092d553222c19)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:17.623805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d158f25-91a6-4be2-bf10-276e17b105e8 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:17.683836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:17.726388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d158f25-91a6-4be2-bf10-276e17b105e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf702ae68f345248f6092d553222c19', 'request_id': 'req-1d158f25-91a6-4be2-bf10-276e17b105e8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:17.745970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d158f25-91a6-4be2-bf10-276e17b105e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf702ae68f345248f6092d553222c19', 'request_id': 'req-1d158f25-91a6-4be2-bf10-276e17b105e8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:17.753786 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d158f25-91a6-4be2-bf10-276e17b105e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf702ae68f345248f6092d553222c19', 'request_id': 'req-1d158f25-91a6-4be2-bf10-276e17b105e8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:17.768137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d158f25-91a6-4be2-bf10-276e17b105e8 admin admin] The token cache is being invalidate because project eaf702ae68f345248f6092d553222c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:22:17.768792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d158f25-91a6-4be2-bf10-276e17b105e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:17.769396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d158f25-91a6-4be2-bf10-276e17b105e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:17.771678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1295/2593] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:22:17 2022] DELETE /identity/v3/projects/eaf702ae68f345248f6092d553222c19 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:17.777503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217d60-b365-4456-9f25-3e1400606684 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:17.777995 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217d60-b365-4456-9f25-3e1400606684 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:17.778361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217d60-b365-4456-9f25-3e1400606684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:17.814392 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b1217d60-b365-4456-9f25-3e1400606684 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:17.817223 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b1217d60-b365-4456-9f25-3e1400606684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:17.925682 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1299/2594] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:17.934496 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdd47d-0136-4546-ae69-70b1a722cb09 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:17.934900 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdd47d-0136-4546-ae69-70b1a722cb09 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:17.935163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdd47d-0136-4546-ae69-70b1a722cb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:17.957758 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3cbdd47d-0136-4546-ae69-70b1a722cb09 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:17.959092 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3cbdd47d-0136-4546-ae69-70b1a722cb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:17.967745 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1296/2595] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:17.972171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1217d60-b365-4456-9f25-3e1400606684 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:17.989297 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1217d60-b365-4456-9f25-3e1400606684 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:17.997865 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a19ac4-e54b-4ef9-bfd2-bea412181277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:17.998987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19ac4-e54b-4ef9-bfd2-bea412181277 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:17.999410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19ac4-e54b-4ef9-bfd2-bea412181277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:17.999843 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19ac4-e54b-4ef9-bfd2-bea412181277 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:18.000614 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a19ac4-e54b-4ef9-bfd2-bea412181277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:22:18.000922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a19ac4-e54b-4ef9-bfd2-bea412181277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:18.002670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a19ac4-e54b-4ef9-bfd2-bea412181277 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:18.015574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1300/2596] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:22:18.021240 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdd47d-0136-4546-ae69-70b1a722cb09 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:18.033654 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdd47d-0136-4546-ae69-70b1a722cb09 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:18.039570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2b2e-cb99-410e-8df5-41d1dd0abcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:18.040274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2b2e-cb99-410e-8df5-41d1dd0abcf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:18.040626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2b2e-cb99-410e-8df5-41d1dd0abcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:18.040961 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2b2e-cb99-410e-8df5-41d1dd0abcf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:18.041688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a2b2e-cb99-410e-8df5-41d1dd0abcf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:18.044528 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a2b2e-cb99-410e-8df5-41d1dd0abcf9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:18.085447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1297/2597] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:22:18 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:22:18.090252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a19ac4-e54b-4ef9-bfd2-bea412181277 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:18.101773 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a19ac4-e54b-4ef9-bfd2-bea412181277 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:18.168140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4f1dd-bda0-4758-bfde-d0225ed12bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:18.169233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4f1dd-bda0-4758-bfde-d0225ed12bef admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:18.169519 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4f1dd-bda0-4758-bfde-d0225ed12bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:18.170059 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4f1dd-bda0-4758-bfde-d0225ed12bef admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:18.170988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4f1dd-bda0-4758-bfde-d0225ed12bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:18.172958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4f1dd-bda0-4758-bfde-d0225ed12bef admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:18.184250 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:18.201291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1301/2598] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:22:18 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:18.205581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2b2e-cb99-410e-8df5-41d1dd0abcf9 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:18.216880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2b2e-cb99-410e-8df5-41d1dd0abcf9 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:18.222524 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb1877-97f6-4a5f-a1af-64fd3234dd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:18.223513 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1877-97f6-4a5f-a1af-64fd3234dd68 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:18.223797 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1877-97f6-4a5f-a1af-64fd3234dd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:18.224078 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1877-97f6-4a5f-a1af-64fd3234dd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:18.225082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb1877-97f6-4a5f-a1af-64fd3234dd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:18.226803 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb1877-97f6-4a5f-a1af-64fd3234dd68 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:18.238790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1298/2599] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:18.245445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4f1dd-bda0-4758-bfde-d0225ed12bef admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:18.262132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4f1dd-bda0-4758-bfde-d0225ed12bef admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:18.268286 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bf9bc-b30e-4447-9c90-193026fa91d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:18.268696 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bf9bc-b30e-4447-9c90-193026fa91d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:18.269040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bf9bc-b30e-4447-9c90-193026fa91d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:18.269438 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bf9bc-b30e-4447-9c90-193026fa91d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:18.270429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bf9bc-b30e-4447-9c90-193026fa91d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:18.272908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bf9bc-b30e-4447-9c90-193026fa91d5 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:18.289528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1302/2600] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:18.294758 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb1877-97f6-4a5f-a1af-64fd3234dd68 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:18.315000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb1877-97f6-4a5f-a1af-64fd3234dd68 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:18.322225 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e77f6-54e2-4a8d-b521-9c140f6eb401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:18.323288 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e77f6-54e2-4a8d-b521-9c140f6eb401 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:18.323664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e77f6-54e2-4a8d-b521-9c140f6eb401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:18.324082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e77f6-54e2-4a8d-b521-9c140f6eb401 admin admin] PATH_INFO: `/v3/projects/808aced9c4cf4da082eb241a0255dca6/users/0ff57d7de3334310b0fc70ae1a4ba1a7/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:18.350404 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e77f6-54e2-4a8d-b521-9c140f6eb401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=808aced9c4cf4da082eb241a0255dca6, user_id=0ff57d7de3334310b0fc70ae1a4ba1a7, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:18.353140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e77f6-54e2-4a8d-b521-9c140f6eb401 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:18.371669 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1299/2601] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:18 2022] PUT /identity/v3/projects/808aced9c4cf4da082eb241a0255dca6/users/0ff57d7de3334310b0fc70ae1a4ba1a7/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:22:18.383375 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64173-4cbe-47ed-a224-a7886ec0b8ac None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:18.383666 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64173-4cbe-47ed-a224-a7886ec0b8ac None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:18.383941 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64173-4cbe-47ed-a224-a7886ec0b8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:18.417546 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-06b64173-4cbe-47ed-a224-a7886ec0b8ac None None] MFA Rules not processed for user `0ff57d7de3334310b0fc70ae1a4ba1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:18.419473 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-06b64173-4cbe-47ed-a224-a7886ec0b8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:18.522902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1303/2602] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:18.529202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e77f6-54e2-4a8d-b521-9c140f6eb401 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:18.619268 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e77f6-54e2-4a8d-b521-9c140f6eb401 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:18.622376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d67c16-6f10-42ca-96ce-c4e1a6a9d7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:18.623268 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d67c16-6f10-42ca-96ce-c4e1a6a9d7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:18.623646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d67c16-6f10-42ca-96ce-c4e1a6a9d7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:18.623951 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d67c16-6f10-42ca-96ce-c4e1a6a9d7d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:18.624837 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d67c16-6f10-42ca-96ce-c4e1a6a9d7d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:18.626792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d67c16-6f10-42ca-96ce-c4e1a6a9d7d8 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:18.665007 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1300/2603] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:22:18 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:18.670921 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64173-4cbe-47ed-a224-a7886ec0b8ac None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:18.685017 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64173-4cbe-47ed-a224-a7886ec0b8ac None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:18.753278 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa885-d523-41d3-8208-5e7b66ee0ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:18.754218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa885-d523-41d3-8208-5e7b66ee0ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:18.754416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa885-d523-41d3-8208-5e7b66ee0ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:18.754777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa885-d523-41d3-8208-5e7b66ee0ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:18.755599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aa885-d523-41d3-8208-5e7b66ee0ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:18.757926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aa885-d523-41d3-8208-5e7b66ee0ae5 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:18.781063 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1304/2604] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:22:18 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:18.785508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d67c16-6f10-42ca-96ce-c4e1a6a9d7d8 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:18.797091 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d67c16-6f10-42ca-96ce-c4e1a6a9d7d8 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:18.802953 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1dd36-e65e-4b08-af6d-99f19f45a405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:18.803671 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1dd36-e65e-4b08-af6d-99f19f45a405 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:18.803930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1dd36-e65e-4b08-af6d-99f19f45a405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:18.804197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1dd36-e65e-4b08-af6d-99f19f45a405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:18.804975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1dd36-e65e-4b08-af6d-99f19f45a405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:18.806681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1dd36-e65e-4b08-af6d-99f19f45a405 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:18.819096 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1301/2605] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:18.825136 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa885-d523-41d3-8208-5e7b66ee0ae5 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:18.836426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa885-d523-41d3-8208-5e7b66ee0ae5 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:18.841304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7834506-ee5d-4b2b-bb01-16fc19c7c1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:18.841995 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7834506-ee5d-4b2b-bb01-16fc19c7c1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:18.842279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7834506-ee5d-4b2b-bb01-16fc19c7c1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:18.842555 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7834506-ee5d-4b2b-bb01-16fc19c7c1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:18.843337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7834506-ee5d-4b2b-bb01-16fc19c7c1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:18.845124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7834506-ee5d-4b2b-bb01-16fc19c7c1a0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:18.856640 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1305/2606] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:18.861009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1dd36-e65e-4b08-af6d-99f19f45a405 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:18.872350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1dd36-e65e-4b08-af6d-99f19f45a405 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:18.878115 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef312e9-d7c1-4b40-abd7-95f315d1a405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:18.879078 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef312e9-d7c1-4b40-abd7-95f315d1a405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:18.879361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef312e9-d7c1-4b40-abd7-95f315d1a405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:18.879641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef312e9-d7c1-4b40-abd7-95f315d1a405 admin admin] PATH_INFO: `/v3/projects/0fe896d3f9bb4bc58aceceef83c13430/users/79b317c70d41429591e531bc21bbd1fc/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:18.896581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef312e9-d7c1-4b40-abd7-95f315d1a405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe896d3f9bb4bc58aceceef83c13430, user_id=79b317c70d41429591e531bc21bbd1fc, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:18.899294 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef312e9-d7c1-4b40-abd7-95f315d1a405 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:18.909686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:18.916827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1302/2607] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:18 2022] PUT /identity/v3/projects/0fe896d3f9bb4bc58aceceef83c13430/users/79b317c70d41429591e531bc21bbd1fc/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:18.928239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723fc3e-ad08-4cc3-9066-a70fb0122c86 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:18.929076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723fc3e-ad08-4cc3-9066-a70fb0122c86 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:18.929472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723fc3e-ad08-4cc3-9066-a70fb0122c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:18.961853 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d723fc3e-ad08-4cc3-9066-a70fb0122c86 None None] MFA Rules not processed for user `79b317c70d41429591e531bc21bbd1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:18.963191 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d723fc3e-ad08-4cc3-9066-a70fb0122c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:19.019461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:19.058359 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1306/2608] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:19.060443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef312e9-d7c1-4b40-abd7-95f315d1a405 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:19.071371 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c2acf-3033-4618-9d48-58481aa4eb68 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:19.072791 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c2acf-3033-4618-9d48-58481aa4eb68 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:19.073311 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c2acf-3033-4618-9d48-58481aa4eb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:19.100653 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-334c2acf-3033-4618-9d48-58481aa4eb68 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:19.102887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-334c2acf-3033-4618-9d48-58481aa4eb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:19.153802 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef312e9-d7c1-4b40-abd7-95f315d1a405 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:19.159620 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8541161-8cb9-449f-ae30-50fd10130e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:19.160057 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8541161-8cb9-449f-ae30-50fd10130e48 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:19.160376 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8541161-8cb9-449f-ae30-50fd10130e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:19.160654 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8541161-8cb9-449f-ae30-50fd10130e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:19.161384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8541161-8cb9-449f-ae30-50fd10130e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:19.163430 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8541161-8cb9-449f-ae30-50fd10130e48 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:19.211217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1303/2609] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:22:19 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:19.212838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8541161-8cb9-449f-ae30-50fd10130e48 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:19.216751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e8541161-8cb9-449f-ae30-50fd10130e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:19.244204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1307/2610] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jul 21 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:22:19.245283 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c2acf-3033-4618-9d48-58481aa4eb68 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:19.256925 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c2acf-3033-4618-9d48-58481aa4eb68 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:19.332111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8541161-8cb9-449f-ae30-50fd10130e48 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:19.338526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c264c-5584-4004-8874-4133e1d2da13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:19.339047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cd57e-e61a-4679-b506-ef54f5bdb59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:19.339777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c264c-5584-4004-8874-4133e1d2da13 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:19.339966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cd57e-e61a-4679-b506-ef54f5bdb59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:19.340229 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cd57e-e61a-4679-b506-ef54f5bdb59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:19.340346 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c264c-5584-4004-8874-4133e1d2da13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:19.340429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cd57e-e61a-4679-b506-ef54f5bdb59a admin admin] PATH_INFO: `/v3/users/7433506088244841ad91075f0ed37f0d` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:19.340766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c264c-5584-4004-8874-4133e1d2da13 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:19.341694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cd57e-e61a-4679-b506-ef54f5bdb59a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7433506088244841ad91075f0ed37f0d)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:19.342187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c264c-5584-4004-8874-4133e1d2da13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:19.343751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cd57e-e61a-4679-b506-ef54f5bdb59a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:19.345830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c264c-5584-4004-8874-4133e1d2da13 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:19.382131 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1308/2611] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:22:19 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:19.383783 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c264c-5584-4004-8874-4133e1d2da13 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:19.387194 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-127c264c-5584-4004-8874-4133e1d2da13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:19.421472 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-610cd57e-e61a-4679-b506-ef54f5bdb59a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7433506088244841ad91075f0ed37f0d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:19.422818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-610cd57e-e61a-4679-b506-ef54f5bdb59a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7433506088244841ad91075f0ed37f0d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:19.456423 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-610cd57e-e61a-4679-b506-ef54f5bdb59a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7433506088244841ad91075f0ed37f0d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:19.468527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-610cd57e-e61a-4679-b506-ef54f5bdb59a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7433506088244841ad91075f0ed37f0d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:19.469551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-610cd57e-e61a-4679-b506-ef54f5bdb59a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7433506088244841ad91075f0ed37f0d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:19.492818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1304/2612] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:22:19 2022] DELETE /identity/v3/users/7433506088244841ad91075f0ed37f0d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:19.494750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cd57e-e61a-4679-b506-ef54f5bdb59a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:19.499518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-610cd57e-e61a-4679-b506-ef54f5bdb59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:19.510805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:19.526361 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c264c-5584-4004-8874-4133e1d2da13 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:19.537649 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:19.611646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cd57e-e61a-4679-b506-ef54f5bdb59a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:19.613176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533191e-3722-4033-8f88-59e79275de3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:19.613926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533191e-3722-4033-8f88-59e79275de3a service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:19.614270 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533191e-3722-4033-8f88-59e79275de3a service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:19.614607 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533191e-3722-4033-8f88-59e79275de3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:19.616731 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6533191e-3722-4033-8f88-59e79275de3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:19.617481 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2dfce-0dd1-4628-b70d-7c513ea8078d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:19.618344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2dfce-0dd1-4628-b70d-7c513ea8078d admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:19.618710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2dfce-0dd1-4628-b70d-7c513ea8078d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:19.619103 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2dfce-0dd1-4628-b70d-7c513ea8078d admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:19.620381 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2dfce-0dd1-4628-b70d-7c513ea8078d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:19.623540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2dfce-0dd1-4628-b70d-7c513ea8078d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:19.631782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533191e-3722-4033-8f88-59e79275de3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:19.633516 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533191e-3722-4033-8f88-59e79275de3a service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:19.647546 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1305/2613] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:19.647781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1309/2614] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:19.647891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019bd16-1df5-4276-b30f-84924c604184 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:19.647891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019bd16-1df5-4276-b30f-84924c604184 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:19.647891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019bd16-1df5-4276-b30f-84924c604184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:19.648533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7a101-97a2-4af8-b0c3-b545614443aa None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:19.648913 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7a101-97a2-4af8-b0c3-b545614443aa None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:19.649279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7a101-97a2-4af8-b0c3-b545614443aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:19.677748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-37a7a101-97a2-4af8-b0c3-b545614443aa None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:19.678397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1019bd16-1df5-4276-b30f-84924c604184 None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:19.679648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-37a7a101-97a2-4af8-b0c3-b545614443aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:19.680571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1019bd16-1df5-4276-b30f-84924c604184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:19.694193 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1310/2615] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:19.695819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7a101-97a2-4af8-b0c3-b545614443aa None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:19.708511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7a101-97a2-4af8-b0c3-b545614443aa None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:19.714992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81dd41-8f8e-436d-bd10-8f096320eedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:19.716411 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81dd41-8f8e-436d-bd10-8f096320eedc admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:19.716798 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81dd41-8f8e-436d-bd10-8f096320eedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:19.717169 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81dd41-8f8e-436d-bd10-8f096320eedc admin admin] PATH_INFO: `/v3/projects/91edc13ec9804df6960892f68fa79d9c/users/97dd0c3274f94c23b146dab9b316ed25/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:19.740902 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81dd41-8f8e-436d-bd10-8f096320eedc admin admin] RBAC: Authorizing `identity:create_grant(project_id=91edc13ec9804df6960892f68fa79d9c, user_id=97dd0c3274f94c23b146dab9b316ed25, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:19.744153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81dd41-8f8e-436d-bd10-8f096320eedc admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:19.763036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1311/2616] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:19 2022] PUT /identity/v3/projects/91edc13ec9804df6960892f68fa79d9c/users/97dd0c3274f94c23b146dab9b316ed25/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:19.764229 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81dd41-8f8e-436d-bd10-8f096320eedc admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:19.766120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7e81dd41-8f8e-436d-bd10-8f096320eedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:19.801995 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1306/2617] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jul 21 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:19.803318 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019bd16-1df5-4276-b30f-84924c604184 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:19.823652 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019bd16-1df5-4276-b30f-84924c604184 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:19.856474 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81dd41-8f8e-436d-bd10-8f096320eedc admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:19.861933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf26b86-baae-423b-8cf3-071e1cb910da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:19.862964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf26b86-baae-423b-8cf3-071e1cb910da service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:19.863283 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf26b86-baae-423b-8cf3-071e1cb910da service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:19.863564 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf26b86-baae-423b-8cf3-071e1cb910da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:19.907594 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d473d-95b5-4e2f-9bd8-bc81252072b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:19.908336 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d473d-95b5-4e2f-9bd8-bc81252072b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:19.908619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d473d-95b5-4e2f-9bd8-bc81252072b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:19.908897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d473d-95b5-4e2f-9bd8-bc81252072b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:19.909849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d473d-95b5-4e2f-9bd8-bc81252072b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:19.911584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d473d-95b5-4e2f-9bd8-bc81252072b8 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:19.923843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1307/2618] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:19.925179 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d473d-95b5-4e2f-9bd8-bc81252072b8 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:19.927311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-835d473d-95b5-4e2f-9bd8-bc81252072b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:19.952534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf26b86-baae-423b-8cf3-071e1cb910da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:19.954003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf26b86-baae-423b-8cf3-071e1cb910da service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:19.966206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1312/2619] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:19.967137 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf26b86-baae-423b-8cf3-071e1cb910da service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:19.980466 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf26b86-baae-423b-8cf3-071e1cb910da service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:19.984479 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc7dd8-5990-48b9-a7ba-9781c32346a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:19.985453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7dd8-5990-48b9-a7ba-9781c32346a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:19.985909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7dd8-5990-48b9-a7ba-9781c32346a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:19.986186 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7dd8-5990-48b9-a7ba-9781c32346a9 admin admin] PATH_INFO: `/v3/projects/91edc13ec9804df6960892f68fa79d9c/users/97dd0c3274f94c23b146dab9b316ed25/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:19.988426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc7dd8-5990-48b9-a7ba-9781c32346a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91edc13ec9804df6960892f68fa79d9c, user_id=97dd0c3274f94c23b146dab9b316ed25, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:19.991170 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc7dd8-5990-48b9-a7ba-9781c32346a9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:20.000182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:20.005106 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1313/2620] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:19 2022] PUT /identity/v3/projects/91edc13ec9804df6960892f68fa79d9c/users/97dd0c3274f94c23b146dab9b316ed25/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:20.018517 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e20bb-f107-43c2-ac16-ff53ad0e0715 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:20.018869 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e20bb-f107-43c2-ac16-ff53ad0e0715 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:20.019156 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e20bb-f107-43c2-ac16-ff53ad0e0715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:20.027875 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:20.033437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d473d-95b5-4e2f-9bd8-bc81252072b8 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:20.058690 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6e6e20bb-f107-43c2-ac16-ff53ad0e0715 None None] MFA Rules not processed for user `97dd0c3274f94c23b146dab9b316ed25`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:20.060180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6e6e20bb-f107-43c2-ac16-ff53ad0e0715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:20.121442 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a56d1-6a1b-41ea-bd74-e2dee0fb954f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:20.122227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a56d1-6a1b-41ea-bd74-e2dee0fb954f service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:20.122626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a56d1-6a1b-41ea-bd74-e2dee0fb954f service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:20.122934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a56d1-6a1b-41ea-bd74-e2dee0fb954f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:20.154345 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1314/2621] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:20.170598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e20bb-f107-43c2-ac16-ff53ad0e0715 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:20.173062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6e6e20bb-f107-43c2-ac16-ff53ad0e0715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:20.216026 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a56d1-6a1b-41ea-bd74-e2dee0fb954f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:20.218566 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a56d1-6a1b-41ea-bd74-e2dee0fb954f service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:20.229437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1308/2622] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:22:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:22:20.276829 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e20bb-f107-43c2-ac16-ff53ad0e0715 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:20.283236 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21973b5e-eb78-4874-a592-f020cc28b332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:20.284338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21973b5e-eb78-4874-a592-f020cc28b332 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:20.284874 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21973b5e-eb78-4874-a592-f020cc28b332 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:20.285712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21973b5e-eb78-4874-a592-f020cc28b332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:20.301947 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-21973b5e-eb78-4874-a592-f020cc28b332 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:20.392558 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a56d1-6a1b-41ea-bd74-e2dee0fb954f service swift] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:20.395287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c18a56d1-6a1b-41ea-bd74-e2dee0fb954f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:20.421042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21973b5e-eb78-4874-a592-f020cc28b332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:20.425392 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21973b5e-eb78-4874-a592-f020cc28b332 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:20.445467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1315/2623] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:20.546979 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a56d1-6a1b-41ea-bd74-e2dee0fb954f service swift] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:20.558354 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:20.560212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:20.560808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:20.561590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] PATH_INFO: `/v3/projects/03278f9f9b2a4f9b8262e90ef6ef8a80` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:20.564084 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03278f9f9b2a4f9b8262e90ef6ef8a80)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:20.567845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:20.620764 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:20.644643 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03278f9f9b2a4f9b8262e90ef6ef8a80', 'request_id': 'req-7a3a9906-df9e-451c-b636-2cdef14b9816'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:20.657227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03278f9f9b2a4f9b8262e90ef6ef8a80', 'request_id': 'req-7a3a9906-df9e-451c-b636-2cdef14b9816'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:20.670919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03278f9f9b2a4f9b8262e90ef6ef8a80', 'request_id': 'req-7a3a9906-df9e-451c-b636-2cdef14b9816'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:20.694488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] The token cache is being invalidate because project 03278f9f9b2a4f9b8262e90ef6ef8a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:22:20.695187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:20.703622 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:20.706515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1309/2624] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:22:20 2022] DELETE /identity/v3/projects/03278f9f9b2a4f9b8262e90ef6ef8a80 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:20.726944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21973b5e-eb78-4874-a592-f020cc28b332 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:20.741282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21973b5e-eb78-4874-a592-f020cc28b332 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:20.799420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:20.829336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672273e6-9c6e-4456-8836-5918b7a1fff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:20.830566 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672273e6-9c6e-4456-8836-5918b7a1fff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:20.830958 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672273e6-9c6e-4456-8836-5918b7a1fff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:20.831299 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672273e6-9c6e-4456-8836-5918b7a1fff3 admin admin] PATH_INFO: `/v3/users/716c99383ea8463090dd2482e2f504af` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:20.832598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672273e6-9c6e-4456-8836-5918b7a1fff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=716c99383ea8463090dd2482e2f504af)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:20.834696 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672273e6-9c6e-4456-8836-5918b7a1fff3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:20.929836 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-672273e6-9c6e-4456-8836-5918b7a1fff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716c99383ea8463090dd2482e2f504af'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:20.937560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-672273e6-9c6e-4456-8836-5918b7a1fff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716c99383ea8463090dd2482e2f504af'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:20.938329 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-672273e6-9c6e-4456-8836-5918b7a1fff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716c99383ea8463090dd2482e2f504af'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:20.951458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-672273e6-9c6e-4456-8836-5918b7a1fff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716c99383ea8463090dd2482e2f504af'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:20.952271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-672273e6-9c6e-4456-8836-5918b7a1fff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716c99383ea8463090dd2482e2f504af'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:20.967834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1316/2625] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:22:20 2022] DELETE /identity/v3/users/716c99383ea8463090dd2482e2f504af => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:21.316059 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:21.317562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:21.337466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a9906-df9e-451c-b636-2cdef14b9816 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:21.403041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb0e6d-5263-4b90-bfcf-117d28c9f411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:21.404068 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb0e6d-5263-4b90-bfcf-117d28c9f411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:21.404354 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb0e6d-5263-4b90-bfcf-117d28c9f411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:21.404622 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb0e6d-5263-4b90-bfcf-117d28c9f411 admin admin] PATH_INFO: `/v3/projects/e059bcf85d484177b807100c624f0e80` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:21.406736 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb0e6d-5263-4b90-bfcf-117d28c9f411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e059bcf85d484177b807100c624f0e80)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:21.408695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb0e6d-5263-4b90-bfcf-117d28c9f411 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:21.471610 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-30fb0e6d-5263-4b90-bfcf-117d28c9f411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e059bcf85d484177b807100c624f0e80', 'request_id': 'req-30fb0e6d-5263-4b90-bfcf-117d28c9f411'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:21.480424 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-30fb0e6d-5263-4b90-bfcf-117d28c9f411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e059bcf85d484177b807100c624f0e80', 'request_id': 'req-30fb0e6d-5263-4b90-bfcf-117d28c9f411'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:21.486851 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-30fb0e6d-5263-4b90-bfcf-117d28c9f411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e059bcf85d484177b807100c624f0e80', 'request_id': 'req-30fb0e6d-5263-4b90-bfcf-117d28c9f411'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:21.499483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-30fb0e6d-5263-4b90-bfcf-117d28c9f411 admin admin] The token cache is being invalidate because project e059bcf85d484177b807100c624f0e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:22:21.499681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-30fb0e6d-5263-4b90-bfcf-117d28c9f411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:21.500345 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-30fb0e6d-5263-4b90-bfcf-117d28c9f411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:21.502053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1310/2626] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:22:21 2022] DELETE /identity/v3/projects/e059bcf85d484177b807100c624f0e80 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:21.507675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e533f8-b5ae-4de9-9691-8cd080b3ee1b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:21.508192 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e533f8-b5ae-4de9-9691-8cd080b3ee1b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:21.508305 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e533f8-b5ae-4de9-9691-8cd080b3ee1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:21.526785 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-37e533f8-b5ae-4de9-9691-8cd080b3ee1b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:21.528083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-37e533f8-b5ae-4de9-9691-8cd080b3ee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:21.599944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1317/2627] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:22:21.608330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb7ecb-3396-4d88-a5f1-f360a51a609a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:21.609399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb7ecb-3396-4d88-a5f1-f360a51a609a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:21.609399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb7ecb-3396-4d88-a5f1-f360a51a609a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:21.631649 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e2bb7ecb-3396-4d88-a5f1-f360a51a609a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:21.632863 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e2bb7ecb-3396-4d88-a5f1-f360a51a609a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:21.641859 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1311/2628] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:21.646386 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e533f8-b5ae-4de9-9691-8cd080b3ee1b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:21.656898 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e533f8-b5ae-4de9-9691-8cd080b3ee1b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:21.662097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab96a4-68b9-4c70-b00c-af3c965fa7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:21.662880 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab96a4-68b9-4c70-b00c-af3c965fa7ee admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:21.663159 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab96a4-68b9-4c70-b00c-af3c965fa7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:21.663439 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab96a4-68b9-4c70-b00c-af3c965fa7ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:21.664378 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab96a4-68b9-4c70-b00c-af3c965fa7ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:22:21.664804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab96a4-68b9-4c70-b00c-af3c965fa7ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:21.666341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab96a4-68b9-4c70-b00c-af3c965fa7ee admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:21.690306 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1318/2629] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:22:21.692356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb7ecb-3396-4d88-a5f1-f360a51a609a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:21.709858 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb7ecb-3396-4d88-a5f1-f360a51a609a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:21.717886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dbe04-bf43-451c-9ed8-31d925b3673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:21.719274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dbe04-bf43-451c-9ed8-31d925b3673e admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:21.719761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dbe04-bf43-451c-9ed8-31d925b3673e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:21.720237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dbe04-bf43-451c-9ed8-31d925b3673e admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:21.721531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dbe04-bf43-451c-9ed8-31d925b3673e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:21.725313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dbe04-bf43-451c-9ed8-31d925b3673e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:21.767365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1312/2630] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:22:21 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:21.772427 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab96a4-68b9-4c70-b00c-af3c965fa7ee admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:21.792872 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab96a4-68b9-4c70-b00c-af3c965fa7ee admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:21.851522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:21.874143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4cb9a-fe9a-493a-bc8c-265987bc705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:21.875410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4cb9a-fe9a-493a-bc8c-265987bc705f admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:21.875912 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4cb9a-fe9a-493a-bc8c-265987bc705f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:21.876433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4cb9a-fe9a-493a-bc8c-265987bc705f admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:21.877701 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4cb9a-fe9a-493a-bc8c-265987bc705f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:21.881643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4cb9a-fe9a-493a-bc8c-265987bc705f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:21.906539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1319/2631] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:22:21 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:21.911919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dbe04-bf43-451c-9ed8-31d925b3673e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:21.924094 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dbe04-bf43-451c-9ed8-31d925b3673e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:21.929874 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337edd4e-c42f-4595-b386-52f331d56102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:21.930967 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337edd4e-c42f-4595-b386-52f331d56102 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:21.931248 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337edd4e-c42f-4595-b386-52f331d56102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:21.931525 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337edd4e-c42f-4595-b386-52f331d56102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:21.932273 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337edd4e-c42f-4595-b386-52f331d56102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:21.933897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337edd4e-c42f-4595-b386-52f331d56102 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:21.952400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1313/2632] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:22:21.953877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4cb9a-fe9a-493a-bc8c-265987bc705f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:21.965165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4cb9a-fe9a-493a-bc8c-265987bc705f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:21.970261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e63f1-a883-47b4-9b39-dc2821a4f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:21.970980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e63f1-a883-47b4-9b39-dc2821a4f19a admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:21.971269 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e63f1-a883-47b4-9b39-dc2821a4f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:21.971547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e63f1-a883-47b4-9b39-dc2821a4f19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:21.972304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e63f1-a883-47b4-9b39-dc2821a4f19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:21.973960 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e63f1-a883-47b4-9b39-dc2821a4f19a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:21.985337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1320/2633] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:21.990960 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337edd4e-c42f-4595-b386-52f331d56102 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:22.002271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337edd4e-c42f-4595-b386-52f331d56102 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:22.007216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19232f-6404-47c6-b93e-0bca1e4d4efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:22.008129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19232f-6404-47c6-b93e-0bca1e4d4efe admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:22.008412 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19232f-6404-47c6-b93e-0bca1e4d4efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:22.008686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19232f-6404-47c6-b93e-0bca1e4d4efe admin admin] PATH_INFO: `/v3/projects/ce874939131143ce943955c8a4286c62/users/0c4b234a55f14e55ae220062f5ba6ba8/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:22.011469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:22.028058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19232f-6404-47c6-b93e-0bca1e4d4efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce874939131143ce943955c8a4286c62, user_id=0c4b234a55f14e55ae220062f5ba6ba8, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:22.031106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19232f-6404-47c6-b93e-0bca1e4d4efe admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:22.046753 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1314/2634] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:21 2022] PUT /identity/v3/projects/ce874939131143ce943955c8a4286c62/users/0c4b234a55f14e55ae220062f5ba6ba8/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:22.060892 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1d9ca-77ba-485f-8ba8-74e6804cc3a2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:22.061295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1d9ca-77ba-485f-8ba8-74e6804cc3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:22.061571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1d9ca-77ba-485f-8ba8-74e6804cc3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:22.106196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-93c1d9ca-77ba-485f-8ba8-74e6804cc3a2 None None] MFA Rules not processed for user `0c4b234a55f14e55ae220062f5ba6ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:22.107544 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-93c1d9ca-77ba-485f-8ba8-74e6804cc3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:22.160897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19232f-6404-47c6-b93e-0bca1e4d4efe admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:22.163552 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1e19232f-6404-47c6-b93e-0bca1e4d4efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:22.191691 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1321/2635] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:22.204471 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1d9ca-77ba-485f-8ba8-74e6804cc3a2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:22.206054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-93c1d9ca-77ba-485f-8ba8-74e6804cc3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:22.250180 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19232f-6404-47c6-b93e-0bca1e4d4efe admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:22.254111 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931e0eb-ef8e-4a33-96ac-099a8ccdb20d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:22.254807 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e0eb-ef8e-4a33-96ac-099a8ccdb20d service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:22.255090 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e0eb-ef8e-4a33-96ac-099a8ccdb20d service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:22.255361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e0eb-ef8e-4a33-96ac-099a8ccdb20d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:22.257346 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a931e0eb-ef8e-4a33-96ac-099a8ccdb20d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:22.270575 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1d9ca-77ba-485f-8ba8-74e6804cc3a2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:22.275992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a27430-5364-4ddd-88fb-2a51f5006d7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10611bf25b9e4604ad769a6902f7f457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:22.277250 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27430-5364-4ddd-88fb-2a51f5006d7d service glance] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:22.277830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27430-5364-4ddd-88fb-2a51f5006d7d service glance] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:22.278287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27430-5364-4ddd-88fb-2a51f5006d7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:22.290317 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a27430-5364-4ddd-88fb-2a51f5006d7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:22.291864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a27430-5364-4ddd-88fb-2a51f5006d7d service glance] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:22.302992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1322/2636] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:22:22.325166 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931e0eb-ef8e-4a33-96ac-099a8ccdb20d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:22.326971 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931e0eb-ef8e-4a33-96ac-099a8ccdb20d service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:22.339676 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1315/2637] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:22:23.037591 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a27430-5364-4ddd-88fb-2a51f5006d7d service glance] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:23.060064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a27430-5364-4ddd-88fb-2a51f5006d7d service glance] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:23.066173 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9e995-60a6-4fb1-91f3-0630e7378971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:23.068140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9e995-60a6-4fb1-91f3-0630e7378971 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:23.070111 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9e995-60a6-4fb1-91f3-0630e7378971 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:23.070471 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9e995-60a6-4fb1-91f3-0630e7378971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:23.075933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-65e9e995-60a6-4fb1-91f3-0630e7378971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:23.185833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:23.191163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9e995-60a6-4fb1-91f3-0630e7378971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:23.192738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9e995-60a6-4fb1-91f3-0630e7378971 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:23.210056 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1323/2638] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:23.278684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28489c9-3ad0-46af-ad22-9b4455777cb1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:23.279459 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28489c9-3ad0-46af-ad22-9b4455777cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:23.279459 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28489c9-3ad0-46af-ad22-9b4455777cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:23.302750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f28489c9-3ad0-46af-ad22-9b4455777cb1 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:23.304054 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f28489c9-3ad0-46af-ad22-9b4455777cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:23.386992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1316/2639] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jul 21 12:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:23.412739 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9e995-60a6-4fb1-91f3-0630e7378971 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:23.414601 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-65e9e995-60a6-4fb1-91f3-0630e7378971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:23.513762 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9e995-60a6-4fb1-91f3-0630e7378971 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:23.519568 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02ae08-7c5b-4577-86e6-f6b2df0b1b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:23.520254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02ae08-7c5b-4577-86e6-f6b2df0b1b34 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:23.520603 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02ae08-7c5b-4577-86e6-f6b2df0b1b34 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:23.520987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02ae08-7c5b-4577-86e6-f6b2df0b1b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:23.532707 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02ae08-7c5b-4577-86e6-f6b2df0b1b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:23.534438 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02ae08-7c5b-4577-86e6-f6b2df0b1b34 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:23.547630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1324/2640] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:26.584779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054b6f-e483-4e4b-a293-9030a7638a9f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:26.585381 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054b6f-e483-4e4b-a293-9030a7638a9f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:26.585718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054b6f-e483-4e4b-a293-9030a7638a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:26.609561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-67054b6f-e483-4e4b-a293-9030a7638a9f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:26.610838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-67054b6f-e483-4e4b-a293-9030a7638a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:26.620041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1317/2641] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jul 21 12:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:26.641544 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02ae08-7c5b-4577-86e6-f6b2df0b1b34 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:26.643241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4f02ae08-7c5b-4577-86e6-f6b2df0b1b34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:26.660456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02ae08-7c5b-4577-86e6-f6b2df0b1b34 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:26.667179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee7a64-a33c-4e88-bf8b-1257ae0d99d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:26.667894 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee7a64-a33c-4e88-bf8b-1257ae0d99d6 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:26.668643 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee7a64-a33c-4e88-bf8b-1257ae0d99d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:26.669026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee7a64-a33c-4e88-bf8b-1257ae0d99d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:26.680390 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee7a64-a33c-4e88-bf8b-1257ae0d99d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:26.681979 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee7a64-a33c-4e88-bf8b-1257ae0d99d6 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:26.692410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1325/2642] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:27.230955 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67054b6f-e483-4e4b-a293-9030a7638a9f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:27.232638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-67054b6f-e483-4e4b-a293-9030a7638a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:27.244930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67054b6f-e483-4e4b-a293-9030a7638a9f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:27.250365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dc378-42dd-404b-9d9f-b3a8b551e12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:27.251293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dc378-42dd-404b-9d9f-b3a8b551e12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:27.251570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dc378-42dd-404b-9d9f-b3a8b551e12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:27.251838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dc378-42dd-404b-9d9f-b3a8b551e12d admin admin] PATH_INFO: `/v3/users/0ff57d7de3334310b0fc70ae1a4ba1a7` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:27.253121 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dc378-42dd-404b-9d9f-b3a8b551e12d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff57d7de3334310b0fc70ae1a4ba1a7)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:27.255106 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dc378-42dd-404b-9d9f-b3a8b551e12d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:27.292880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:27.317897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f4dc378-42dd-404b-9d9f-b3a8b551e12d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff57d7de3334310b0fc70ae1a4ba1a7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:27.318907 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f4dc378-42dd-404b-9d9f-b3a8b551e12d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff57d7de3334310b0fc70ae1a4ba1a7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:27.333686 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f4dc378-42dd-404b-9d9f-b3a8b551e12d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff57d7de3334310b0fc70ae1a4ba1a7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:27.341655 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f4dc378-42dd-404b-9d9f-b3a8b551e12d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff57d7de3334310b0fc70ae1a4ba1a7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:27.342505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f4dc378-42dd-404b-9d9f-b3a8b551e12d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff57d7de3334310b0fc70ae1a4ba1a7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:27.363957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1318/2643] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:22:27 2022] DELETE /identity/v3/users/0ff57d7de3334310b0fc70ae1a4ba1a7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:27.366007 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20906a80-0975-4701-85f4-0e0e1c401a1a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:27.366419 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20906a80-0975-4701-85f4-0e0e1c401a1a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:27.366879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20906a80-0975-4701-85f4-0e0e1c401a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:27.386484 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-20906a80-0975-4701-85f4-0e0e1c401a1a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:27.387853 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-20906a80-0975-4701-85f4-0e0e1c401a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:27.476651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1326/2644] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:27.488098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dc378-42dd-404b-9d9f-b3a8b551e12d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:27.489729 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7f4dc378-42dd-404b-9d9f-b3a8b551e12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:27.557153 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dc378-42dd-404b-9d9f-b3a8b551e12d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:27.561775 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d70ca-a0d1-41df-9da8-d790a0219f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:27.562456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d70ca-a0d1-41df-9da8-d790a0219f97 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:27.562783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d70ca-a0d1-41df-9da8-d790a0219f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:27.563062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d70ca-a0d1-41df-9da8-d790a0219f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:27.573717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d70ca-a0d1-41df-9da8-d790a0219f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:27.575282 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d70ca-a0d1-41df-9da8-d790a0219f97 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:27.586081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1319/2645] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:27.950623 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20906a80-0975-4701-85f4-0e0e1c401a1a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:27.953006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-20906a80-0975-4701-85f4-0e0e1c401a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:27.968110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20906a80-0975-4701-85f4-0e0e1c401a1a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:27.974353 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:27.975491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:27.975864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:27.976236 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] PATH_INFO: `/v3/projects/808aced9c4cf4da082eb241a0255dca6` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:27.977741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808aced9c4cf4da082eb241a0255dca6)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:27.980067 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:28.047409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808aced9c4cf4da082eb241a0255dca6', 'request_id': 'req-e2dd79e5-7783-48c4-8e2b-2df870c24852'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.056515 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808aced9c4cf4da082eb241a0255dca6', 'request_id': 'req-e2dd79e5-7783-48c4-8e2b-2df870c24852'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.064676 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808aced9c4cf4da082eb241a0255dca6', 'request_id': 'req-e2dd79e5-7783-48c4-8e2b-2df870c24852'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.066084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:28.081028 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] The token cache is being invalidate because project 808aced9c4cf4da082eb241a0255dca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:22:28.081319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.081969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.084216 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1327/2646] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:22:27 2022] DELETE /identity/v3/projects/808aced9c4cf4da082eb241a0255dca6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:28.089689 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d70ca-a0d1-41df-9da8-d790a0219f97 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:28.104446 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d70ca-a0d1-41df-9da8-d790a0219f97 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:28.179167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059d2de-7624-4e3b-ba0a-ca4e99ea9c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:28.180191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059d2de-7624-4e3b-ba0a-ca4e99ea9c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:28.180560 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059d2de-7624-4e3b-ba0a-ca4e99ea9c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:28.180899 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059d2de-7624-4e3b-ba0a-ca4e99ea9c9d admin admin] PATH_INFO: `/v3/users/79b317c70d41429591e531bc21bbd1fc` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:28.182391 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059d2de-7624-4e3b-ba0a-ca4e99ea9c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b317c70d41429591e531bc21bbd1fc)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:28.184380 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059d2de-7624-4e3b-ba0a-ca4e99ea9c9d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:28.251722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b059d2de-7624-4e3b-ba0a-ca4e99ea9c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b317c70d41429591e531bc21bbd1fc'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.252400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b059d2de-7624-4e3b-ba0a-ca4e99ea9c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b317c70d41429591e531bc21bbd1fc'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.253588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:28.274611 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b059d2de-7624-4e3b-ba0a-ca4e99ea9c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b317c70d41429591e531bc21bbd1fc'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.283027 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b059d2de-7624-4e3b-ba0a-ca4e99ea9c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b317c70d41429591e531bc21bbd1fc'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.283816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b059d2de-7624-4e3b-ba0a-ca4e99ea9c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b317c70d41429591e531bc21bbd1fc'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.298561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1320/2647] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:22:28 2022] DELETE /identity/v3/users/79b317c70d41429591e531bc21bbd1fc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:22:28.629340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:28.630944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:28.644697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd79e5-7783-48c4-8e2b-2df870c24852 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:28.711629 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:28.712677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:28.712965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:28.713251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] PATH_INFO: `/v3/projects/0fe896d3f9bb4bc58aceceef83c13430` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:28.714680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe896d3f9bb4bc58aceceef83c13430)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:28.718469 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:28.774680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe896d3f9bb4bc58aceceef83c13430', 'request_id': 'req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.783996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe896d3f9bb4bc58aceceef83c13430', 'request_id': 'req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.791207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe896d3f9bb4bc58aceceef83c13430', 'request_id': 'req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.802722 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] The token cache is being invalidate because project 0fe896d3f9bb4bc58aceceef83c13430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:22:28.803010 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.803707 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.805282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1328/2648] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:22:28 2022] DELETE /identity/v3/projects/0fe896d3f9bb4bc58aceceef83c13430 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:28.811252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059d2de-7624-4e3b-ba0a-ca4e99ea9c9d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:28.817966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b059d2de-7624-4e3b-ba0a-ca4e99ea9c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:28.837120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059d2de-7624-4e3b-ba0a-ca4e99ea9c9d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:28.900304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f5831-d068-468b-a66c-42b3a88ed8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:28.901194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f5831-d068-468b-a66c-42b3a88ed8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:28.901468 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f5831-d068-468b-a66c-42b3a88ed8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:28.901759 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f5831-d068-468b-a66c-42b3a88ed8f2 admin admin] PATH_INFO: `/v3/users/97dd0c3274f94c23b146dab9b316ed25` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:28.903009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f5831-d068-468b-a66c-42b3a88ed8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97dd0c3274f94c23b146dab9b316ed25)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:28.905150 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f5831-d068-468b-a66c-42b3a88ed8f2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:28.964723 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-209f5831-d068-468b-a66c-42b3a88ed8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97dd0c3274f94c23b146dab9b316ed25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.965452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-209f5831-d068-468b-a66c-42b3a88ed8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97dd0c3274f94c23b146dab9b316ed25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.978597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-209f5831-d068-468b-a66c-42b3a88ed8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97dd0c3274f94c23b146dab9b316ed25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.985744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-209f5831-d068-468b-a66c-42b3a88ed8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97dd0c3274f94c23b146dab9b316ed25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:28.986466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-209f5831-d068-468b-a66c-42b3a88ed8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97dd0c3274f94c23b146dab9b316ed25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:29.011680 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1321/2649] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:22:28 2022] DELETE /identity/v3/users/97dd0c3274f94c23b146dab9b316ed25 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:22:29.344439 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:29.346039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:29.361419 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0dc77-40d4-4dae-83cf-88ee1ff4d8c3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:29.426625 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc4927-0b9b-44ec-a621-42762bae439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:29.427556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc4927-0b9b-44ec-a621-42762bae439d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:29.427814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc4927-0b9b-44ec-a621-42762bae439d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:29.428176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc4927-0b9b-44ec-a621-42762bae439d admin admin] PATH_INFO: `/v3/projects/91edc13ec9804df6960892f68fa79d9c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:29.429392 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc4927-0b9b-44ec-a621-42762bae439d admin admin] RBAC: Authorizing `identity:delete_project(project_id=91edc13ec9804df6960892f68fa79d9c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:29.431328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc4927-0b9b-44ec-a621-42762bae439d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:29.465916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:29.494258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3edc4927-0b9b-44ec-a621-42762bae439d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91edc13ec9804df6960892f68fa79d9c', 'request_id': 'req-3edc4927-0b9b-44ec-a621-42762bae439d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:29.503890 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3edc4927-0b9b-44ec-a621-42762bae439d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91edc13ec9804df6960892f68fa79d9c', 'request_id': 'req-3edc4927-0b9b-44ec-a621-42762bae439d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:29.514830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3edc4927-0b9b-44ec-a621-42762bae439d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91edc13ec9804df6960892f68fa79d9c', 'request_id': 'req-3edc4927-0b9b-44ec-a621-42762bae439d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:29.526753 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3edc4927-0b9b-44ec-a621-42762bae439d admin admin] The token cache is being invalidate because project 91edc13ec9804df6960892f68fa79d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:22:29.526978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3edc4927-0b9b-44ec-a621-42762bae439d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:29.527655 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-3edc4927-0b9b-44ec-a621-42762bae439d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:29.529376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1329/2650] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:22:29 2022] DELETE /identity/v3/projects/91edc13ec9804df6960892f68fa79d9c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:29.535600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658f52e-cd72-4e63-87e6-77ac304f9ab3 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:29.535890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658f52e-cd72-4e63-87e6-77ac304f9ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:29.535890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658f52e-cd72-4e63-87e6-77ac304f9ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:29.558381 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c658f52e-cd72-4e63-87e6-77ac304f9ab3 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:29.559703 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c658f52e-cd72-4e63-87e6-77ac304f9ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:29.617678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:29.625679 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0d226-ce6a-493d-add3-d526e045ce55 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:29.626101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0d226-ce6a-493d-add3-d526e045ce55 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:29.626332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0d226-ce6a-493d-add3-d526e045ce55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:29.647168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1322/2651] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:22:29.647396 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f7a0d226-ce6a-493d-add3-d526e045ce55 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:29.648153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f7a0d226-ce6a-493d-add3-d526e045ce55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:29.656624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca0f6b-7a7d-4128-b51a-281d556aee46 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:29.657079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca0f6b-7a7d-4128-b51a-281d556aee46 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:29.657219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1330/2652] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jul 21 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:29.657360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca0f6b-7a7d-4128-b51a-281d556aee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:29.680825 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-adca0f6b-7a7d-4128-b51a-281d556aee46 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:29.682589 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-adca0f6b-7a7d-4128-b51a-281d556aee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:29.685950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0d226-ce6a-493d-add3-d526e045ce55 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:29.687498 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f7a0d226-ce6a-493d-add3-d526e045ce55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:29.699095 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1323/2653] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:22:29.700168 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca0f6b-7a7d-4128-b51a-281d556aee46 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:29.710571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca0f6b-7a7d-4128-b51a-281d556aee46 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:29.717032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ad6cf-86d5-4bd0-bbbc-0039e5827f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:29.717770 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ad6cf-86d5-4bd0-bbbc-0039e5827f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:29.718062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ad6cf-86d5-4bd0-bbbc-0039e5827f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:29.718359 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ad6cf-86d5-4bd0-bbbc-0039e5827f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:29.719200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ad6cf-86d5-4bd0-bbbc-0039e5827f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:22:29.719520 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ad6cf-86d5-4bd0-bbbc-0039e5827f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:29.721182 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ad6cf-86d5-4bd0-bbbc-0039e5827f78 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:29.735246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1324/2654] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:22:29.740565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ad6cf-86d5-4bd0-bbbc-0039e5827f78 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:29.754469 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ad6cf-86d5-4bd0-bbbc-0039e5827f78 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:29.760380 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2545b7c-ec90-4810-bdbc-58b4c5d692fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:29.761046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2545b7c-ec90-4810-bdbc-58b4c5d692fb admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:29.761335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2545b7c-ec90-4810-bdbc-58b4c5d692fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:29.761609 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2545b7c-ec90-4810-bdbc-58b4c5d692fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:29.762319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2545b7c-ec90-4810-bdbc-58b4c5d692fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:29.764495 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2545b7c-ec90-4810-bdbc-58b4c5d692fb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:29.785229 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0d226-ce6a-493d-add3-d526e045ce55 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:29.792220 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa414dcf-42cf-4488-969a-d8cf2e25b364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:29.793545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa414dcf-42cf-4488-969a-d8cf2e25b364 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:29.794332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa414dcf-42cf-4488-969a-d8cf2e25b364 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:29.794332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa414dcf-42cf-4488-969a-d8cf2e25b364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:29.803593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1325/2655] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:22:29 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:22:29.804841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa414dcf-42cf-4488-969a-d8cf2e25b364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:29.807231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa414dcf-42cf-4488-969a-d8cf2e25b364 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:29.809164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2545b7c-ec90-4810-bdbc-58b4c5d692fb admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:29.821279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1331/2656] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:22:29.896544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2545b7c-ec90-4810-bdbc-58b4c5d692fb admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:29.902843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94aee7b-4b9c-42ac-993a-bd4b81a71e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:29.903920 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aee7b-4b9c-42ac-993a-bd4b81a71e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:29.904835 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aee7b-4b9c-42ac-993a-bd4b81a71e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:29.904835 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aee7b-4b9c-42ac-993a-bd4b81a71e59 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:29.905464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94aee7b-4b9c-42ac-993a-bd4b81a71e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:29.907986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94aee7b-4b9c-42ac-993a-bd4b81a71e59 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:29.931744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1326/2657] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:22:29 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:22:29.935880 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa414dcf-42cf-4488-969a-d8cf2e25b364 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:29.947038 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa414dcf-42cf-4488-969a-d8cf2e25b364 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:29.953453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fde3e-f464-4aae-b9e2-6ddff393e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:29.954151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fde3e-f464-4aae-b9e2-6ddff393e8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:29.954439 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fde3e-f464-4aae-b9e2-6ddff393e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:29.954725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fde3e-f464-4aae-b9e2-6ddff393e8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:29.955482 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fde3e-f464-4aae-b9e2-6ddff393e8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:29.957078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fde3e-f464-4aae-b9e2-6ddff393e8f5 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:29.968735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1332/2658] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:29.974577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94aee7b-4b9c-42ac-993a-bd4b81a71e59 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:29.987330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94aee7b-4b9c-42ac-993a-bd4b81a71e59 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:29.993508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6256a-bfe3-47bb-a18e-1933bc8bb3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:29.994420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6256a-bfe3-47bb-a18e-1933bc8bb3cb admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:29.996110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6256a-bfe3-47bb-a18e-1933bc8bb3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:29.996110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6256a-bfe3-47bb-a18e-1933bc8bb3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:29.996110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6256a-bfe3-47bb-a18e-1933bc8bb3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:29.998047 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6256a-bfe3-47bb-a18e-1933bc8bb3cb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:30.015202 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1327/2659] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:22:30.020367 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fde3e-f464-4aae-b9e2-6ddff393e8f5 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:30.037598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fde3e-f464-4aae-b9e2-6ddff393e8f5 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:30.044951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e6775-052f-41e1-b850-4c93ac2a7b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:30.045879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6775-052f-41e1-b850-4c93ac2a7b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:30.046177 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6775-052f-41e1-b850-4c93ac2a7b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:30.046448 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6775-052f-41e1-b850-4c93ac2a7b11 admin admin] PATH_INFO: `/v3/projects/d8ecfa8293354aa9be3ecdddaa6435a6/users/d14c9402fa9048f3a8a7de43ceaadd6a/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:30.065165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e6775-052f-41e1-b850-4c93ac2a7b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ecfa8293354aa9be3ecdddaa6435a6, user_id=d14c9402fa9048f3a8a7de43ceaadd6a, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:30.069077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e6775-052f-41e1-b850-4c93ac2a7b11 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:30.084277 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1333/2660] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:22:30 2022] PUT /identity/v3/projects/d8ecfa8293354aa9be3ecdddaa6435a6/users/d14c9402fa9048f3a8a7de43ceaadd6a/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:30.090101 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041748c-6835-4d62-b833-238de6688d2f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:30.090459 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041748c-6835-4d62-b833-238de6688d2f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:30.090906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041748c-6835-4d62-b833-238de6688d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:30.110734 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1041748c-6835-4d62-b833-238de6688d2f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:30.112210 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1041748c-6835-4d62-b833-238de6688d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:30.179547 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1328/2661] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:30.190725 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e6775-052f-41e1-b850-4c93ac2a7b11 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:30.193313 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bb4e6775-052f-41e1-b850-4c93ac2a7b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:30.267851 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e6775-052f-41e1-b850-4c93ac2a7b11 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:30.271937 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7112-8961-4c47-86a8-7f2cb35f392c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:30.272677 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7112-8961-4c47-86a8-7f2cb35f392c service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:30.272966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7112-8961-4c47-86a8-7f2cb35f392c service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:30.273243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7112-8961-4c47-86a8-7f2cb35f392c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:30.284954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7112-8961-4c47-86a8-7f2cb35f392c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:30.285825 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:30.287769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7112-8961-4c47-86a8-7f2cb35f392c service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:30.302539 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1334/2662] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:31.079076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581136d3-b93b-41dc-acc3-fd8b8db17239 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:31.079812 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581136d3-b93b-41dc-acc3-fd8b8db17239 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:31.079916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581136d3-b93b-41dc-acc3-fd8b8db17239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:31.110323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-581136d3-b93b-41dc-acc3-fd8b8db17239 None None] MFA Rules not processed for user `d14c9402fa9048f3a8a7de43ceaadd6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:31.111589 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-581136d3-b93b-41dc-acc3-fd8b8db17239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:31.122718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:31.189733 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1329/2663] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:31.201322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7112-8961-4c47-86a8-7f2cb35f392c service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:31.202888 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-df1c7112-8961-4c47-86a8-7f2cb35f392c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:31.272264 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7112-8961-4c47-86a8-7f2cb35f392c service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:31.276153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381129d-5871-428d-9bf4-ab9d5d174e1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:31.277040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381129d-5871-428d-9bf4-ab9d5d174e1e service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:31.277340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381129d-5871-428d-9bf4-ab9d5d174e1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:31.277733 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381129d-5871-428d-9bf4-ab9d5d174e1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:31.302540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381129d-5871-428d-9bf4-ab9d5d174e1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:31.304204 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381129d-5871-428d-9bf4-ab9d5d174e1e service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:31.319143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1335/2664] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:32.789688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98473c-2d05-4576-9c90-87defd401a1d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:32.790290 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98473c-2d05-4576-9c90-87defd401a1d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:32.790290 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98473c-2d05-4576-9c90-87defd401a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:32.811399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-be98473c-2d05-4576-9c90-87defd401a1d None None] MFA Rules not processed for user `d14c9402fa9048f3a8a7de43ceaadd6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:32.812605 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-be98473c-2d05-4576-9c90-87defd401a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:32.819699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1330/2665] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:32.832198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6e194-f6a1-4c35-b272-c9f8cf27881c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:32.832633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6e194-f6a1-4c35-b272-c9f8cf27881c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:32.833027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6e194-f6a1-4c35-b272-c9f8cf27881c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:32.852384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-21f6e194-f6a1-4c35-b272-c9f8cf27881c None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:32.853729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-21f6e194-f6a1-4c35-b272-c9f8cf27881c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:32.863627 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1336/2666] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jul 21 12:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:32.887271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98473c-2d05-4576-9c90-87defd401a1d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:32.992174 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98473c-2d05-4576-9c90-87defd401a1d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:33.002700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c730b-b6f0-4ded-b364-2194ce8d5d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:33.003904 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c730b-b6f0-4ded-b364-2194ce8d5d64 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:33.004414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c730b-b6f0-4ded-b364-2194ce8d5d64 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:33.004909 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c730b-b6f0-4ded-b364-2194ce8d5d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:33.019516 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c730b-b6f0-4ded-b364-2194ce8d5d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:33.021987 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c730b-b6f0-4ded-b364-2194ce8d5d64 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:33.040374 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1331/2667] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:36.020995 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6bf2f-6a32-4b74-a147-a57ef9c0987f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:36.021571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6bf2f-6a32-4b74-a147-a57ef9c0987f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:36.021571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6bf2f-6a32-4b74-a147-a57ef9c0987f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:36.044402 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-14a6bf2f-6a32-4b74-a147-a57ef9c0987f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:36.045212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-14a6bf2f-6a32-4b74-a147-a57ef9c0987f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:36.053914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1337/2668] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jul 21 12:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:36.087780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c730b-b6f0-4ded-b364-2194ce8d5d64 service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:36.090838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ff5c730b-b6f0-4ded-b364-2194ce8d5d64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:36.119754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c730b-b6f0-4ded-b364-2194ce8d5d64 service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:36.130742 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6dadcb-2c17-4601-b0a5-a46adea13f3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:36.131926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dadcb-2c17-4601-b0a5-a46adea13f3a service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:36.132445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dadcb-2c17-4601-b0a5-a46adea13f3a service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:36.132947 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dadcb-2c17-4601-b0a5-a46adea13f3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:36.148975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6dadcb-2c17-4601-b0a5-a46adea13f3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:36.151974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6dadcb-2c17-4601-b0a5-a46adea13f3a service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:36.169436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1332/2669] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:39.098248 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6bf2f-6a32-4b74-a147-a57ef9c0987f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:39.099750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-14a6bf2f-6a32-4b74-a147-a57ef9c0987f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:39.114675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6bf2f-6a32-4b74-a147-a57ef9c0987f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:39.120330 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab177e45-63c1-4d42-9e7d-456571e709c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:39.121314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab177e45-63c1-4d42-9e7d-456571e709c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:39.121670 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab177e45-63c1-4d42-9e7d-456571e709c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:39.122050 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab177e45-63c1-4d42-9e7d-456571e709c1 admin admin] PATH_INFO: `/v3/users/0c4b234a55f14e55ae220062f5ba6ba8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:39.123431 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab177e45-63c1-4d42-9e7d-456571e709c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4b234a55f14e55ae220062f5ba6ba8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:39.125567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab177e45-63c1-4d42-9e7d-456571e709c1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:39.189124 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ab177e45-63c1-4d42-9e7d-456571e709c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4b234a55f14e55ae220062f5ba6ba8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:39.198965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ab177e45-63c1-4d42-9e7d-456571e709c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4b234a55f14e55ae220062f5ba6ba8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:39.200290 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ab177e45-63c1-4d42-9e7d-456571e709c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4b234a55f14e55ae220062f5ba6ba8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:39.215811 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ab177e45-63c1-4d42-9e7d-456571e709c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4b234a55f14e55ae220062f5ba6ba8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:39.216552 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ab177e45-63c1-4d42-9e7d-456571e709c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4b234a55f14e55ae220062f5ba6ba8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:39.234985 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1338/2670] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:22:39 2022] DELETE /identity/v3/users/0c4b234a55f14e55ae220062f5ba6ba8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:39.240832 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058155e-0b9c-4608-b1d1-aaaedaa07bcd None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:39.241383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058155e-0b9c-4608-b1d1-aaaedaa07bcd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:39.241383 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058155e-0b9c-4608-b1d1-aaaedaa07bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:39.261194 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3058155e-0b9c-4608-b1d1-aaaedaa07bcd None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:39.262962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3058155e-0b9c-4608-b1d1-aaaedaa07bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:39.358931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1333/2671] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:39.366256 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab177e45-63c1-4d42-9e7d-456571e709c1 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:39.367971 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ab177e45-63c1-4d42-9e7d-456571e709c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:39.437590 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab177e45-63c1-4d42-9e7d-456571e709c1 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:39.442206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab8f5d-b143-405d-b871-b90b199d6cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:39.443387 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab8f5d-b143-405d-b871-b90b199d6cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:39.443726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab8f5d-b143-405d-b871-b90b199d6cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:39.444064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab8f5d-b143-405d-b871-b90b199d6cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:39.455832 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab8f5d-b143-405d-b871-b90b199d6cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:39.457981 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab8f5d-b143-405d-b871-b90b199d6cc2 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:39.464078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:39.474933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1339/2672] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:39.780569 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058155e-0b9c-4608-b1d1-aaaedaa07bcd None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:39.783098 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3058155e-0b9c-4608-b1d1-aaaedaa07bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:39.802623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058155e-0b9c-4608-b1d1-aaaedaa07bcd None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:39.807930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827f85f-a43c-4bf8-b851-74ab8c299a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:39.808798 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827f85f-a43c-4bf8-b851-74ab8c299a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:39.809313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827f85f-a43c-4bf8-b851-74ab8c299a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:39.809605 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827f85f-a43c-4bf8-b851-74ab8c299a87 admin admin] PATH_INFO: `/v3/projects/ce874939131143ce943955c8a4286c62` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:39.810926 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827f85f-a43c-4bf8-b851-74ab8c299a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce874939131143ce943955c8a4286c62)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:39.813915 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827f85f-a43c-4bf8-b851-74ab8c299a87 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:39.827618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:39.870022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9827f85f-a43c-4bf8-b851-74ab8c299a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce874939131143ce943955c8a4286c62', 'request_id': 'req-9827f85f-a43c-4bf8-b851-74ab8c299a87'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:39.879766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9827f85f-a43c-4bf8-b851-74ab8c299a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce874939131143ce943955c8a4286c62', 'request_id': 'req-9827f85f-a43c-4bf8-b851-74ab8c299a87'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:39.886473 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9827f85f-a43c-4bf8-b851-74ab8c299a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce874939131143ce943955c8a4286c62', 'request_id': 'req-9827f85f-a43c-4bf8-b851-74ab8c299a87'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:39.899429 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9827f85f-a43c-4bf8-b851-74ab8c299a87 admin admin] The token cache is being invalidate because project ce874939131143ce943955c8a4286c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:22:39.899720 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9827f85f-a43c-4bf8-b851-74ab8c299a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:39.900463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9827f85f-a43c-4bf8-b851-74ab8c299a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:22:39.902107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1334/2673] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:22:39 2022] DELETE /identity/v3/projects/ce874939131143ce943955c8a4286c62 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:22:47.401438 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab8f5d-b143-405d-b871-b90b199d6cc2 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:47.403076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-39ab8f5d-b143-405d-b871-b90b199d6cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:47.546719 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab8f5d-b143-405d-b871-b90b199d6cc2 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:47.636450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220be60e-8b6d-406a-9b61-19bb3154ebaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:47.637121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220be60e-8b6d-406a-9b61-19bb3154ebaf service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:47.637401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220be60e-8b6d-406a-9b61-19bb3154ebaf service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:47.637946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220be60e-8b6d-406a-9b61-19bb3154ebaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:47.639693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-220be60e-8b6d-406a-9b61-19bb3154ebaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:47.654185 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220be60e-8b6d-406a-9b61-19bb3154ebaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:47.655836 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220be60e-8b6d-406a-9b61-19bb3154ebaf service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:47.667174 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1340/2674] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:22:49.895934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:22:53.403519 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc064c-d0aa-402b-b3b4-25377783f70a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:53.404200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc064c-d0aa-402b-b3b4-25377783f70a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:53.404200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc064c-d0aa-402b-b3b4-25377783f70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:53.423453 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5dcc064c-d0aa-402b-b3b4-25377783f70a None None] MFA Rules not processed for user `d14c9402fa9048f3a8a7de43ceaadd6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:53.424701 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5dcc064c-d0aa-402b-b3b4-25377783f70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:53.487589 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1335/2675] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:53.755547 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7142-a501-4d56-b538-bef80f728057 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:53.756118 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7142-a501-4d56-b538-bef80f728057 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:53.756118 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7142-a501-4d56-b538-bef80f728057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:53.773726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f58b7142-a501-4d56-b538-bef80f728057 None None] MFA Rules not processed for user `9cad08b5d46a4fce898e8978f1e84edb`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:22:53.775022 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f58b7142-a501-4d56-b538-bef80f728057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:53.832156 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1341/2676] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:22:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:22:58.832138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc064c-d0aa-402b-b3b4-25377783f70a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:22:58.833589 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5dcc064c-d0aa-402b-b3b4-25377783f70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:58.940972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc064c-d0aa-402b-b3b4-25377783f70a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:22:58.945045 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42605794-5f81-4304-889f-17b1dc0fd227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:22:58.945922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42605794-5f81-4304-889f-17b1dc0fd227 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:22:58.946743 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42605794-5f81-4304-889f-17b1dc0fd227 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:22:58.947197 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42605794-5f81-4304-889f-17b1dc0fd227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:22:58.949985 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-42605794-5f81-4304-889f-17b1dc0fd227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:22:59.060287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42605794-5f81-4304-889f-17b1dc0fd227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:22:59.061829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42605794-5f81-4304-889f-17b1dc0fd227 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:22:59.072510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1336/2677] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:00.355503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b7142-a501-4d56-b538-bef80f728057 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:00.357028 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f58b7142-a501-4d56-b538-bef80f728057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:00.393052 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:00.441353 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b7142-a501-4d56-b538-bef80f728057 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:00.446399 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f9e13-5431-403c-a60d-bc7481b9d6b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06c172bcd99f469f83728c98d061a7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:00.447098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9e13-5431-403c-a60d-bc7481b9d6b2 service placement] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:00.447371 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9e13-5431-403c-a60d-bc7481b9d6b2 service placement] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:00.447644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9e13-5431-403c-a60d-bc7481b9d6b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:00.449551 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-cc0f9e13-5431-403c-a60d-bc7481b9d6b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:00.462254 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f9e13-5431-403c-a60d-bc7481b9d6b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:00.464304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f9e13-5431-403c-a60d-bc7481b9d6b2 service placement] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:00.474688 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1342/2678] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:05.345857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42605794-5f81-4304-889f-17b1dc0fd227 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:05.347435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-42605794-5f81-4304-889f-17b1dc0fd227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:05.366002 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42605794-5f81-4304-889f-17b1dc0fd227 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:05.371257 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2029e1-a643-47e5-8a7b-dbe39b821215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:05.372176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2029e1-a643-47e5-8a7b-dbe39b821215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:05.372712 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2029e1-a643-47e5-8a7b-dbe39b821215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:05.372875 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2029e1-a643-47e5-8a7b-dbe39b821215 admin admin] PATH_INFO: `/v3/users/9a3b95b117914230819b17ecda8ffa7e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:05.374740 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2029e1-a643-47e5-8a7b-dbe39b821215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3b95b117914230819b17ecda8ffa7e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:05.376969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2029e1-a643-47e5-8a7b-dbe39b821215 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:05.449298 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7b2029e1-a643-47e5-8a7b-dbe39b821215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3b95b117914230819b17ecda8ffa7e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:05.450581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7b2029e1-a643-47e5-8a7b-dbe39b821215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3b95b117914230819b17ecda8ffa7e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:05.453758 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:05.473962 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7b2029e1-a643-47e5-8a7b-dbe39b821215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3b95b117914230819b17ecda8ffa7e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:05.493504 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7b2029e1-a643-47e5-8a7b-dbe39b821215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3b95b117914230819b17ecda8ffa7e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:05.494271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7b2029e1-a643-47e5-8a7b-dbe39b821215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3b95b117914230819b17ecda8ffa7e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:05.512324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1337/2679] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:05 2022] DELETE /identity/v3/users/9a3b95b117914230819b17ecda8ffa7e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:05.924212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f9e13-5431-403c-a60d-bc7481b9d6b2 service placement] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:05.948975 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f9e13-5431-403c-a60d-bc7481b9d6b2 service placement] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:06.073864 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:06.075534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:06.076026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:06.076322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] PATH_INFO: `/v3/projects/bdf99ca427374f0a9333141593ea33c2` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:06.078027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf99ca427374f0a9333141593ea33c2)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:06.080104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:06.150754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf99ca427374f0a9333141593ea33c2', 'request_id': 'req-05c146f1-374b-45b0-986a-88459061d9a9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.168984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf99ca427374f0a9333141593ea33c2', 'request_id': 'req-05c146f1-374b-45b0-986a-88459061d9a9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.177617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf99ca427374f0a9333141593ea33c2', 'request_id': 'req-05c146f1-374b-45b0-986a-88459061d9a9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.192441 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] The token cache is being invalidate because project bdf99ca427374f0a9333141593ea33c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:06.192828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.193816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.197538 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1343/2680] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:05 2022] DELETE /identity/v3/projects/bdf99ca427374f0a9333141593ea33c2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:06.202398 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2029e1-a643-47e5-8a7b-dbe39b821215 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:06.205004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7b2029e1-a643-47e5-8a7b-dbe39b821215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:06.220280 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2029e1-a643-47e5-8a7b-dbe39b821215 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:06.317483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d565479-4d2a-4d9a-a2e4-204403f214e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:06.319037 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d565479-4d2a-4d9a-a2e4-204403f214e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:06.319471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d565479-4d2a-4d9a-a2e4-204403f214e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:06.319896 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d565479-4d2a-4d9a-a2e4-204403f214e4 admin admin] PATH_INFO: `/v3/users/02f0813f2394461893e5d23db8d4f8ed` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:06.322173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d565479-4d2a-4d9a-a2e4-204403f214e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f0813f2394461893e5d23db8d4f8ed)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:06.325030 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d565479-4d2a-4d9a-a2e4-204403f214e4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:06.385767 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d565479-4d2a-4d9a-a2e4-204403f214e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f0813f2394461893e5d23db8d4f8ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.386464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d565479-4d2a-4d9a-a2e4-204403f214e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f0813f2394461893e5d23db8d4f8ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.400831 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d565479-4d2a-4d9a-a2e4-204403f214e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f0813f2394461893e5d23db8d4f8ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.408681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d565479-4d2a-4d9a-a2e4-204403f214e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f0813f2394461893e5d23db8d4f8ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.409462 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d565479-4d2a-4d9a-a2e4-204403f214e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f0813f2394461893e5d23db8d4f8ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.430910 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1338/2681] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:06 2022] DELETE /identity/v3/users/02f0813f2394461893e5d23db8d4f8ed => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:06.681183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:06.683878 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:06.712013 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c146f1-374b-45b0-986a-88459061d9a9 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:06.781325 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:06.799227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:06.800365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:06.800654 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:06.800934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] PATH_INFO: `/v3/projects/e4f3a770f241438b9345df304d220d0e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:06.802324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4f3a770f241438b9345df304d220d0e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:06.804323 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:06.876370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4f3a770f241438b9345df304d220d0e', 'request_id': 'req-6cf0188d-dcee-4f6e-abef-20498ceca18c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.892585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4f3a770f241438b9345df304d220d0e', 'request_id': 'req-6cf0188d-dcee-4f6e-abef-20498ceca18c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.901813 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4f3a770f241438b9345df304d220d0e', 'request_id': 'req-6cf0188d-dcee-4f6e-abef-20498ceca18c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.927073 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] The token cache is being invalidate because project e4f3a770f241438b9345df304d220d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:06.928006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.928183 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:06.930247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1344/2682] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:06 2022] DELETE /identity/v3/projects/e4f3a770f241438b9345df304d220d0e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:23:09.703791 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4759040-5b5a-4a05-b616-cbe365670c26 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:09.704405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4759040-5b5a-4a05-b616-cbe365670c26 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:09.704405 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4759040-5b5a-4a05-b616-cbe365670c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:09.725773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b4759040-5b5a-4a05-b616-cbe365670c26 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:09.727083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b4759040-5b5a-4a05-b616-cbe365670c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:09.774636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:09.800184 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1339/2683] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jul 21 12:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:23:09.823336 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:09.825409 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:09.921681 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0188d-dcee-4f6e-abef-20498ceca18c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:09.929447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1034d2f-a2f2-4f6a-8df5-ef26aaf9e14c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:09.930760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1034d2f-a2f2-4f6a-8df5-ef26aaf9e14c service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:09.932309 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1034d2f-a2f2-4f6a-8df5-ef26aaf9e14c service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:09.932786 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1034d2f-a2f2-4f6a-8df5-ef26aaf9e14c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:09.948844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1034d2f-a2f2-4f6a-8df5-ef26aaf9e14c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:09.950514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1034d2f-a2f2-4f6a-8df5-ef26aaf9e14c service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:09.967313 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1345/2684] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:10.030341 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4759040-5b5a-4a05-b616-cbe365670c26 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:10.031887 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b4759040-5b5a-4a05-b616-cbe365670c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:10.098784 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4759040-5b5a-4a05-b616-cbe365670c26 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:10.102682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25f2e1-bc1f-4cc5-8887-a6cb89b4baff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:10.103357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f2e1-bc1f-4cc5-8887-a6cb89b4baff service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:10.103646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f2e1-bc1f-4cc5-8887-a6cb89b4baff service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:10.103917 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f2e1-bc1f-4cc5-8887-a6cb89b4baff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:10.105750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3b25f2e1-bc1f-4cc5-8887-a6cb89b4baff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:10.119726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25f2e1-bc1f-4cc5-8887-a6cb89b4baff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:10.121324 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25f2e1-bc1f-4cc5-8887-a6cb89b4baff service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:10.133460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1340/2685] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:13.178696 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc15b65-a43a-43e1-a90e-1f4153129583 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:13.179634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc15b65-a43a-43e1-a90e-1f4153129583 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:13.179634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc15b65-a43a-43e1-a90e-1f4153129583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:13.202915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6fc15b65-a43a-43e1-a90e-1f4153129583 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:13.205110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6fc15b65-a43a-43e1-a90e-1f4153129583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:13.222412 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1346/2686] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jul 21 12:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:13.245361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25f2e1-bc1f-4cc5-8887-a6cb89b4baff service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:13.248487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3b25f2e1-bc1f-4cc5-8887-a6cb89b4baff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:13.266860 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25f2e1-bc1f-4cc5-8887-a6cb89b4baff service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:13.277009 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31581271-ea30-49c0-b354-0aeefd15c243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:13.278295 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31581271-ea30-49c0-b354-0aeefd15c243 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:13.278586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31581271-ea30-49c0-b354-0aeefd15c243 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:13.278909 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31581271-ea30-49c0-b354-0aeefd15c243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:13.289612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31581271-ea30-49c0-b354-0aeefd15c243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:13.292122 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31581271-ea30-49c0-b354-0aeefd15c243 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:13.306006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1341/2687] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:14.761876 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc15b65-a43a-43e1-a90e-1f4153129583 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:14.763961 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6fc15b65-a43a-43e1-a90e-1f4153129583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:14.781969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc15b65-a43a-43e1-a90e-1f4153129583 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:14.787689 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf1e69-577e-475c-9a19-0aaa00c8173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:14.788883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf1e69-577e-475c-9a19-0aaa00c8173d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:14.789252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf1e69-577e-475c-9a19-0aaa00c8173d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:14.789533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf1e69-577e-475c-9a19-0aaa00c8173d admin admin] PATH_INFO: `/v3/users/d9a96b51c98344a09cc59af05dd455ef` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:14.791319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf1e69-577e-475c-9a19-0aaa00c8173d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a96b51c98344a09cc59af05dd455ef)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:14.793662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf1e69-577e-475c-9a19-0aaa00c8173d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:14.860739 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6ccf1e69-577e-475c-9a19-0aaa00c8173d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a96b51c98344a09cc59af05dd455ef'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:14.870753 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:14.876462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6ccf1e69-577e-475c-9a19-0aaa00c8173d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a96b51c98344a09cc59af05dd455ef'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:14.877720 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6ccf1e69-577e-475c-9a19-0aaa00c8173d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a96b51c98344a09cc59af05dd455ef'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:14.897728 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6ccf1e69-577e-475c-9a19-0aaa00c8173d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a96b51c98344a09cc59af05dd455ef'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:14.898561 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6ccf1e69-577e-475c-9a19-0aaa00c8173d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a96b51c98344a09cc59af05dd455ef'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:14.924920 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1347/2688] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:14 2022] DELETE /identity/v3/users/d9a96b51c98344a09cc59af05dd455ef => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:15.264347 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31581271-ea30-49c0-b354-0aeefd15c243 service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:15.292934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31581271-ea30-49c0-b354-0aeefd15c243 service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:15.390948 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:15.392762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:15.393524 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:15.394040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2 admin admin] PATH_INFO: `/v3/projects/6f13cf466a4b40acaf0c98516c5fa5b1` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:15.396813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f13cf466a4b40acaf0c98516c5fa5b1)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:15.399206 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:15.468870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f13cf466a4b40acaf0c98516c5fa5b1', 'request_id': 'req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:15.481695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f13cf466a4b40acaf0c98516c5fa5b1', 'request_id': 'req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:15.491489 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f13cf466a4b40acaf0c98516c5fa5b1', 'request_id': 'req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:15.510012 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2 admin admin] The token cache is being invalidate because project 6f13cf466a4b40acaf0c98516c5fa5b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:15.510483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:15.511300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1d74470d-d4c5-4e8e-b76c-ca31230b8ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:15.513309 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1342/2689] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:15 2022] DELETE /identity/v3/projects/6f13cf466a4b40acaf0c98516c5fa5b1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:15.518730 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef0247-1287-4d72-9c40-e78187aae58d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:15.518934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef0247-1287-4d72-9c40-e78187aae58d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:15.519134 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef0247-1287-4d72-9c40-e78187aae58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:15.540197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d8ef0247-1287-4d72-9c40-e78187aae58d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:15.541819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d8ef0247-1287-4d72-9c40-e78187aae58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:15.613156 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1348/2690] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:15.621949 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d484-51f8-4f3a-9802-ac0fbf9caa93 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:15.621949 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d484-51f8-4f3a-9802-ac0fbf9caa93 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:15.622166 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d484-51f8-4f3a-9802-ac0fbf9caa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:15.637350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:15.645284 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-47b4d484-51f8-4f3a-9802-ac0fbf9caa93 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:15.647881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-47b4d484-51f8-4f3a-9802-ac0fbf9caa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:15.659834 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1343/2691] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:15.665084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef0247-1287-4d72-9c40-e78187aae58d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:15.679777 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef0247-1287-4d72-9c40-e78187aae58d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:15.686135 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2250991-d82a-440f-9395-1fccdf7ef98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:15.686854 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2250991-d82a-440f-9395-1fccdf7ef98a admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:15.687165 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2250991-d82a-440f-9395-1fccdf7ef98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:15.687451 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2250991-d82a-440f-9395-1fccdf7ef98a admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:15.688255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2250991-d82a-440f-9395-1fccdf7ef98a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:23:15.688604 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2250991-d82a-440f-9395-1fccdf7ef98a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:15.690265 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2250991-d82a-440f-9395-1fccdf7ef98a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:15.704420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1349/2692] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:23:15.710044 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4d484-51f8-4f3a-9802-ac0fbf9caa93 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:15.720494 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4d484-51f8-4f3a-9802-ac0fbf9caa93 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:15.726288 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c742f2-a06d-45ee-881f-821e4c0383d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:15.727025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c742f2-a06d-45ee-881f-821e4c0383d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:15.727311 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c742f2-a06d-45ee-881f-821e4c0383d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:15.727586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c742f2-a06d-45ee-881f-821e4c0383d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:15.728314 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c742f2-a06d-45ee-881f-821e4c0383d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:15.730312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c742f2-a06d-45ee-881f-821e4c0383d0 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:15.760146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1344/2693] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:23:15 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:15.765371 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2250991-d82a-440f-9395-1fccdf7ef98a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:15.784497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2250991-d82a-440f-9395-1fccdf7ef98a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:15.858131 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1eddd-6a10-436e-9174-808f8a738e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:15.859115 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1eddd-6a10-436e-9174-808f8a738e82 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:15.859534 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1eddd-6a10-436e-9174-808f8a738e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:15.859916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1eddd-6a10-436e-9174-808f8a738e82 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:15.860984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1eddd-6a10-436e-9174-808f8a738e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:15.863207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1eddd-6a10-436e-9174-808f8a738e82 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:15.889377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1350/2694] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:23:15 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:15.895736 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c742f2-a06d-45ee-881f-821e4c0383d0 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:15.914062 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c742f2-a06d-45ee-881f-821e4c0383d0 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:15.922692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6488e0-29c7-4043-8093-e64229dd67a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:15.923841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6488e0-29c7-4043-8093-e64229dd67a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:15.924361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6488e0-29c7-4043-8093-e64229dd67a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:15.924860 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6488e0-29c7-4043-8093-e64229dd67a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:15.926271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6488e0-29c7-4043-8093-e64229dd67a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:15.929485 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6488e0-29c7-4043-8093-e64229dd67a6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:15.951432 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1345/2695] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:15.956120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1eddd-6a10-436e-9174-808f8a738e82 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:15.966998 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1eddd-6a10-436e-9174-808f8a738e82 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:15.972045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75b07e-69f2-455c-bd02-0f8a3b4ed35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:15.972744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75b07e-69f2-455c-bd02-0f8a3b4ed35f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:15.973031 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75b07e-69f2-455c-bd02-0f8a3b4ed35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:15.973308 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75b07e-69f2-455c-bd02-0f8a3b4ed35f admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:15.974051 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75b07e-69f2-455c-bd02-0f8a3b4ed35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:15.975709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75b07e-69f2-455c-bd02-0f8a3b4ed35f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:15.987314 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1351/2696] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:15.993444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6488e0-29c7-4043-8093-e64229dd67a6 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:16.004566 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6488e0-29c7-4043-8093-e64229dd67a6 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:16.009408 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12852f65-8a1e-461a-8366-743d43d11dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:16.010300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12852f65-8a1e-461a-8366-743d43d11dac admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:16.010580 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12852f65-8a1e-461a-8366-743d43d11dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:16.010891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12852f65-8a1e-461a-8366-743d43d11dac admin admin] PATH_INFO: `/v3/projects/d631d4ad3a5d4f68aba327294254ca10/users/eb82e2714d864900ae82957e6270264d/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:16.029113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12852f65-8a1e-461a-8366-743d43d11dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d631d4ad3a5d4f68aba327294254ca10, user_id=eb82e2714d864900ae82957e6270264d, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:16.032005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12852f65-8a1e-461a-8366-743d43d11dac admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:16.048285 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1346/2697] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:15 2022] PUT /identity/v3/projects/d631d4ad3a5d4f68aba327294254ca10/users/eb82e2714d864900ae82957e6270264d/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:16.058772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78571caa-0c9f-438f-af17-90a3ae9a0127 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:16.059199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78571caa-0c9f-438f-af17-90a3ae9a0127 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:16.059324 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78571caa-0c9f-438f-af17-90a3ae9a0127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:16.090112 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-78571caa-0c9f-438f-af17-90a3ae9a0127 None None] MFA Rules not processed for user `eb82e2714d864900ae82957e6270264d`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:16.091400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-78571caa-0c9f-438f-af17-90a3ae9a0127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:16.118969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:16.186443 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1352/2698] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:16.193371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12852f65-8a1e-461a-8366-743d43d11dac admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:16.306792 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12852f65-8a1e-461a-8366-743d43d11dac admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:16.311879 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0fd74-e7b9-4e34-8d6d-170aaab45892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:16.312491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0fd74-e7b9-4e34-8d6d-170aaab45892 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:16.312783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0fd74-e7b9-4e34-8d6d-170aaab45892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:16.313063 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0fd74-e7b9-4e34-8d6d-170aaab45892 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:16.313780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0fd74-e7b9-4e34-8d6d-170aaab45892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:16.315814 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0fd74-e7b9-4e34-8d6d-170aaab45892 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:16.343350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1347/2699] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:23:16 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:16.347558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78571caa-0c9f-438f-af17-90a3ae9a0127 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:16.359365 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78571caa-0c9f-438f-af17-90a3ae9a0127 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:16.447633 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f16fbc-0e60-4de2-be3a-93ce4436b503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:16.448782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f16fbc-0e60-4de2-be3a-93ce4436b503 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:16.449065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f16fbc-0e60-4de2-be3a-93ce4436b503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:16.449267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee1717-7e9c-4ee8-8f0b-5b8b4966dab8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:16.449378 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f16fbc-0e60-4de2-be3a-93ce4436b503 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:16.449570 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee1717-7e9c-4ee8-8f0b-5b8b4966dab8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:16.449842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee1717-7e9c-4ee8-8f0b-5b8b4966dab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:16.450021 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f16fbc-0e60-4de2-be3a-93ce4436b503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:16.452010 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f16fbc-0e60-4de2-be3a-93ce4436b503 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:16.470556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-bfee1717-7e9c-4ee8-8f0b-5b8b4966dab8 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:16.471884 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bfee1717-7e9c-4ee8-8f0b-5b8b4966dab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:16.478686 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1353/2700] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:23:16 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:23:16.480927 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1348/2701] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jul 21 12:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:23:16.483349 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f16fbc-0e60-4de2-be3a-93ce4436b503 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:16.493737 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f16fbc-0e60-4de2-be3a-93ce4436b503 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:16.498574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c94cf-65f2-4e32-a183-19c00afdadd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:16.499284 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c94cf-65f2-4e32-a183-19c00afdadd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:16.499570 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c94cf-65f2-4e32-a183-19c00afdadd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:16.499845 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c94cf-65f2-4e32-a183-19c00afdadd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:16.500586 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c94cf-65f2-4e32-a183-19c00afdadd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:16.502260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c94cf-65f2-4e32-a183-19c00afdadd2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:16.512803 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1354/2702] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:16.518561 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee1717-7e9c-4ee8-8f0b-5b8b4966dab8 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:16.529079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee1717-7e9c-4ee8-8f0b-5b8b4966dab8 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:16.534992 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c08a4d-4022-4cf1-8a4e-27feeb99ec3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:16.536046 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08a4d-4022-4cf1-8a4e-27feeb99ec3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:16.536267 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08a4d-4022-4cf1-8a4e-27feeb99ec3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:16.536597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08a4d-4022-4cf1-8a4e-27feeb99ec3f admin admin] PATH_INFO: `/v3/projects/4324b2c0b0064cf9916c074b1a1edef4/users/0f9f06d6979245e8a7ff35a35a5b7b18/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:16.555423 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c08a4d-4022-4cf1-8a4e-27feeb99ec3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4324b2c0b0064cf9916c074b1a1edef4, user_id=0f9f06d6979245e8a7ff35a35a5b7b18, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:16.560796 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c08a4d-4022-4cf1-8a4e-27feeb99ec3f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:16.567849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c94cf-65f2-4e32-a183-19c00afdadd2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:16.569429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f10c94cf-65f2-4e32-a183-19c00afdadd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:16.584314 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1349/2703] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:16 2022] PUT /identity/v3/projects/4324b2c0b0064cf9916c074b1a1edef4/users/0f9f06d6979245e8a7ff35a35a5b7b18/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:16.596816 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c08a4d-4022-4cf1-8a4e-27feeb99ec3f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:16.690969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c94cf-65f2-4e32-a183-19c00afdadd2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:16.698923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:16.703843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c08a4d-4022-4cf1-8a4e-27feeb99ec3f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:16.710387 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde197a-17d7-4a43-9caf-7b45565381fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:16.711119 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde197a-17d7-4a43-9caf-7b45565381fa admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:16.711422 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde197a-17d7-4a43-9caf-7b45565381fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:16.711692 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde197a-17d7-4a43-9caf-7b45565381fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:16.712467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde197a-17d7-4a43-9caf-7b45565381fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:16.714075 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde197a-17d7-4a43-9caf-7b45565381fa admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:16.724952 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1350/2704] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:23:16.726286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6ed0-801b-4a21-92c6-a8ec46106b0a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:16.726591 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6ed0-801b-4a21-92c6-a8ec46106b0a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:16.726892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6ed0-801b-4a21-92c6-a8ec46106b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:16.747334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-30fa6ed0-801b-4a21-92c6-a8ec46106b0a None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:16.748808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-30fa6ed0-801b-4a21-92c6-a8ec46106b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:16.764914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:16.800408 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d4c6b-6960-4770-ad0e-2af1cd99af2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:16.801140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d4c6b-6960-4770-ad0e-2af1cd99af2e service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:16.801349 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d4c6b-6960-4770-ad0e-2af1cd99af2e service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:16.801636 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d4c6b-6960-4770-ad0e-2af1cd99af2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:16.813134 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d4c6b-6960-4770-ad0e-2af1cd99af2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:16.815111 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d4c6b-6960-4770-ad0e-2af1cd99af2e service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:16.820699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1351/2705] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:23:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:16.826371 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa6ed0-801b-4a21-92c6-a8ec46106b0a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:16.834695 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1355/2706] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:23:16.839909 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa6ed0-801b-4a21-92c6-a8ec46106b0a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:16.846041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f58fe-fd1c-4443-bbc2-8ef03c4386e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:16.847224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f58fe-fd1c-4443-bbc2-8ef03c4386e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:16.847402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f58fe-fd1c-4443-bbc2-8ef03c4386e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:16.847713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f58fe-fd1c-4443-bbc2-8ef03c4386e6 admin admin] PATH_INFO: `/v3/projects/4324b2c0b0064cf9916c074b1a1edef4/users/0f9f06d6979245e8a7ff35a35a5b7b18/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:16.848772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d4c6b-6960-4770-ad0e-2af1cd99af2e service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:16.849766 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f58fe-fd1c-4443-bbc2-8ef03c4386e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4324b2c0b0064cf9916c074b1a1edef4, user_id=0f9f06d6979245e8a7ff35a35a5b7b18, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:16.851889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-892d4c6b-6960-4770-ad0e-2af1cd99af2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:16.852680 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f58fe-fd1c-4443-bbc2-8ef03c4386e6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:16.872129 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1352/2707] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:16 2022] PUT /identity/v3/projects/4324b2c0b0064cf9916c074b1a1edef4/users/0f9f06d6979245e8a7ff35a35a5b7b18/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:16.886977 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38ef58-0580-494d-b943-f6a767f3d917 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:16.887445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38ef58-0580-494d-b943-f6a767f3d917 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:16.888102 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38ef58-0580-494d-b943-f6a767f3d917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:16.925949 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4d38ef58-0580-494d-b943-f6a767f3d917 None None] MFA Rules not processed for user `0f9f06d6979245e8a7ff35a35a5b7b18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:16.927223 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4d38ef58-0580-494d-b943-f6a767f3d917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:16.963910 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d4c6b-6960-4770-ad0e-2af1cd99af2e service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:17.019751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1353/2708] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:23:17.031684 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38ef58-0580-494d-b943-f6a767f3d917 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:17.033513 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4d38ef58-0580-494d-b943-f6a767f3d917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:17.033908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f2b70-cf4d-43d3-aafe-4af1e01c6a7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:17.034568 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2b70-cf4d-43d3-aafe-4af1e01c6a7b service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:17.034879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2b70-cf4d-43d3-aafe-4af1e01c6a7b service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:17.035151 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2b70-cf4d-43d3-aafe-4af1e01c6a7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:17.111140 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f2b70-cf4d-43d3-aafe-4af1e01c6a7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:17.111578 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38ef58-0580-494d-b943-f6a767f3d917 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:17.113055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f2b70-cf4d-43d3-aafe-4af1e01c6a7b service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:17.115618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f7011-20e4-4024-804a-18626d53a312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:17.116301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f7011-20e4-4024-804a-18626d53a312 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:17.116587 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f7011-20e4-4024-804a-18626d53a312 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:17.116876 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f7011-20e4-4024-804a-18626d53a312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:17.124968 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1356/2709] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:23:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:23:17.128726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f7011-20e4-4024-804a-18626d53a312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:17.131729 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f7011-20e4-4024-804a-18626d53a312 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:17.145494 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1354/2710] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:23:17.257159 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f2b70-cf4d-43d3-aafe-4af1e01c6a7b service swift] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:17.269771 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f2b70-cf4d-43d3-aafe-4af1e01c6a7b service swift] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:17.274747 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4172f-fc67-4c7a-a85e-5197eee82a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:17.275493 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4172f-fc67-4c7a-a85e-5197eee82a0b service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:17.275848 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4172f-fc67-4c7a-a85e-5197eee82a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:17.276198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4172f-fc67-4c7a-a85e-5197eee82a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:17.288522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:17.388889 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4172f-fc67-4c7a-a85e-5197eee82a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:17.390957 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4172f-fc67-4c7a-a85e-5197eee82a0b service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:17.403824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1357/2711] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:19.612828 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47391e-554d-4df9-a55c-fd8a08279c05 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:19.613708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47391e-554d-4df9-a55c-fd8a08279c05 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:19.613906 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47391e-554d-4df9-a55c-fd8a08279c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:19.654828 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0b47391e-554d-4df9-a55c-fd8a08279c05 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:19.659399 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0b47391e-554d-4df9-a55c-fd8a08279c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:19.679790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:19.816899 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1355/2712] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jul 21 12:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:19.847738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4172f-fc67-4c7a-a85e-5197eee82a0b service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:19.850145 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-01f4172f-fc67-4c7a-a85e-5197eee82a0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:19.990508 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4172f-fc67-4c7a-a85e-5197eee82a0b service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:19.996559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e58ee-fa32-45a1-be05-d834f5f745d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:19.997550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e58ee-fa32-45a1-be05-d834f5f745d4 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:19.998045 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e58ee-fa32-45a1-be05-d834f5f745d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:19.998284 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e58ee-fa32-45a1-be05-d834f5f745d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:20.011750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e58ee-fa32-45a1-be05-d834f5f745d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:20.014054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e58ee-fa32-45a1-be05-d834f5f745d4 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:20.031828 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1358/2713] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:20.803109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47391e-554d-4df9-a55c-fd8a08279c05 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:20.822412 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47391e-554d-4df9-a55c-fd8a08279c05 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:20.829289 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a4711-950d-4de5-bf34-8f1e35568b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:20.830436 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a4711-950d-4de5-bf34-8f1e35568b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:20.830865 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a4711-950d-4de5-bf34-8f1e35568b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:20.831127 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a4711-950d-4de5-bf34-8f1e35568b16 admin admin] PATH_INFO: `/v3/users/eb82e2714d864900ae82957e6270264d` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:20.832933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a4711-950d-4de5-bf34-8f1e35568b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb82e2714d864900ae82957e6270264d)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:20.835346 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a4711-950d-4de5-bf34-8f1e35568b16 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:20.926919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-018a4711-950d-4de5-bf34-8f1e35568b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb82e2714d864900ae82957e6270264d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:20.928138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-018a4711-950d-4de5-bf34-8f1e35568b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb82e2714d864900ae82957e6270264d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:20.956880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-018a4711-950d-4de5-bf34-8f1e35568b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb82e2714d864900ae82957e6270264d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:20.969731 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-018a4711-950d-4de5-bf34-8f1e35568b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb82e2714d864900ae82957e6270264d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:20.971029 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-018a4711-950d-4de5-bf34-8f1e35568b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb82e2714d864900ae82957e6270264d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:21.010681 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1356/2714] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:20 2022] DELETE /identity/v3/users/eb82e2714d864900ae82957e6270264d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:21.019440 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c5461-dbe5-486b-8df0-d9fc91eb4f5b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:21.020285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c5461-dbe5-486b-8df0-d9fc91eb4f5b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:21.020285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c5461-dbe5-486b-8df0-d9fc91eb4f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:21.056090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2e9c5461-dbe5-486b-8df0-d9fc91eb4f5b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:21.058076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2e9c5461-dbe5-486b-8df0-d9fc91eb4f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:21.182779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1359/2715] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:21.199556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a4711-950d-4de5-bf34-8f1e35568b16 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:21.202551 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-018a4711-950d-4de5-bf34-8f1e35568b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:21.304334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a4711-950d-4de5-bf34-8f1e35568b16 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:21.309259 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab65bc-4ff1-44e6-baaf-abf12ea5ea1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:21.310143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab65bc-4ff1-44e6-baaf-abf12ea5ea1b service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:21.310420 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab65bc-4ff1-44e6-baaf-abf12ea5ea1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:21.310762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab65bc-4ff1-44e6-baaf-abf12ea5ea1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:21.323076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab65bc-4ff1-44e6-baaf-abf12ea5ea1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:21.325913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab65bc-4ff1-44e6-baaf-abf12ea5ea1b service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:21.338744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1357/2716] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:23:21.838399 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c5461-dbe5-486b-8df0-d9fc91eb4f5b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:21.841769 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2e9c5461-dbe5-486b-8df0-d9fc91eb4f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:21.875916 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c5461-dbe5-486b-8df0-d9fc91eb4f5b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:21.894639 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:21.896501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:21.897002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:21.897488 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] PATH_INFO: `/v3/projects/d631d4ad3a5d4f68aba327294254ca10` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:21.900980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d631d4ad3a5d4f68aba327294254ca10)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:21.905074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:21.987289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:22.019746 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd631d4ad3a5d4f68aba327294254ca10', 'request_id': 'req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:22.034255 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd631d4ad3a5d4f68aba327294254ca10', 'request_id': 'req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:22.048714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd631d4ad3a5d4f68aba327294254ca10', 'request_id': 'req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:22.067961 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] The token cache is being invalidate because project d631d4ad3a5d4f68aba327294254ca10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:22.068413 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:22.069674 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:22.072374 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1360/2717] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:21 2022] DELETE /identity/v3/projects/d631d4ad3a5d4f68aba327294254ca10 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:22.078247 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab65bc-4ff1-44e6-baaf-abf12ea5ea1b service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:22.096780 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab65bc-4ff1-44e6-baaf-abf12ea5ea1b service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:22.150708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:22.225230 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271030db-aab0-47ed-b46a-268f10e95c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:22.227618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271030db-aab0-47ed-b46a-268f10e95c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:22.228138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271030db-aab0-47ed-b46a-268f10e95c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:22.228966 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271030db-aab0-47ed-b46a-268f10e95c07 admin admin] PATH_INFO: `/v3/users/0f9f06d6979245e8a7ff35a35a5b7b18` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:22.232158 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271030db-aab0-47ed-b46a-268f10e95c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9f06d6979245e8a7ff35a35a5b7b18)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:22.236256 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271030db-aab0-47ed-b46a-268f10e95c07 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:22.335515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-271030db-aab0-47ed-b46a-268f10e95c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9f06d6979245e8a7ff35a35a5b7b18'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:22.337936 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-271030db-aab0-47ed-b46a-268f10e95c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9f06d6979245e8a7ff35a35a5b7b18'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:22.364554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-271030db-aab0-47ed-b46a-268f10e95c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9f06d6979245e8a7ff35a35a5b7b18'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:22.382603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-271030db-aab0-47ed-b46a-268f10e95c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9f06d6979245e8a7ff35a35a5b7b18'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:22.384730 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-271030db-aab0-47ed-b46a-268f10e95c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9f06d6979245e8a7ff35a35a5b7b18'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:22.415384 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1358/2718] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:22 2022] DELETE /identity/v3/users/0f9f06d6979245e8a7ff35a35a5b7b18 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:22.924713 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:22.927090 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:22.939754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a7db7-e35d-471f-95c8-5fab08e6e2d1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:22.940139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a7db7-e35d-471f-95c8-5fab08e6e2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:22.940403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a7db7-e35d-471f-95c8-5fab08e6e2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:22.978053 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a6c3a-7e45-4485-88b9-acb26f35a7f1 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:22.978619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-060a7db7-e35d-471f-95c8-5fab08e6e2d1 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:22.980070 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-060a7db7-e35d-471f-95c8-5fab08e6e2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:23.079659 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1359/2719] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jul 21 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:23.107535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a7db7-e35d-471f-95c8-5fab08e6e2d1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:23.109687 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-060a7db7-e35d-471f-95c8-5fab08e6e2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:23.120961 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42838244-5bb0-4c37-821e-74e32ccb792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:23.121891 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42838244-5bb0-4c37-821e-74e32ccb792f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:23.122173 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42838244-5bb0-4c37-821e-74e32ccb792f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:23.122616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42838244-5bb0-4c37-821e-74e32ccb792f admin admin] PATH_INFO: `/v3/projects/4324b2c0b0064cf9916c074b1a1edef4` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:23.125212 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42838244-5bb0-4c37-821e-74e32ccb792f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4324b2c0b0064cf9916c074b1a1edef4)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:23.131620 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42838244-5bb0-4c37-821e-74e32ccb792f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:23.226503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:23.240057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-42838244-5bb0-4c37-821e-74e32ccb792f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4324b2c0b0064cf9916c074b1a1edef4', 'request_id': 'req-42838244-5bb0-4c37-821e-74e32ccb792f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:23.285785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a7db7-e35d-471f-95c8-5fab08e6e2d1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:23.287132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-42838244-5bb0-4c37-821e-74e32ccb792f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4324b2c0b0064cf9916c074b1a1edef4', 'request_id': 'req-42838244-5bb0-4c37-821e-74e32ccb792f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:23.296929 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-42838244-5bb0-4c37-821e-74e32ccb792f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4324b2c0b0064cf9916c074b1a1edef4', 'request_id': 'req-42838244-5bb0-4c37-821e-74e32ccb792f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:23.311456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-42838244-5bb0-4c37-821e-74e32ccb792f admin admin] The token cache is being invalidate because project 4324b2c0b0064cf9916c074b1a1edef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:23.311456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-42838244-5bb0-4c37-821e-74e32ccb792f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:23.312792 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-42838244-5bb0-4c37-821e-74e32ccb792f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:23.314630 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1361/2720] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:22 2022] DELETE /identity/v3/projects/4324b2c0b0064cf9916c074b1a1edef4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:23:23.322944 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f5dc5-dc26-41b4-9098-487e63c4707f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:23.331034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f5dc5-dc26-41b4-9098-487e63c4707f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:23.331584 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f5dc5-dc26-41b4-9098-487e63c4707f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:23.363936 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ac9f5dc5-dc26-41b4-9098-487e63c4707f None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:23.365574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ac9f5dc5-dc26-41b4-9098-487e63c4707f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:23.442512 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:23.486869 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c870e05-5f90-4f7d-9a15-94fd0cb001ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3fb1d091b27472081549f4166ca172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:23.487442 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c870e05-5f90-4f7d-9a15-94fd0cb001ad service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:23.487930 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c870e05-5f90-4f7d-9a15-94fd0cb001ad service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:23.488400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c870e05-5f90-4f7d-9a15-94fd0cb001ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:23.498275 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3c870e05-5f90-4f7d-9a15-94fd0cb001ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:23.502002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1362/2721] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:23:23.504360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff7aa7-c624-47a9-9a49-b9de0080a1b3 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:23.504809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff7aa7-c624-47a9-9a49-b9de0080a1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:23.505240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff7aa7-c624-47a9-9a49-b9de0080a1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:23.536863 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c870e05-5f90-4f7d-9a15-94fd0cb001ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:23.538457 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-97ff7aa7-c624-47a9-9a49-b9de0080a1b3 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:23.540169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c870e05-5f90-4f7d-9a15-94fd0cb001ad service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:23.540852 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-97ff7aa7-c624-47a9-9a49-b9de0080a1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:23.551798 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1363/2722] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:23.558066 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff7aa7-c624-47a9-9a49-b9de0080a1b3 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:23.562938 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1360/2723] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:23.569450 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff7aa7-c624-47a9-9a49-b9de0080a1b3 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:23.575775 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a031ffb-ca89-4e1f-963c-163fc4d8874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:23.576198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a031ffb-ca89-4e1f-963c-163fc4d8874a admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:23.576491 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a031ffb-ca89-4e1f-963c-163fc4d8874a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:23.576764 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a031ffb-ca89-4e1f-963c-163fc4d8874a admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:23.578579 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a031ffb-ca89-4e1f-963c-163fc4d8874a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:23:23.578579 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a031ffb-ca89-4e1f-963c-163fc4d8874a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:23.579668 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a031ffb-ca89-4e1f-963c-163fc4d8874a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:23.595587 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1364/2724] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:23:23.603700 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c870e05-5f90-4f7d-9a15-94fd0cb001ad service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:23.624697 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c870e05-5f90-4f7d-9a15-94fd0cb001ad service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:23.634241 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4caf8-7f77-47c9-85b2-b0e29a53bf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:23.635527 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4caf8-7f77-47c9-85b2-b0e29a53bf85 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:23.636040 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4caf8-7f77-47c9-85b2-b0e29a53bf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:23.636539 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4caf8-7f77-47c9-85b2-b0e29a53bf85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:23.638005 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4caf8-7f77-47c9-85b2-b0e29a53bf85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:23.644583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4caf8-7f77-47c9-85b2-b0e29a53bf85 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:23.691722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1361/2725] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:23:23 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:23.694080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a031ffb-ca89-4e1f-963c-163fc4d8874a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:23.708337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a031ffb-ca89-4e1f-963c-163fc4d8874a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:23.814195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344c0a7-0465-4da3-a0a0-f89ea59f847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:23.816672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344c0a7-0465-4da3-a0a0-f89ea59f847c admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:23.817578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344c0a7-0465-4da3-a0a0-f89ea59f847c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:23.818390 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344c0a7-0465-4da3-a0a0-f89ea59f847c admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:23.820988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344c0a7-0465-4da3-a0a0-f89ea59f847c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:23.827210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344c0a7-0465-4da3-a0a0-f89ea59f847c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:23.864550 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1365/2726] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:23:23 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:23.869443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4caf8-7f77-47c9-85b2-b0e29a53bf85 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:23.885505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4caf8-7f77-47c9-85b2-b0e29a53bf85 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:23.892786 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa80455-1b65-4ee9-9c22-9262a12c3637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:23.893991 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa80455-1b65-4ee9-9c22-9262a12c3637 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:23.894503 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa80455-1b65-4ee9-9c22-9262a12c3637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:23.895138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa80455-1b65-4ee9-9c22-9262a12c3637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:23.896565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa80455-1b65-4ee9-9c22-9262a12c3637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:23.904361 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa80455-1b65-4ee9-9c22-9262a12c3637 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:23.934774 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1362/2727] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:23:23.941191 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344c0a7-0465-4da3-a0a0-f89ea59f847c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:23.960752 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344c0a7-0465-4da3-a0a0-f89ea59f847c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:23.974113 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56f98f-ff23-4e2b-8ed3-8cd1ca0d6b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:23.975540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56f98f-ff23-4e2b-8ed3-8cd1ca0d6b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:23.976192 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56f98f-ff23-4e2b-8ed3-8cd1ca0d6b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:23.976510 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56f98f-ff23-4e2b-8ed3-8cd1ca0d6b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:23.977971 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56f98f-ff23-4e2b-8ed3-8cd1ca0d6b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:23.981429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56f98f-ff23-4e2b-8ed3-8cd1ca0d6b27 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:24.013729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1366/2728] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:23:24.016222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa80455-1b65-4ee9-9c22-9262a12c3637 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:24.030554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa80455-1b65-4ee9-9c22-9262a12c3637 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:24.036228 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8caf-0864-4bd1-8cc9-47d4475e4eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:24.037159 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8caf-0864-4bd1-8cc9-47d4475e4eef admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:24.037438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8caf-0864-4bd1-8cc9-47d4475e4eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:24.037711 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8caf-0864-4bd1-8cc9-47d4475e4eef admin admin] PATH_INFO: `/v3/projects/2d604f994cba43f6bc70a7815fbf6f89/users/40b7c98fb647415b816954d696418c60/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:24.061460 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf8caf-0864-4bd1-8cc9-47d4475e4eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d604f994cba43f6bc70a7815fbf6f89, user_id=40b7c98fb647415b816954d696418c60, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:24.065550 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf8caf-0864-4bd1-8cc9-47d4475e4eef admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:24.098695 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1363/2729] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:24 2022] PUT /identity/v3/projects/2d604f994cba43f6bc70a7815fbf6f89/users/40b7c98fb647415b816954d696418c60/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:24.106723 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf925ae-2de7-4fbe-a839-d56f8cadcec5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:24.107392 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf925ae-2de7-4fbe-a839-d56f8cadcec5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:24.108232 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf925ae-2de7-4fbe-a839-d56f8cadcec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:24.175702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-fbf925ae-2de7-4fbe-a839-d56f8cadcec5 None None] MFA Rules not processed for user `40b7c98fb647415b816954d696418c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:24.177051 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-fbf925ae-2de7-4fbe-a839-d56f8cadcec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:24.298420 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1367/2730] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:24.304353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8caf-0864-4bd1-8cc9-47d4475e4eef admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:24.424952 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8caf-0864-4bd1-8cc9-47d4475e4eef admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:24.432813 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df4cd-1c3b-435b-97f7-453a2814cbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:24.433880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df4cd-1c3b-435b-97f7-453a2814cbaf admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:24.434395 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df4cd-1c3b-435b-97f7-453a2814cbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:24.434922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df4cd-1c3b-435b-97f7-453a2814cbaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:24.436012 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df4cd-1c3b-435b-97f7-453a2814cbaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:24.439199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df4cd-1c3b-435b-97f7-453a2814cbaf admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:24.503798 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:24.516170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1364/2731] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:23:24 2022] POST /identity/v3/projects => generated 369 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:24.521832 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf925ae-2de7-4fbe-a839-d56f8cadcec5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:24.539360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf925ae-2de7-4fbe-a839-d56f8cadcec5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:24.601726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:24.643716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cb3b5-f58c-4fb7-a96b-6a5773508c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:24.644986 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cb3b5-f58c-4fb7-a96b-6a5773508c69 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:24.645439 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cb3b5-f58c-4fb7-a96b-6a5773508c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:24.645949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cb3b5-f58c-4fb7-a96b-6a5773508c69 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:24.647176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cb3b5-f58c-4fb7-a96b-6a5773508c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:24.649303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cb3b5-f58c-4fb7-a96b-6a5773508c69 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:24.691153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1368/2732] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:23:24 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:24.696939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df4cd-1c3b-435b-97f7-453a2814cbaf admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:24.715841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df4cd-1c3b-435b-97f7-453a2814cbaf admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:24.725032 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6098100-2dcc-490c-8c77-36a13f81fe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:24.726688 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6098100-2dcc-490c-8c77-36a13f81fe21 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:24.727338 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6098100-2dcc-490c-8c77-36a13f81fe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:24.727829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6098100-2dcc-490c-8c77-36a13f81fe21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:24.729827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6098100-2dcc-490c-8c77-36a13f81fe21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:24.733934 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6098100-2dcc-490c-8c77-36a13f81fe21 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:24.750426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1365/2733] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:24.758900 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cb3b5-f58c-4fb7-a96b-6a5773508c69 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:24.773765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cb3b5-f58c-4fb7-a96b-6a5773508c69 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:24.781307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee097-bd30-4edd-94db-2d94e8fdf1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:24.783078 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee097-bd30-4edd-94db-2d94e8fdf1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:24.783714 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee097-bd30-4edd-94db-2d94e8fdf1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:24.784001 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee097-bd30-4edd-94db-2d94e8fdf1e9 admin admin] PATH_INFO: `/v3/projects/cf37ac84ab384274a22e4cf742ef48ec/users/8653b9228cd64bb4b4e40f31af1322e1/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:24.822536 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ee097-bd30-4edd-94db-2d94e8fdf1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf37ac84ab384274a22e4cf742ef48ec, user_id=8653b9228cd64bb4b4e40f31af1322e1, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:24.829145 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ee097-bd30-4edd-94db-2d94e8fdf1e9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:24.851260 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1369/2734] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:24 2022] PUT /identity/v3/projects/cf37ac84ab384274a22e4cf742ef48ec/users/8653b9228cd64bb4b4e40f31af1322e1/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:24.857351 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6098100-2dcc-490c-8c77-36a13f81fe21 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:24.879201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6098100-2dcc-490c-8c77-36a13f81fe21 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:25.048190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0fd2d-c9c1-41ab-80d5-74d1ab033c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:25.048988 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0fd2d-c9c1-41ab-80d5-74d1ab033c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:25.049454 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0fd2d-c9c1-41ab-80d5-74d1ab033c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:25.049881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0fd2d-c9c1-41ab-80d5-74d1ab033c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:25.051093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0fd2d-c9c1-41ab-80d5-74d1ab033c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:25.053239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0fd2d-c9c1-41ab-80d5-74d1ab033c0e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:25.073673 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1366/2735] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:25.075797 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee097-bd30-4edd-94db-2d94e8fdf1e9 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:25.116341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee097-bd30-4edd-94db-2d94e8fdf1e9 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:25.124840 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd32e7-43e7-43e1-87e9-fe3d32694d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:25.127094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd32e7-43e7-43e1-87e9-fe3d32694d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:25.127935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd32e7-43e7-43e1-87e9-fe3d32694d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:25.128718 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd32e7-43e7-43e1-87e9-fe3d32694d85 admin admin] PATH_INFO: `/v3/projects/cf37ac84ab384274a22e4cf742ef48ec/users/8653b9228cd64bb4b4e40f31af1322e1/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:25.133549 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd32e7-43e7-43e1-87e9-fe3d32694d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf37ac84ab384274a22e4cf742ef48ec, user_id=8653b9228cd64bb4b4e40f31af1322e1, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:25.140456 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd32e7-43e7-43e1-87e9-fe3d32694d85 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:25.163181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1370/2736] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:25 2022] PUT /identity/v3/projects/cf37ac84ab384274a22e4cf742ef48ec/users/8653b9228cd64bb4b4e40f31af1322e1/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:25.191076 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dba7f4-8c66-48ae-8cce-ecf9073db382 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:25.191886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dba7f4-8c66-48ae-8cce-ecf9073db382 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:25.191886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dba7f4-8c66-48ae-8cce-ecf9073db382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:25.239754 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-95dba7f4-8c66-48ae-8cce-ecf9073db382 None None] MFA Rules not processed for user `8653b9228cd64bb4b4e40f31af1322e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:25.241012 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-95dba7f4-8c66-48ae-8cce-ecf9073db382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:25.342213 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1367/2737] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:25.352190 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd32e7-43e7-43e1-87e9-fe3d32694d85 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:25.354081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f7cd32e7-43e7-43e1-87e9-fe3d32694d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:25.434884 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd32e7-43e7-43e1-87e9-fe3d32694d85 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:25.439799 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090c8ec-15a8-494e-bba5-99163bda1f9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:25.440476 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090c8ec-15a8-494e-bba5-99163bda1f9b service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:25.440758 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090c8ec-15a8-494e-bba5-99163bda1f9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:25.441195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090c8ec-15a8-494e-bba5-99163bda1f9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:25.453121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090c8ec-15a8-494e-bba5-99163bda1f9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:25.454773 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090c8ec-15a8-494e-bba5-99163bda1f9b service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:25.474751 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1371/2738] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:25 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:25.529701 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dba7f4-8c66-48ae-8cce-ecf9073db382 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:25.531724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-95dba7f4-8c66-48ae-8cce-ecf9073db382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:25.548829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dba7f4-8c66-48ae-8cce-ecf9073db382 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:25.554416 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc74517-e262-4621-97f7-d7724aa949be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:25.555365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74517-e262-4621-97f7-d7724aa949be service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:25.555644 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74517-e262-4621-97f7-d7724aa949be service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:25.556027 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74517-e262-4621-97f7-d7724aa949be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:25.635573 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc74517-e262-4621-97f7-d7724aa949be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:25.637518 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc74517-e262-4621-97f7-d7724aa949be service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:25.648252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1368/2739] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:30.160229 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090c8ec-15a8-494e-bba5-99163bda1f9b service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:30.331503 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:30.342578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090c8ec-15a8-494e-bba5-99163bda1f9b service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:30.349519 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf215ee-8d6b-4e64-8277-41368f2bbb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:30.350558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf215ee-8d6b-4e64-8277-41368f2bbb48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:30.351153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf215ee-8d6b-4e64-8277-41368f2bbb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:30.351364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf215ee-8d6b-4e64-8277-41368f2bbb48 admin admin] PATH_INFO: `/v3/users/40b7c98fb647415b816954d696418c60` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:30.352735 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf215ee-8d6b-4e64-8277-41368f2bbb48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b7c98fb647415b816954d696418c60)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:30.354736 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf215ee-8d6b-4e64-8277-41368f2bbb48 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:30.445032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-caf215ee-8d6b-4e64-8277-41368f2bbb48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b7c98fb647415b816954d696418c60'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:30.461798 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-caf215ee-8d6b-4e64-8277-41368f2bbb48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b7c98fb647415b816954d696418c60'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:30.462863 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-caf215ee-8d6b-4e64-8277-41368f2bbb48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b7c98fb647415b816954d696418c60'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:30.486055 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-caf215ee-8d6b-4e64-8277-41368f2bbb48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b7c98fb647415b816954d696418c60'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:30.489025 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-caf215ee-8d6b-4e64-8277-41368f2bbb48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b7c98fb647415b816954d696418c60'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:30.522240 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1372/2740] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:30 2022] DELETE /identity/v3/users/40b7c98fb647415b816954d696418c60 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:30.528674 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101148-4edb-4966-a928-4fe6dc14379a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:30.529272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101148-4edb-4966-a928-4fe6dc14379a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:30.529524 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101148-4edb-4966-a928-4fe6dc14379a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:30.548026 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:30.622246 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d6101148-4edb-4966-a928-4fe6dc14379a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:30.623722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d6101148-4edb-4966-a928-4fe6dc14379a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:30.716750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1369/2741] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:30.732171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf215ee-8d6b-4e64-8277-41368f2bbb48 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:30.734226 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-caf215ee-8d6b-4e64-8277-41368f2bbb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:30.865433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf215ee-8d6b-4e64-8277-41368f2bbb48 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:30.883992 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea98113-efc3-4514-95c2-e0d860dd55cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:30.885162 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea98113-efc3-4514-95c2-e0d860dd55cb service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:30.885663 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea98113-efc3-4514-95c2-e0d860dd55cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:30.886166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea98113-efc3-4514-95c2-e0d860dd55cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:30.905519 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea98113-efc3-4514-95c2-e0d860dd55cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:30.908563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea98113-efc3-4514-95c2-e0d860dd55cb service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:30.927005 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1373/2742] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:23:31.525972 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6101148-4edb-4966-a928-4fe6dc14379a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:31.528142 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d6101148-4edb-4966-a928-4fe6dc14379a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:31.552304 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6101148-4edb-4966-a928-4fe6dc14379a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:31.559498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:31.560566 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:31.560948 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:31.561351 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] PATH_INFO: `/v3/projects/2d604f994cba43f6bc70a7815fbf6f89` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:31.562853 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d604f994cba43f6bc70a7815fbf6f89)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:31.574731 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:31.676348 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d604f994cba43f6bc70a7815fbf6f89', 'request_id': 'req-a43e833f-5431-497b-b3a9-0ee8475cc52c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:31.691077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d604f994cba43f6bc70a7815fbf6f89', 'request_id': 'req-a43e833f-5431-497b-b3a9-0ee8475cc52c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:31.707295 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d604f994cba43f6bc70a7815fbf6f89', 'request_id': 'req-a43e833f-5431-497b-b3a9-0ee8475cc52c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:31.730645 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] The token cache is being invalidate because project 2d604f994cba43f6bc70a7815fbf6f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:31.731134 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:31.731932 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:31.741297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1370/2743] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:31 2022] DELETE /identity/v3/projects/2d604f994cba43f6bc70a7815fbf6f89 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:31.742644 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea98113-efc3-4514-95c2-e0d860dd55cb service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:31.756855 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea98113-efc3-4514-95c2-e0d860dd55cb service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:31.841605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:31.851061 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ec3d9-021f-4cb5-a143-7ae8db5eda91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:31.851767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ec3d9-021f-4cb5-a143-7ae8db5eda91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:31.855496 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ec3d9-021f-4cb5-a143-7ae8db5eda91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:31.858933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ec3d9-021f-4cb5-a143-7ae8db5eda91 admin admin] PATH_INFO: `/v3/users/8653b9228cd64bb4b4e40f31af1322e1` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:31.867783 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ec3d9-021f-4cb5-a143-7ae8db5eda91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8653b9228cd64bb4b4e40f31af1322e1)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:31.879282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ec3d9-021f-4cb5-a143-7ae8db5eda91 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:31.974291 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a60ec3d9-021f-4cb5-a143-7ae8db5eda91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8653b9228cd64bb4b4e40f31af1322e1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:31.984760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a60ec3d9-021f-4cb5-a143-7ae8db5eda91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8653b9228cd64bb4b4e40f31af1322e1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:31.985954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a60ec3d9-021f-4cb5-a143-7ae8db5eda91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8653b9228cd64bb4b4e40f31af1322e1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:32.008060 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a60ec3d9-021f-4cb5-a143-7ae8db5eda91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8653b9228cd64bb4b4e40f31af1322e1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:32.009313 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a60ec3d9-021f-4cb5-a143-7ae8db5eda91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8653b9228cd64bb4b4e40f31af1322e1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:32.030793 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1374/2744] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:31 2022] DELETE /identity/v3/users/8653b9228cd64bb4b4e40f31af1322e1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:23:32.809824 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:32.814470 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:32.834873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e833f-5431-497b-b3a9-0ee8475cc52c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:33.000357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e032014-7ba3-4f0e-810e-4a2adbc3de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:33.002100 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e032014-7ba3-4f0e-810e-4a2adbc3de03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:33.002826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e032014-7ba3-4f0e-810e-4a2adbc3de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:33.003313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e032014-7ba3-4f0e-810e-4a2adbc3de03 admin admin] PATH_INFO: `/v3/projects/cf37ac84ab384274a22e4cf742ef48ec` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:33.006502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e032014-7ba3-4f0e-810e-4a2adbc3de03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf37ac84ab384274a22e4cf742ef48ec)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:33.010305 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e032014-7ba3-4f0e-810e-4a2adbc3de03 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:33.031642 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:33.153531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8e032014-7ba3-4f0e-810e-4a2adbc3de03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf37ac84ab384274a22e4cf742ef48ec', 'request_id': 'req-8e032014-7ba3-4f0e-810e-4a2adbc3de03'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:33.167233 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8e032014-7ba3-4f0e-810e-4a2adbc3de03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf37ac84ab384274a22e4cf742ef48ec', 'request_id': 'req-8e032014-7ba3-4f0e-810e-4a2adbc3de03'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:33.176909 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8e032014-7ba3-4f0e-810e-4a2adbc3de03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf37ac84ab384274a22e4cf742ef48ec', 'request_id': 'req-8e032014-7ba3-4f0e-810e-4a2adbc3de03'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:33.193964 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8e032014-7ba3-4f0e-810e-4a2adbc3de03 admin admin] The token cache is being invalidate because project cf37ac84ab384274a22e4cf742ef48ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:33.194751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8e032014-7ba3-4f0e-810e-4a2adbc3de03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:33.196353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8e032014-7ba3-4f0e-810e-4a2adbc3de03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:33.199207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1371/2745] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:32 2022] DELETE /identity/v3/projects/cf37ac84ab384274a22e4cf742ef48ec => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:33.206229 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde021a-bbe6-49f1-ab34-f2957b490d01 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:33.207229 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde021a-bbe6-49f1-ab34-f2957b490d01 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:33.207229 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde021a-bbe6-49f1-ab34-f2957b490d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:33.334332 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ccde021a-bbe6-49f1-ab34-f2957b490d01 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:33.336662 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ccde021a-bbe6-49f1-ab34-f2957b490d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:33.581207 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1375/2746] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:23:33.596838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738f33-7c74-47fa-b42f-97ec15cf4776 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:33.597188 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738f33-7c74-47fa-b42f-97ec15cf4776 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:33.597612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738f33-7c74-47fa-b42f-97ec15cf4776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:33.648351 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c0738f33-7c74-47fa-b42f-97ec15cf4776 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:33.650022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c0738f33-7c74-47fa-b42f-97ec15cf4776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:33.673337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde021a-bbe6-49f1-ab34-f2957b490d01 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:33.682148 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1372/2747] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:33.696084 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde021a-bbe6-49f1-ab34-f2957b490d01 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:33.704097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c67f2-3dc7-405c-a4a6-0ada357bfa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:33.706026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c67f2-3dc7-405c-a4a6-0ada357bfa4a admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:33.706418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c67f2-3dc7-405c-a4a6-0ada357bfa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:33.707241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c67f2-3dc7-405c-a4a6-0ada357bfa4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:33.710295 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c67f2-3dc7-405c-a4a6-0ada357bfa4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:23:33.710842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c67f2-3dc7-405c-a4a6-0ada357bfa4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:33.713653 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c67f2-3dc7-405c-a4a6-0ada357bfa4a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:33.745215 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1376/2748] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:23:33.748385 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0738f33-7c74-47fa-b42f-97ec15cf4776 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:33.764228 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0738f33-7c74-47fa-b42f-97ec15cf4776 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:33.772312 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f313c-11f5-4d62-be75-b40a75835252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:33.773435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f313c-11f5-4d62-be75-b40a75835252 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:33.773901 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f313c-11f5-4d62-be75-b40a75835252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:33.774345 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f313c-11f5-4d62-be75-b40a75835252 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:33.775611 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f313c-11f5-4d62-be75-b40a75835252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:33.779777 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f313c-11f5-4d62-be75-b40a75835252 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:33.848059 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1373/2749] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:23:33 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:33.849956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c67f2-3dc7-405c-a4a6-0ada357bfa4a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:33.864294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c67f2-3dc7-405c-a4a6-0ada357bfa4a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:33.941448 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:33.971807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd8d61-7a45-4ca3-8abe-c670abbc7b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:33.972998 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8d61-7a45-4ca3-8abe-c670abbc7b3c admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:33.973327 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8d61-7a45-4ca3-8abe-c670abbc7b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:33.973977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8d61-7a45-4ca3-8abe-c670abbc7b3c admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:33.975453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd8d61-7a45-4ca3-8abe-c670abbc7b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:33.978748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd8d61-7a45-4ca3-8abe-c670abbc7b3c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:34.020299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f313c-11f5-4d62-be75-b40a75835252 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:34.022125 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1377/2750] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:23:33 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:23:34.039219 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f313c-11f5-4d62-be75-b40a75835252 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:34.047059 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5121f-2b69-41d9-a6dd-42aff899fcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:34.048172 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5121f-2b69-41d9-a6dd-42aff899fcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:34.048641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5121f-2b69-41d9-a6dd-42aff899fcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:34.049137 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5121f-2b69-41d9-a6dd-42aff899fcb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:34.050852 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5121f-2b69-41d9-a6dd-42aff899fcb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:34.053785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5121f-2b69-41d9-a6dd-42aff899fcb5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:34.076222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1374/2751] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:34.082093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd8d61-7a45-4ca3-8abe-c670abbc7b3c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:34.108083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd8d61-7a45-4ca3-8abe-c670abbc7b3c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:34.118221 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a9ef2-3dbb-4ef5-a617-92e09561527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:34.119511 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a9ef2-3dbb-4ef5-a617-92e09561527a admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:34.119996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a9ef2-3dbb-4ef5-a617-92e09561527a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:34.120762 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a9ef2-3dbb-4ef5-a617-92e09561527a admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:34.122167 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a9ef2-3dbb-4ef5-a617-92e09561527a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:34.125289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a9ef2-3dbb-4ef5-a617-92e09561527a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:34.148281 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1378/2752] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:34.154646 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5121f-2b69-41d9-a6dd-42aff899fcb5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:34.171669 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5121f-2b69-41d9-a6dd-42aff899fcb5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:34.182893 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ceaee-6f33-4776-9ea2-4844e1e2a70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:34.184830 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ceaee-6f33-4776-9ea2-4844e1e2a70b admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:34.184830 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ceaee-6f33-4776-9ea2-4844e1e2a70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:34.185059 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ceaee-6f33-4776-9ea2-4844e1e2a70b admin admin] PATH_INFO: `/v3/projects/70a42313a94e4cf68e296f74dce2f5ad/users/a2a9e2557bf54c93ba4a65c2b3efded2/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:34.215592 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ceaee-6f33-4776-9ea2-4844e1e2a70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a42313a94e4cf68e296f74dce2f5ad, user_id=a2a9e2557bf54c93ba4a65c2b3efded2, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:34.219705 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ceaee-6f33-4776-9ea2-4844e1e2a70b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:34.241297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1375/2753] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:34 2022] PUT /identity/v3/projects/70a42313a94e4cf68e296f74dce2f5ad/users/a2a9e2557bf54c93ba4a65c2b3efded2/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:23:34.263599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1e952-0219-42a7-86c9-c0d4dd0a54b8 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:34.264217 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1e952-0219-42a7-86c9-c0d4dd0a54b8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:34.264303 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1e952-0219-42a7-86c9-c0d4dd0a54b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:34.307094 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-38a1e952-0219-42a7-86c9-c0d4dd0a54b8 None None] MFA Rules not processed for user `a2a9e2557bf54c93ba4a65c2b3efded2`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:34.316283 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-38a1e952-0219-42a7-86c9-c0d4dd0a54b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:34.426796 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1379/2754] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:34.433189 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ceaee-6f33-4776-9ea2-4844e1e2a70b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:34.521857 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ceaee-6f33-4776-9ea2-4844e1e2a70b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:34.528744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e54fd-8214-436f-afbb-cc4da6f65df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:34.529446 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e54fd-8214-436f-afbb-cc4da6f65df2 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:34.529731 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e54fd-8214-436f-afbb-cc4da6f65df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:34.530012 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e54fd-8214-436f-afbb-cc4da6f65df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:34.530781 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e54fd-8214-436f-afbb-cc4da6f65df2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:34.532886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e54fd-8214-436f-afbb-cc4da6f65df2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:34.565586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1376/2755] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:23:34 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:34.570628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1e952-0219-42a7-86c9-c0d4dd0a54b8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:34.584558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1e952-0219-42a7-86c9-c0d4dd0a54b8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:34.680077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6744e50-7af1-4db3-881a-4b7ec1779084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:34.680859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6744e50-7af1-4db3-881a-4b7ec1779084 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:34.681114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6744e50-7af1-4db3-881a-4b7ec1779084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:34.681426 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6744e50-7af1-4db3-881a-4b7ec1779084 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:34.682195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6744e50-7af1-4db3-881a-4b7ec1779084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:34.684595 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6744e50-7af1-4db3-881a-4b7ec1779084 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:34.722294 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1380/2756] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:23:34 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:23:34.727138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e54fd-8214-436f-afbb-cc4da6f65df2 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:34.748537 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e54fd-8214-436f-afbb-cc4da6f65df2 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:34.760254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fedfe0-31e4-44be-9913-82f9ea1e7ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:34.761452 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fedfe0-31e4-44be-9913-82f9ea1e7ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:34.761881 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fedfe0-31e4-44be-9913-82f9ea1e7ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:34.762293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fedfe0-31e4-44be-9913-82f9ea1e7ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:34.763577 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fedfe0-31e4-44be-9913-82f9ea1e7ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:34.765778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fedfe0-31e4-44be-9913-82f9ea1e7ff4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:34.790612 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1377/2757] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:23:34.792989 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6744e50-7af1-4db3-881a-4b7ec1779084 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:34.825871 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6744e50-7af1-4db3-881a-4b7ec1779084 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:34.834927 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71b46a-784a-4edd-bd35-4023a29777d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:34.836385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71b46a-784a-4edd-bd35-4023a29777d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:34.836741 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71b46a-784a-4edd-bd35-4023a29777d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:34.837368 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71b46a-784a-4edd-bd35-4023a29777d2 admin admin] PATH_INFO: `/v3/projects/5537bb173b2a45f59ce1ef9a325a8883/users/d019379692ce4aa9858016d0f2bd1f13/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:34.877384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71b46a-784a-4edd-bd35-4023a29777d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5537bb173b2a45f59ce1ef9a325a8883, user_id=d019379692ce4aa9858016d0f2bd1f13, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:34.881074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71b46a-784a-4edd-bd35-4023a29777d2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:34.917721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1381/2758] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:34 2022] PUT /identity/v3/projects/5537bb173b2a45f59ce1ef9a325a8883/users/d019379692ce4aa9858016d0f2bd1f13/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:34.920261 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fedfe0-31e4-44be-9913-82f9ea1e7ff4 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:34.962889 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fedfe0-31e4-44be-9913-82f9ea1e7ff4 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:34.969418 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:35.111183 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f695d2-98a5-4fee-b272-10bc8c4a93ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:35.114356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f695d2-98a5-4fee-b272-10bc8c4a93ad admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:35.116580 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f695d2-98a5-4fee-b272-10bc8c4a93ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:35.117538 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f695d2-98a5-4fee-b272-10bc8c4a93ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:35.119303 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f695d2-98a5-4fee-b272-10bc8c4a93ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:35.122581 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f695d2-98a5-4fee-b272-10bc8c4a93ad admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:35.163175 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1378/2759] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:35.168123 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71b46a-784a-4edd-bd35-4023a29777d2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:35.182765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71b46a-784a-4edd-bd35-4023a29777d2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:35.187696 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd2038-5a09-423d-ab70-683f1718c94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:35.188678 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd2038-5a09-423d-ab70-683f1718c94b admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:35.188976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd2038-5a09-423d-ab70-683f1718c94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:35.189231 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd2038-5a09-423d-ab70-683f1718c94b admin admin] PATH_INFO: `/v3/projects/5537bb173b2a45f59ce1ef9a325a8883/users/d019379692ce4aa9858016d0f2bd1f13/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:35.191498 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd2038-5a09-423d-ab70-683f1718c94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5537bb173b2a45f59ce1ef9a325a8883, user_id=d019379692ce4aa9858016d0f2bd1f13, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:35.194318 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd2038-5a09-423d-ab70-683f1718c94b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:35.205017 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:35.222033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1382/2760] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:35 2022] PUT /identity/v3/projects/5537bb173b2a45f59ce1ef9a325a8883/users/d019379692ce4aa9858016d0f2bd1f13/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:23:35.224323 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c489-4bb2-4f62-b292-b325ba1074f4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:35.224502 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c489-4bb2-4f62-b292-b325ba1074f4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:35.224974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c489-4bb2-4f62-b292-b325ba1074f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:35.293109 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4ce4c489-4bb2-4f62-b292-b325ba1074f4 None None] MFA Rules not processed for user `d019379692ce4aa9858016d0f2bd1f13`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:35.295685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4ce4c489-4bb2-4f62-b292-b325ba1074f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:35.450225 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1379/2761] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:35.464842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd2038-5a09-423d-ab70-683f1718c94b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:35.467003 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-58cd2038-5a09-423d-ab70-683f1718c94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:35.574781 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd2038-5a09-423d-ab70-683f1718c94b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:35.581824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191da6a8-10ab-41b4-afd0-b49ee2ea3c0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:35.583071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191da6a8-10ab-41b4-afd0-b49ee2ea3c0d service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:35.583617 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191da6a8-10ab-41b4-afd0-b49ee2ea3c0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:35.584076 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191da6a8-10ab-41b4-afd0-b49ee2ea3c0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:35.735462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191da6a8-10ab-41b4-afd0-b49ee2ea3c0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:35.738560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191da6a8-10ab-41b4-afd0-b49ee2ea3c0d service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:35.749708 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1383/2762] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:23:36.882021 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ba037-fee1-4a04-b420-05e028730fa3 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:36.882840 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ba037-fee1-4a04-b420-05e028730fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:36.883314 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ba037-fee1-4a04-b420-05e028730fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:36.926970 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-028ba037-fee1-4a04-b420-05e028730fa3 None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:36.928515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-028ba037-fee1-4a04-b420-05e028730fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:37.004397 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1380/2763] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jul 21 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:37.025874 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191da6a8-10ab-41b4-afd0-b49ee2ea3c0d service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:37.028187 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-191da6a8-10ab-41b4-afd0-b49ee2ea3c0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:37.157559 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191da6a8-10ab-41b4-afd0-b49ee2ea3c0d service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:37.164049 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9758aea-5030-47f7-ac3f-8d9e81b0ea35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:37.164768 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9758aea-5030-47f7-ac3f-8d9e81b0ea35 service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:37.165054 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9758aea-5030-47f7-ac3f-8d9e81b0ea35 service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:37.165330 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9758aea-5030-47f7-ac3f-8d9e81b0ea35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:37.175565 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9758aea-5030-47f7-ac3f-8d9e81b0ea35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:37.177200 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9758aea-5030-47f7-ac3f-8d9e81b0ea35 service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:37.188934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1384/2764] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:23:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:23:37.329638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ba037-fee1-4a04-b420-05e028730fa3 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:37.331875 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-028ba037-fee1-4a04-b420-05e028730fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:37.361635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ba037-fee1-4a04-b420-05e028730fa3 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:37.368025 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651f6e1-fea1-41ca-94a6-40f3ce6cca4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:37.369203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f6e1-fea1-41ca-94a6-40f3ce6cca4d service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:37.369789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f6e1-fea1-41ca-94a6-40f3ce6cca4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:37.370274 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f6e1-fea1-41ca-94a6-40f3ce6cca4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:37.388954 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651f6e1-fea1-41ca-94a6-40f3ce6cca4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:37.390820 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651f6e1-fea1-41ca-94a6-40f3ce6cca4d service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:37.414170 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1381/2765] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:39.640011 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9758aea-5030-47f7-ac3f-8d9e81b0ea35 service swift] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:39.642350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c9758aea-5030-47f7-ac3f-8d9e81b0ea35 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:39.704313 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:39.726353 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9758aea-5030-47f7-ac3f-8d9e81b0ea35 service swift] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:39.731729 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157b865-034e-45cb-8fc5-51656f279015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:39.732721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157b865-034e-45cb-8fc5-51656f279015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:39.733031 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157b865-034e-45cb-8fc5-51656f279015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:39.733305 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157b865-034e-45cb-8fc5-51656f279015 admin admin] PATH_INFO: `/v3/users/d14c9402fa9048f3a8a7de43ceaadd6a` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:39.734696 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157b865-034e-45cb-8fc5-51656f279015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14c9402fa9048f3a8a7de43ceaadd6a)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:39.736654 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157b865-034e-45cb-8fc5-51656f279015 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:39.801074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6157b865-034e-45cb-8fc5-51656f279015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14c9402fa9048f3a8a7de43ceaadd6a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:39.810057 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6157b865-034e-45cb-8fc5-51656f279015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14c9402fa9048f3a8a7de43ceaadd6a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:39.811042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6157b865-034e-45cb-8fc5-51656f279015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14c9402fa9048f3a8a7de43ceaadd6a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:39.829060 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6157b865-034e-45cb-8fc5-51656f279015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14c9402fa9048f3a8a7de43ceaadd6a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:39.829968 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6157b865-034e-45cb-8fc5-51656f279015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14c9402fa9048f3a8a7de43ceaadd6a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:39.846908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1385/2766] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:39 2022] DELETE /identity/v3/users/d14c9402fa9048f3a8a7de43ceaadd6a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:40.087931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651f6e1-fea1-41ca-94a6-40f3ce6cca4d service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:40.099509 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:40.104963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651f6e1-fea1-41ca-94a6-40f3ce6cca4d service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:40.175110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:40.176447 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:40.176830 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:40.177297 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d admin admin] PATH_INFO: `/v3/projects/d8ecfa8293354aa9be3ecdddaa6435a6` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:40.178903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ecfa8293354aa9be3ecdddaa6435a6)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:40.181394 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:40.265357 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ecfa8293354aa9be3ecdddaa6435a6', 'request_id': 'req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:40.278772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ecfa8293354aa9be3ecdddaa6435a6', 'request_id': 'req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:40.287580 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ecfa8293354aa9be3ecdddaa6435a6', 'request_id': 'req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:40.309176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d admin admin] The token cache is being invalidate because project d8ecfa8293354aa9be3ecdddaa6435a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:40.309641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:40.310638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7c4a2d0a-0d61-4d02-bec2-bd6e1e42cb3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:40.312470 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1382/2767] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:40 2022] DELETE /identity/v3/projects/d8ecfa8293354aa9be3ecdddaa6435a6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:40.319636 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c135df-a6a5-4fe8-8d1f-8658c465ef73 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:40.320095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c135df-a6a5-4fe8-8d1f-8658c465ef73 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:40.320460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c135df-a6a5-4fe8-8d1f-8658c465ef73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:40.351532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c4c135df-a6a5-4fe8-8d1f-8658c465ef73 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:40.352824 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c4c135df-a6a5-4fe8-8d1f-8658c465ef73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:40.431043 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1386/2768] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:40.440400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaada04c-a2cf-40c6-be5f-2bfe1f6ee966 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:40.440752 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaada04c-a2cf-40c6-be5f-2bfe1f6ee966 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:40.441059 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaada04c-a2cf-40c6-be5f-2bfe1f6ee966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:40.471981 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-aaada04c-a2cf-40c6-be5f-2bfe1f6ee966 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:40.473640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-aaada04c-a2cf-40c6-be5f-2bfe1f6ee966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:40.485319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1383/2769] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:40.491480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c135df-a6a5-4fe8-8d1f-8658c465ef73 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:40.511276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c135df-a6a5-4fe8-8d1f-8658c465ef73 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:40.521437 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4df882-e505-4f37-87fa-02f269b1cd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:40.522605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4df882-e505-4f37-87fa-02f269b1cd15 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:40.523158 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4df882-e505-4f37-87fa-02f269b1cd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:40.523658 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4df882-e505-4f37-87fa-02f269b1cd15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:40.525099 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4df882-e505-4f37-87fa-02f269b1cd15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:23:40.525667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4df882-e505-4f37-87fa-02f269b1cd15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:40.529362 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4df882-e505-4f37-87fa-02f269b1cd15 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:40.554716 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1387/2770] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:23:40.560751 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaada04c-a2cf-40c6-be5f-2bfe1f6ee966 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:40.573133 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaada04c-a2cf-40c6-be5f-2bfe1f6ee966 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:40.578842 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e48e6-56da-4ad8-934a-7eb564fd8702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:40.580414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e48e6-56da-4ad8-934a-7eb564fd8702 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:40.580414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e48e6-56da-4ad8-934a-7eb564fd8702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:40.580414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e48e6-56da-4ad8-934a-7eb564fd8702 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:40.580913 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e48e6-56da-4ad8-934a-7eb564fd8702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:40.582925 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e48e6-56da-4ad8-934a-7eb564fd8702 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:40.627116 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1384/2771] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:23:40 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:40.632983 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4df882-e505-4f37-87fa-02f269b1cd15 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:40.651453 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4df882-e505-4f37-87fa-02f269b1cd15 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:40.729348 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:40.744154 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28e8c1-6494-4ce0-8ee1-10c7ac68c57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:40.745145 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28e8c1-6494-4ce0-8ee1-10c7ac68c57f admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:40.745556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28e8c1-6494-4ce0-8ee1-10c7ac68c57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:40.745909 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28e8c1-6494-4ce0-8ee1-10c7ac68c57f admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:40.747097 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28e8c1-6494-4ce0-8ee1-10c7ac68c57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:40.749163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28e8c1-6494-4ce0-8ee1-10c7ac68c57f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:40.778980 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1388/2772] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:23:40 2022] POST /identity/v3/users => generated 283 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:40.779333 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e48e6-56da-4ad8-934a-7eb564fd8702 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:40.799619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e48e6-56da-4ad8-934a-7eb564fd8702 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:40.807128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95c478-c9bb-443a-9d97-cc40a00a46f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:40.808456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c478-c9bb-443a-9d97-cc40a00a46f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:40.809081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c478-c9bb-443a-9d97-cc40a00a46f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:40.809778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c478-c9bb-443a-9d97-cc40a00a46f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:40.811140 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95c478-c9bb-443a-9d97-cc40a00a46f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:40.813923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95c478-c9bb-443a-9d97-cc40a00a46f1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:40.829210 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1385/2773] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:40.835210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28e8c1-6494-4ce0-8ee1-10c7ac68c57f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:40.853147 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28e8c1-6494-4ce0-8ee1-10c7ac68c57f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:40.862319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e05057-06e5-4ddb-b78d-9a76fc5b8582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:40.868593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05057-06e5-4ddb-b78d-9a76fc5b8582 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:40.868593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05057-06e5-4ddb-b78d-9a76fc5b8582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:40.868593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05057-06e5-4ddb-b78d-9a76fc5b8582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:40.868593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e05057-06e5-4ddb-b78d-9a76fc5b8582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:40.868593 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e05057-06e5-4ddb-b78d-9a76fc5b8582 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:40.882950 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1389/2774] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:40.888240 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95c478-c9bb-443a-9d97-cc40a00a46f1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:40.907264 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95c478-c9bb-443a-9d97-cc40a00a46f1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:40.914845 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb203b0-6424-4996-a384-e850adde6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:40.917145 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb203b0-6424-4996-a384-e850adde6625 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:40.917386 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb203b0-6424-4996-a384-e850adde6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:40.917768 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb203b0-6424-4996-a384-e850adde6625 admin admin] PATH_INFO: `/v3/projects/755b47e8f2a94287b424a1c2c6dd385f/users/dc51cb83ce8b48c19a67361471abc474/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:40.938247 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb203b0-6424-4996-a384-e850adde6625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755b47e8f2a94287b424a1c2c6dd385f, user_id=dc51cb83ce8b48c19a67361471abc474, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:40.941392 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb203b0-6424-4996-a384-e850adde6625 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:40.958293 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1386/2775] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:40 2022] PUT /identity/v3/projects/755b47e8f2a94287b424a1c2c6dd385f/users/dc51cb83ce8b48c19a67361471abc474/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:40.971210 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a72dd-dfd0-40b1-a302-d8572d73f374 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:40.971497 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a72dd-dfd0-40b1-a302-d8572d73f374 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:40.971774 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a72dd-dfd0-40b1-a302-d8572d73f374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:41.018322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8e3a72dd-dfd0-40b1-a302-d8572d73f374 None None] MFA Rules not processed for user `dc51cb83ce8b48c19a67361471abc474`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:41.020433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8e3a72dd-dfd0-40b1-a302-d8572d73f374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:41.098693 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1390/2776] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:23:41.111054 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb203b0-6424-4996-a384-e850adde6625 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:41.113389 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2eb203b0-6424-4996-a384-e850adde6625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:41.156353 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:41.187381 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb203b0-6424-4996-a384-e850adde6625 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:41.194433 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811e560-508d-41d5-ac39-e04416f2f665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:41.195818 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811e560-508d-41d5-ac39-e04416f2f665 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:41.196559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811e560-508d-41d5-ac39-e04416f2f665 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:41.197019 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811e560-508d-41d5-ac39-e04416f2f665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:41.212263 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811e560-508d-41d5-ac39-e04416f2f665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:41.214225 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811e560-508d-41d5-ac39-e04416f2f665 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:41.227210 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1387/2777] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:41.494572 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a72dd-dfd0-40b1-a302-d8572d73f374 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:41.496483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8e3a72dd-dfd0-40b1-a302-d8572d73f374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:41.578353 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a72dd-dfd0-40b1-a302-d8572d73f374 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:41.585433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0258c-5341-4a17-b0ce-e42495ff20dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:41.586968 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0258c-5341-4a17-b0ce-e42495ff20dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:41.587441 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0258c-5341-4a17-b0ce-e42495ff20dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:41.587827 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0258c-5341-4a17-b0ce-e42495ff20dd admin admin] PATH_INFO: `/v3/users/a2a9e2557bf54c93ba4a65c2b3efded2` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:41.589590 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0258c-5341-4a17-b0ce-e42495ff20dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2a9e2557bf54c93ba4a65c2b3efded2)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:41.591977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0258c-5341-4a17-b0ce-e42495ff20dd admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:41.678089 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-eae0258c-5341-4a17-b0ce-e42495ff20dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2a9e2557bf54c93ba4a65c2b3efded2'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:41.690428 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-eae0258c-5341-4a17-b0ce-e42495ff20dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2a9e2557bf54c93ba4a65c2b3efded2'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:41.691509 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-eae0258c-5341-4a17-b0ce-e42495ff20dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2a9e2557bf54c93ba4a65c2b3efded2'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:41.702458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:41.716123 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-eae0258c-5341-4a17-b0ce-e42495ff20dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2a9e2557bf54c93ba4a65c2b3efded2'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:41.717072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-eae0258c-5341-4a17-b0ce-e42495ff20dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2a9e2557bf54c93ba4a65c2b3efded2'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:41.738843 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1391/2778] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:41 2022] DELETE /identity/v3/users/a2a9e2557bf54c93ba4a65c2b3efded2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:41.744322 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb6870-b271-48ed-8a5b-a457420007ec None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:41.744758 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb6870-b271-48ed-8a5b-a457420007ec None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:41.745081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb6870-b271-48ed-8a5b-a457420007ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:41.773665 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4ddb6870-b271-48ed-8a5b-a457420007ec None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:41.774990 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4ddb6870-b271-48ed-8a5b-a457420007ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:41.845768 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1388/2779] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:41.857996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0258c-5341-4a17-b0ce-e42495ff20dd admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:41.859637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-eae0258c-5341-4a17-b0ce-e42495ff20dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:41.947932 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0258c-5341-4a17-b0ce-e42495ff20dd admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:41.953844 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55ddbd-8fc0-4a7a-abc1-7dbfd0c0205c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:41.954631 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55ddbd-8fc0-4a7a-abc1-7dbfd0c0205c service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:41.955110 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55ddbd-8fc0-4a7a-abc1-7dbfd0c0205c service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:41.955554 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55ddbd-8fc0-4a7a-abc1-7dbfd0c0205c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:41.971897 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55ddbd-8fc0-4a7a-abc1-7dbfd0c0205c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:41.974018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55ddbd-8fc0-4a7a-abc1-7dbfd0c0205c service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:41.986964 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1392/2780] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:42.401923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb6870-b271-48ed-8a5b-a457420007ec None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:42.405658 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4ddb6870-b271-48ed-8a5b-a457420007ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:42.426401 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb6870-b271-48ed-8a5b-a457420007ec None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:42.435696 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:42.437736 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:42.438597 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:42.439121 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] PATH_INFO: `/v3/projects/70a42313a94e4cf68e296f74dce2f5ad` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:42.440924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a42313a94e4cf68e296f74dce2f5ad)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:42.443888 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:42.507224 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a42313a94e4cf68e296f74dce2f5ad', 'request_id': 'req-b9762fce-0be1-4929-8e11-f6f0d2d6746a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:42.516685 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a42313a94e4cf68e296f74dce2f5ad', 'request_id': 'req-b9762fce-0be1-4929-8e11-f6f0d2d6746a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:42.525178 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a42313a94e4cf68e296f74dce2f5ad', 'request_id': 'req-b9762fce-0be1-4929-8e11-f6f0d2d6746a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:42.538264 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] The token cache is being invalidate because project 70a42313a94e4cf68e296f74dce2f5ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:42.538632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:42.539242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:42.541221 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1389/2781] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:42 2022] DELETE /identity/v3/projects/70a42313a94e4cf68e296f74dce2f5ad => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:42.547261 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55ddbd-8fc0-4a7a-abc1-7dbfd0c0205c service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:42.559310 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55ddbd-8fc0-4a7a-abc1-7dbfd0c0205c service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:42.631357 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ac592-28f3-4457-a671-c564fb86ce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:42.632357 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ac592-28f3-4457-a671-c564fb86ce92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:42.632707 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ac592-28f3-4457-a671-c564fb86ce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:42.633027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ac592-28f3-4457-a671-c564fb86ce92 admin admin] PATH_INFO: `/v3/users/d019379692ce4aa9858016d0f2bd1f13` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:42.634567 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ac592-28f3-4457-a671-c564fb86ce92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d019379692ce4aa9858016d0f2bd1f13)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:42.636642 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ac592-28f3-4457-a671-c564fb86ce92 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:42.715093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c62ac592-28f3-4457-a671-c564fb86ce92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd019379692ce4aa9858016d0f2bd1f13'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:42.729857 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c62ac592-28f3-4457-a671-c564fb86ce92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd019379692ce4aa9858016d0f2bd1f13'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:42.731227 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c62ac592-28f3-4457-a671-c564fb86ce92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd019379692ce4aa9858016d0f2bd1f13'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:42.766341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c62ac592-28f3-4457-a671-c564fb86ce92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd019379692ce4aa9858016d0f2bd1f13'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:42.766341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c62ac592-28f3-4457-a671-c564fb86ce92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd019379692ce4aa9858016d0f2bd1f13'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:42.780279 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:42.785819 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1393/2782] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:42 2022] DELETE /identity/v3/users/d019379692ce4aa9858016d0f2bd1f13 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:43.205699 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:43.209118 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:43.241880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9762fce-0be1-4929-8e11-f6f0d2d6746a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:43.355726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:43.366903 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc98007-c0e9-4255-857c-251e079a4454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:43.369041 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc98007-c0e9-4255-857c-251e079a4454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:43.369899 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc98007-c0e9-4255-857c-251e079a4454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:43.370603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc98007-c0e9-4255-857c-251e079a4454 admin admin] PATH_INFO: `/v3/projects/5537bb173b2a45f59ce1ef9a325a8883` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:43.375068 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc98007-c0e9-4255-857c-251e079a4454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5537bb173b2a45f59ce1ef9a325a8883)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:43.378892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc98007-c0e9-4255-857c-251e079a4454 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:43.478169 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8dc98007-c0e9-4255-857c-251e079a4454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5537bb173b2a45f59ce1ef9a325a8883', 'request_id': 'req-8dc98007-c0e9-4255-857c-251e079a4454'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:43.499802 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8dc98007-c0e9-4255-857c-251e079a4454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5537bb173b2a45f59ce1ef9a325a8883', 'request_id': 'req-8dc98007-c0e9-4255-857c-251e079a4454'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:43.512042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8dc98007-c0e9-4255-857c-251e079a4454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5537bb173b2a45f59ce1ef9a325a8883', 'request_id': 'req-8dc98007-c0e9-4255-857c-251e079a4454'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:43.528567 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8dc98007-c0e9-4255-857c-251e079a4454 admin admin] The token cache is being invalidate because project 5537bb173b2a45f59ce1ef9a325a8883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:43.528921 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8dc98007-c0e9-4255-857c-251e079a4454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:43.529572 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8dc98007-c0e9-4255-857c-251e079a4454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:43.531718 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1390/2783] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:43 2022] DELETE /identity/v3/projects/5537bb173b2a45f59ce1ef9a325a8883 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:43.536814 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063c6f5-03a7-435e-972c-efc877337058 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:43.537218 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063c6f5-03a7-435e-972c-efc877337058 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:43.537571 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063c6f5-03a7-435e-972c-efc877337058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:43.567858 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d063c6f5-03a7-435e-972c-efc877337058 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:43.570035 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d063c6f5-03a7-435e-972c-efc877337058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:43.674272 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1394/2784] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:23:43.679920 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca1972-2cf2-4bc2-87bc-ea4713461445 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:43.680491 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca1972-2cf2-4bc2-87bc-ea4713461445 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:43.680969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca1972-2cf2-4bc2-87bc-ea4713461445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:43.719287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-bdca1972-2cf2-4bc2-87bc-ea4713461445 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:43.720710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bdca1972-2cf2-4bc2-87bc-ea4713461445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:43.730428 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1391/2785] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:43.736243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063c6f5-03a7-435e-972c-efc877337058 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:43.754370 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063c6f5-03a7-435e-972c-efc877337058 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:43.763083 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b83529-4f62-45aa-ad21-4539902a0416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:43.764211 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b83529-4f62-45aa-ad21-4539902a0416 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:43.764697 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b83529-4f62-45aa-ad21-4539902a0416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:43.765387 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b83529-4f62-45aa-ad21-4539902a0416 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:43.766522 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b83529-4f62-45aa-ad21-4539902a0416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:23:43.767103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b83529-4f62-45aa-ad21-4539902a0416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:43.770296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b83529-4f62-45aa-ad21-4539902a0416 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:43.795108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1395/2786] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:23:43.802066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca1972-2cf2-4bc2-87bc-ea4713461445 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:43.815225 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca1972-2cf2-4bc2-87bc-ea4713461445 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:43.820969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251320ba-9b98-47cf-a5a2-519f9a2bf3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:43.822133 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251320ba-9b98-47cf-a5a2-519f9a2bf3fa admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:43.822558 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251320ba-9b98-47cf-a5a2-519f9a2bf3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:43.823493 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251320ba-9b98-47cf-a5a2-519f9a2bf3fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:43.824409 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251320ba-9b98-47cf-a5a2-519f9a2bf3fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:43.827590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251320ba-9b98-47cf-a5a2-519f9a2bf3fa admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:43.863636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1392/2787] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:23:43 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:43.869163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b83529-4f62-45aa-ad21-4539902a0416 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:43.882912 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b83529-4f62-45aa-ad21-4539902a0416 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:43.955415 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0861850-9861-49ef-983f-6736f1925941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:43.956168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0861850-9861-49ef-983f-6736f1925941 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:43.956465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0861850-9861-49ef-983f-6736f1925941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:43.956753 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0861850-9861-49ef-983f-6736f1925941 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:43.957563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0861850-9861-49ef-983f-6736f1925941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:43.959751 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0861850-9861-49ef-983f-6736f1925941 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:43.983996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1396/2788] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:23:43 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:43.988702 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251320ba-9b98-47cf-a5a2-519f9a2bf3fa admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:44.000801 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251320ba-9b98-47cf-a5a2-519f9a2bf3fa admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:44.007521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2180b-482d-4a23-b126-c389f78308f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:44.008427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2180b-482d-4a23-b126-c389f78308f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:44.008741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2180b-482d-4a23-b126-c389f78308f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:44.009056 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2180b-482d-4a23-b126-c389f78308f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:44.009875 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2180b-482d-4a23-b126-c389f78308f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:44.011632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2180b-482d-4a23-b126-c389f78308f5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:44.026121 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1393/2789] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:44.031572 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0861850-9861-49ef-983f-6736f1925941 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:44.045075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0861850-9861-49ef-983f-6736f1925941 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:44.050594 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18858d9e-cd50-424b-b8fc-73706b9455fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:44.051341 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18858d9e-cd50-424b-b8fc-73706b9455fc admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:44.051667 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18858d9e-cd50-424b-b8fc-73706b9455fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:44.051990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18858d9e-cd50-424b-b8fc-73706b9455fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:44.052783 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18858d9e-cd50-424b-b8fc-73706b9455fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:44.054969 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18858d9e-cd50-424b-b8fc-73706b9455fc admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:44.067262 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1397/2790] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:44.072783 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2180b-482d-4a23-b126-c389f78308f5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:44.085071 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2180b-482d-4a23-b126-c389f78308f5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:44.090244 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d7f13-ecef-4313-8aba-5831ed0cada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:44.091208 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d7f13-ecef-4313-8aba-5831ed0cada8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:44.091481 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d7f13-ecef-4313-8aba-5831ed0cada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:44.091750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d7f13-ecef-4313-8aba-5831ed0cada8 admin admin] PATH_INFO: `/v3/projects/d2fcc48960fe4378b09d0f1b6dc92407/users/f80f09965e0841b782c02400b2114110/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:44.109789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d7f13-ecef-4313-8aba-5831ed0cada8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2fcc48960fe4378b09d0f1b6dc92407, user_id=f80f09965e0841b782c02400b2114110, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:44.112668 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d7f13-ecef-4313-8aba-5831ed0cada8 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:44.133863 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1394/2791] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:44 2022] PUT /identity/v3/projects/d2fcc48960fe4378b09d0f1b6dc92407/users/f80f09965e0841b782c02400b2114110/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:44.147273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5645e-af78-4cc9-8512-b4d0b398461e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:44.147616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5645e-af78-4cc9-8512-b4d0b398461e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:44.148031 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5645e-af78-4cc9-8512-b4d0b398461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:44.178896 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a0a5645e-af78-4cc9-8512-b4d0b398461e None None] MFA Rules not processed for user `f80f09965e0841b782c02400b2114110`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:44.180162 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a0a5645e-af78-4cc9-8512-b4d0b398461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:44.243838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:44.255949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1398/2792] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:44.261077 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d7f13-ecef-4313-8aba-5831ed0cada8 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:44.352894 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d7f13-ecef-4313-8aba-5831ed0cada8 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:44.358199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb3a22-ae0f-4df1-a824-20f40be53cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:44.359000 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb3a22-ae0f-4df1-a824-20f40be53cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:44.359272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb3a22-ae0f-4df1-a824-20f40be53cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:44.359568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb3a22-ae0f-4df1-a824-20f40be53cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:44.360344 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb3a22-ae0f-4df1-a824-20f40be53cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:44.362510 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb3a22-ae0f-4df1-a824-20f40be53cc5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:44.392499 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1395/2793] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:23:44 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:44.397918 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5645e-af78-4cc9-8512-b4d0b398461e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:44.416378 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5645e-af78-4cc9-8512-b4d0b398461e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:44.496924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd365572-3a37-4094-80f3-2f0bc488b550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:44.497591 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd365572-3a37-4094-80f3-2f0bc488b550 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:44.497878 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd365572-3a37-4094-80f3-2f0bc488b550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:44.498167 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd365572-3a37-4094-80f3-2f0bc488b550 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:44.498934 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd365572-3a37-4094-80f3-2f0bc488b550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:44.501028 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd365572-3a37-4094-80f3-2f0bc488b550 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:44.529199 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1399/2794] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:23:44 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:44.535160 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb3a22-ae0f-4df1-a824-20f40be53cc5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:44.546882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb3a22-ae0f-4df1-a824-20f40be53cc5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:44.552370 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1730dde-47ec-49d6-b29d-11dbc4f90dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:44.553574 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1730dde-47ec-49d6-b29d-11dbc4f90dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:44.553923 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1730dde-47ec-49d6-b29d-11dbc4f90dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:44.554260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1730dde-47ec-49d6-b29d-11dbc4f90dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:44.555556 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1730dde-47ec-49d6-b29d-11dbc4f90dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:44.557486 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1730dde-47ec-49d6-b29d-11dbc4f90dfa admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:44.560844 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:44.574838 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1396/2795] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:23:44.581430 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd365572-3a37-4094-80f3-2f0bc488b550 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:44.594241 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd365572-3a37-4094-80f3-2f0bc488b550 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:44.602074 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a6d89-b7d8-4737-a865-3af08b38fe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:44.603709 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a6d89-b7d8-4737-a865-3af08b38fe48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:44.604198 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a6d89-b7d8-4737-a865-3af08b38fe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:44.604700 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a6d89-b7d8-4737-a865-3af08b38fe48 admin admin] PATH_INFO: `/v3/projects/31e430473ef5499aa728d29a4865f1c9/users/5b6b312c22ef43ec9d94fd8f35601c5a/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:44.631047 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a6d89-b7d8-4737-a865-3af08b38fe48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e430473ef5499aa728d29a4865f1c9, user_id=5b6b312c22ef43ec9d94fd8f35601c5a, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:44.636616 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a6d89-b7d8-4737-a865-3af08b38fe48 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:44.655859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1400/2796] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:44 2022] PUT /identity/v3/projects/31e430473ef5499aa728d29a4865f1c9/users/5b6b312c22ef43ec9d94fd8f35601c5a/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:44.660240 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1730dde-47ec-49d6-b29d-11dbc4f90dfa admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:44.671373 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1730dde-47ec-49d6-b29d-11dbc4f90dfa admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:44.744776 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3518f08-df48-4180-9699-ef68ccdb2895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:44.745476 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3518f08-df48-4180-9699-ef68ccdb2895 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:44.745788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3518f08-df48-4180-9699-ef68ccdb2895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:44.746060 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3518f08-df48-4180-9699-ef68ccdb2895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:44.746846 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3518f08-df48-4180-9699-ef68ccdb2895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:44.748618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3518f08-df48-4180-9699-ef68ccdb2895 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:44.760596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1397/2797] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:23:44.765516 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a6d89-b7d8-4737-a865-3af08b38fe48 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:44.780528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a6d89-b7d8-4737-a865-3af08b38fe48 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:44.794070 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac99648-d320-4fa6-a51b-a9e5fa56e431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:44.795060 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac99648-d320-4fa6-a51b-a9e5fa56e431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:44.795348 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac99648-d320-4fa6-a51b-a9e5fa56e431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:44.795626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac99648-d320-4fa6-a51b-a9e5fa56e431 admin admin] PATH_INFO: `/v3/projects/31e430473ef5499aa728d29a4865f1c9/users/5b6b312c22ef43ec9d94fd8f35601c5a/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:44.798267 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac99648-d320-4fa6-a51b-a9e5fa56e431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e430473ef5499aa728d29a4865f1c9, user_id=5b6b312c22ef43ec9d94fd8f35601c5a, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:44.801195 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac99648-d320-4fa6-a51b-a9e5fa56e431 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:44.817650 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1401/2798] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:44 2022] PUT /identity/v3/projects/31e430473ef5499aa728d29a4865f1c9/users/5b6b312c22ef43ec9d94fd8f35601c5a/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:44.831400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b401f-8696-46af-ac22-f938ab213c25 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:44.831790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b401f-8696-46af-ac22-f938ab213c25 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:44.832396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b401f-8696-46af-ac22-f938ab213c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:44.885757 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fc6b401f-8696-46af-ac22-f938ab213c25 None None] MFA Rules not processed for user `5b6b312c22ef43ec9d94fd8f35601c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:44.887974 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fc6b401f-8696-46af-ac22-f938ab213c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:45.004128 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1398/2799] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:45.021006 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac99648-d320-4fa6-a51b-a9e5fa56e431 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:45.024163 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2ac99648-d320-4fa6-a51b-a9e5fa56e431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:45.103448 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac99648-d320-4fa6-a51b-a9e5fa56e431 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:45.107181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b0c01-77ae-48a8-8b1c-e845d37fd901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:45.107846 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b0c01-77ae-48a8-8b1c-e845d37fd901 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:45.108131 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b0c01-77ae-48a8-8b1c-e845d37fd901 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:45.108397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b0c01-77ae-48a8-8b1c-e845d37fd901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:45.118166 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b0c01-77ae-48a8-8b1c-e845d37fd901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:45.119651 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b0c01-77ae-48a8-8b1c-e845d37fd901 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:45.130582 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1402/2800] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:45.504412 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b401f-8696-46af-ac22-f938ab213c25 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:45.514745 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b401f-8696-46af-ac22-f938ab213c25 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:45.519716 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db4845-12b9-44fc-9cdd-567496df30b0 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6b312c22ef43ec9d94fd8f35601c5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31e430473ef5499aa728d29a4865f1c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:45.520586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db4845-12b9-44fc-9cdd-567496df30b0 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:45.520997 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db4845-12b9-44fc-9cdd-567496df30b0 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:45.521339 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db4845-12b9-44fc-9cdd-567496df30b0 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:45.522155 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db4845-12b9-44fc-9cdd-567496df30b0 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:23:45.522707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db4845-12b9-44fc-9cdd-567496df30b0 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:45.524449 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db4845-12b9-44fc-9cdd-567496df30b0 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:45.538242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1399/2801] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:23:45.543429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b0c01-77ae-48a8-8b1c-e845d37fd901 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:45.554273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b0c01-77ae-48a8-8b1c-e845d37fd901 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:45.560477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c133f-6b57-44c9-af33-c32c0f79274e tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6b312c22ef43ec9d94fd8f35601c5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31e430473ef5499aa728d29a4865f1c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:45.561174 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c133f-6b57-44c9-af33-c32c0f79274e tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:45.561457 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c133f-6b57-44c9-af33-c32c0f79274e tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:45.561734 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c133f-6b57-44c9-af33-c32c0f79274e tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:45.562470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c133f-6b57-44c9-af33-c32c0f79274e tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:45.564588 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c133f-6b57-44c9-af33-c32c0f79274e tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:45.596680 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1403/2802] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:23:45 2022] POST /identity/v3/projects => generated 354 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:23:45.601531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db4845-12b9-44fc-9cdd-567496df30b0 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:45.615138 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db4845-12b9-44fc-9cdd-567496df30b0 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:45.677882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecd36e-c40e-4c06-9638-8a016326fc92 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6b312c22ef43ec9d94fd8f35601c5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31e430473ef5499aa728d29a4865f1c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:45.678584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecd36e-c40e-4c06-9638-8a016326fc92 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:45.678920 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecd36e-c40e-4c06-9638-8a016326fc92 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:45.679200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecd36e-c40e-4c06-9638-8a016326fc92 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:45.679945 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecd36e-c40e-4c06-9638-8a016326fc92 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:23:45.680249 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecd36e-c40e-4c06-9638-8a016326fc92 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:45.681858 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecd36e-c40e-4c06-9638-8a016326fc92 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:45.694401 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:45.698596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1400/2803] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:23:45.744883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c133f-6b57-44c9-af33-c32c0f79274e tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:45.763603 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c133f-6b57-44c9-af33-c32c0f79274e tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:45.771833 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850c2ab-e98a-4611-905d-a2ac05810d08 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6b312c22ef43ec9d94fd8f35601c5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31e430473ef5499aa728d29a4865f1c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:45.773182 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850c2ab-e98a-4611-905d-a2ac05810d08 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:45.773613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850c2ab-e98a-4611-905d-a2ac05810d08 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:45.774103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850c2ab-e98a-4611-905d-a2ac05810d08 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] PATH_INFO: `/v3/projects/7c979704a4364aabb87ab648839a63f7` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:45.776462 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850c2ab-e98a-4611-905d-a2ac05810d08 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7c979704a4364aabb87ab648839a63f7)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:45.780197 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850c2ab-e98a-4611-905d-a2ac05810d08 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:45.832373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:45.870213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4850c2ab-e98a-4611-905d-a2ac05810d08 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c979704a4364aabb87ab648839a63f7', 'request_id': 'req-4850c2ab-e98a-4611-905d-a2ac05810d08'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:45.881637 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4850c2ab-e98a-4611-905d-a2ac05810d08 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c979704a4364aabb87ab648839a63f7', 'request_id': 'req-4850c2ab-e98a-4611-905d-a2ac05810d08'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:45.891520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4850c2ab-e98a-4611-905d-a2ac05810d08 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c979704a4364aabb87ab648839a63f7', 'request_id': 'req-4850c2ab-e98a-4611-905d-a2ac05810d08'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:45.905477 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4850c2ab-e98a-4611-905d-a2ac05810d08 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] The token cache is being invalidate because project 7c979704a4364aabb87ab648839a63f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:45.905768 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4850c2ab-e98a-4611-905d-a2ac05810d08 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:45.906525 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4850c2ab-e98a-4611-905d-a2ac05810d08 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:45.908265 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1404/2804] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:45 2022] DELETE /identity/v3/projects/7c979704a4364aabb87ab648839a63f7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:46.125707 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecd36e-c40e-4c06-9638-8a016326fc92 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:46.128097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-70ecd36e-c40e-4c06-9638-8a016326fc92 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:46.224365 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecd36e-c40e-4c06-9638-8a016326fc92 tempest-VolumeQuotaClassesTest-2066127348 tempest-VolumeQuotaClassesTest-2066127348-project-admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:46.289805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13da10-9e08-482e-9fd0-afde69f9e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:46.291093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13da10-9e08-482e-9fd0-afde69f9e9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:46.291528 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13da10-9e08-482e-9fd0-afde69f9e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:46.291920 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13da10-9e08-482e-9fd0-afde69f9e9ba admin admin] PATH_INFO: `/v3/users/f80f09965e0841b782c02400b2114110` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:46.293456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13da10-9e08-482e-9fd0-afde69f9e9ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80f09965e0841b782c02400b2114110)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:46.296112 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13da10-9e08-482e-9fd0-afde69f9e9ba admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:46.359338 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cb13da10-9e08-482e-9fd0-afde69f9e9ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80f09965e0841b782c02400b2114110'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:46.360531 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cb13da10-9e08-482e-9fd0-afde69f9e9ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80f09965e0841b782c02400b2114110'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:46.376762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cb13da10-9e08-482e-9fd0-afde69f9e9ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80f09965e0841b782c02400b2114110'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:46.385583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cb13da10-9e08-482e-9fd0-afde69f9e9ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80f09965e0841b782c02400b2114110'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:46.386762 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cb13da10-9e08-482e-9fd0-afde69f9e9ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80f09965e0841b782c02400b2114110'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:46.403656 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1401/2805] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:46 2022] DELETE /identity/v3/users/f80f09965e0841b782c02400b2114110 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:46.409848 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f32d81-27f3-4118-8f75-a600dcc517fe None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:46.410356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f32d81-27f3-4118-8f75-a600dcc517fe None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:46.410880 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f32d81-27f3-4118-8f75-a600dcc517fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:46.433922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-e7f32d81-27f3-4118-8f75-a600dcc517fe None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:46.435274 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e7f32d81-27f3-4118-8f75-a600dcc517fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:46.523143 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1405/2806] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:46.534060 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13da10-9e08-482e-9fd0-afde69f9e9ba admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:46.535769 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cb13da10-9e08-482e-9fd0-afde69f9e9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:46.573291 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:46.609217 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13da10-9e08-482e-9fd0-afde69f9e9ba admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:46.614334 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a139c-596f-4219-b57a-ea2e6b55df3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:46.615340 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a139c-596f-4219-b57a-ea2e6b55df3c service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:46.615789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a139c-596f-4219-b57a-ea2e6b55df3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:46.616190 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a139c-596f-4219-b57a-ea2e6b55df3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:46.629820 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a139c-596f-4219-b57a-ea2e6b55df3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:46.631590 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a139c-596f-4219-b57a-ea2e6b55df3c service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:46.643107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1402/2807] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:46.980653 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f32d81-27f3-4118-8f75-a600dcc517fe None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:46.982222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e7f32d81-27f3-4118-8f75-a600dcc517fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:47.007287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f32d81-27f3-4118-8f75-a600dcc517fe None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:47.012990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:47.014041 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:47.014316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:47.014809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] PATH_INFO: `/v3/projects/d2fcc48960fe4378b09d0f1b6dc92407` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:47.016337 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2fcc48960fe4378b09d0f1b6dc92407)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:47.018434 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:47.069623 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2fcc48960fe4378b09d0f1b6dc92407', 'request_id': 'req-cb2e5493-af70-4f48-aea4-5331f007b79d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.077956 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2fcc48960fe4378b09d0f1b6dc92407', 'request_id': 'req-cb2e5493-af70-4f48-aea4-5331f007b79d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.085424 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2fcc48960fe4378b09d0f1b6dc92407', 'request_id': 'req-cb2e5493-af70-4f48-aea4-5331f007b79d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.096816 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] The token cache is being invalidate because project d2fcc48960fe4378b09d0f1b6dc92407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:47.097103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.097755 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.099495 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1406/2808] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:46 2022] DELETE /identity/v3/projects/d2fcc48960fe4378b09d0f1b6dc92407 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:47.103670 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a139c-596f-4219-b57a-ea2e6b55df3c service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:47.113951 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a139c-596f-4219-b57a-ea2e6b55df3c service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:47.182465 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2630da2-c048-4e34-98d9-c4a0d1c93bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:47.183489 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630da2-c048-4e34-98d9-c4a0d1c93bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:47.183902 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630da2-c048-4e34-98d9-c4a0d1c93bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:47.184366 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630da2-c048-4e34-98d9-c4a0d1c93bc4 admin admin] PATH_INFO: `/v3/users/5b6b312c22ef43ec9d94fd8f35601c5a` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:47.185722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2630da2-c048-4e34-98d9-c4a0d1c93bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6b312c22ef43ec9d94fd8f35601c5a)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:47.188103 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2630da2-c048-4e34-98d9-c4a0d1c93bc4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:47.260171 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e2630da2-c048-4e34-98d9-c4a0d1c93bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6b312c22ef43ec9d94fd8f35601c5a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.260727 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e2630da2-c048-4e34-98d9-c4a0d1c93bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6b312c22ef43ec9d94fd8f35601c5a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.280892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e2630da2-c048-4e34-98d9-c4a0d1c93bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6b312c22ef43ec9d94fd8f35601c5a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.303484 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e2630da2-c048-4e34-98d9-c4a0d1c93bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6b312c22ef43ec9d94fd8f35601c5a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.304265 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e2630da2-c048-4e34-98d9-c4a0d1c93bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6b312c22ef43ec9d94fd8f35601c5a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.320651 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1403/2809] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:47 2022] DELETE /identity/v3/users/5b6b312c22ef43ec9d94fd8f35601c5a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:47.624108 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:47.625986 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:47.643064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e5493-af70-4f48-aea4-5331f007b79d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:47.681982 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:47.710545 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e41347-2480-41b2-ad7e-261ef12cb588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:47.711490 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e41347-2480-41b2-ad7e-261ef12cb588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:47.711773 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e41347-2480-41b2-ad7e-261ef12cb588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:47.712068 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e41347-2480-41b2-ad7e-261ef12cb588 admin admin] PATH_INFO: `/v3/projects/31e430473ef5499aa728d29a4865f1c9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:47.713283 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e41347-2480-41b2-ad7e-261ef12cb588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e430473ef5499aa728d29a4865f1c9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:47.715243 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e41347-2480-41b2-ad7e-261ef12cb588 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:47.769377 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-37e41347-2480-41b2-ad7e-261ef12cb588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e430473ef5499aa728d29a4865f1c9', 'request_id': 'req-37e41347-2480-41b2-ad7e-261ef12cb588'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.777847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-37e41347-2480-41b2-ad7e-261ef12cb588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e430473ef5499aa728d29a4865f1c9', 'request_id': 'req-37e41347-2480-41b2-ad7e-261ef12cb588'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.785069 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-37e41347-2480-41b2-ad7e-261ef12cb588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e430473ef5499aa728d29a4865f1c9', 'request_id': 'req-37e41347-2480-41b2-ad7e-261ef12cb588'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.801737 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-37e41347-2480-41b2-ad7e-261ef12cb588 admin admin] The token cache is being invalidate because project 31e430473ef5499aa728d29a4865f1c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:47.802039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-37e41347-2480-41b2-ad7e-261ef12cb588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.802750 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-37e41347-2480-41b2-ad7e-261ef12cb588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:47.804380 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1407/2810] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:47 2022] DELETE /identity/v3/projects/31e430473ef5499aa728d29a4865f1c9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:47.809760 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98443c2-f80f-410f-b880-2909450cfa80 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:47.810314 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98443c2-f80f-410f-b880-2909450cfa80 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:47.810544 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98443c2-f80f-410f-b880-2909450cfa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:47.835209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b98443c2-f80f-410f-b880-2909450cfa80 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:47.836616 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b98443c2-f80f-410f-b880-2909450cfa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:47.886549 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:47.907319 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1404/2811] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:47.915036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d6b34-7b9e-4bcb-9b7a-b19a153167a2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:47.915328 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d6b34-7b9e-4bcb-9b7a-b19a153167a2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:47.915996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d6b34-7b9e-4bcb-9b7a-b19a153167a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:47.938965 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a06d6b34-7b9e-4bcb-9b7a-b19a153167a2 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:47.940655 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a06d6b34-7b9e-4bcb-9b7a-b19a153167a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:47.950037 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1408/2812] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:47.954817 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98443c2-f80f-410f-b880-2909450cfa80 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:47.965212 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98443c2-f80f-410f-b880-2909450cfa80 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:47.971002 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d75291-f258-457f-bfe0-404a0b81898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:47.971657 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d75291-f258-457f-bfe0-404a0b81898d admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:47.971933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d75291-f258-457f-bfe0-404a0b81898d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:47.972200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d75291-f258-457f-bfe0-404a0b81898d admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:47.972941 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d75291-f258-457f-bfe0-404a0b81898d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:23:47.973256 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d75291-f258-457f-bfe0-404a0b81898d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:47.974902 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d75291-f258-457f-bfe0-404a0b81898d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:47.988432 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1405/2813] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:23:47.993302 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d6b34-7b9e-4bcb-9b7a-b19a153167a2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:48.003601 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d6b34-7b9e-4bcb-9b7a-b19a153167a2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:48.013381 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726b074-2d28-438d-8f46-51c063c9bb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:48.014120 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726b074-2d28-438d-8f46-51c063c9bb68 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:48.014775 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726b074-2d28-438d-8f46-51c063c9bb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:48.014775 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726b074-2d28-438d-8f46-51c063c9bb68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:48.015340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726b074-2d28-438d-8f46-51c063c9bb68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:48.017258 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726b074-2d28-438d-8f46-51c063c9bb68 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:48.048028 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1409/2814] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:23:47 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:48.052638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d75291-f258-457f-bfe0-404a0b81898d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:48.063744 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d75291-f258-457f-bfe0-404a0b81898d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:48.123205 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ad55e-3dc2-4a81-ac56-e68592c4592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:48.123924 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ad55e-3dc2-4a81-ac56-e68592c4592d admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:48.124166 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ad55e-3dc2-4a81-ac56-e68592c4592d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:48.124445 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ad55e-3dc2-4a81-ac56-e68592c4592d admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:48.125565 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ad55e-3dc2-4a81-ac56-e68592c4592d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:48.128225 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ad55e-3dc2-4a81-ac56-e68592c4592d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:48.150789 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1406/2815] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:23:48 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:48.156628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726b074-2d28-438d-8f46-51c063c9bb68 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:48.169578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726b074-2d28-438d-8f46-51c063c9bb68 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:48.174996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1eb980-35de-44bc-a6ca-0841f1808114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:48.175746 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eb980-35de-44bc-a6ca-0841f1808114 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:48.176139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eb980-35de-44bc-a6ca-0841f1808114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:48.176463 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eb980-35de-44bc-a6ca-0841f1808114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:48.177343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1eb980-35de-44bc-a6ca-0841f1808114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:48.179259 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1eb980-35de-44bc-a6ca-0841f1808114 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:48.192196 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1410/2816] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:48.196905 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ad55e-3dc2-4a81-ac56-e68592c4592d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:48.210044 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ad55e-3dc2-4a81-ac56-e68592c4592d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:48.214897 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6ac7e-9c0a-4d9f-bfb9-9b0e5fad1ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:48.215604 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6ac7e-9c0a-4d9f-bfb9-9b0e5fad1ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:48.215877 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6ac7e-9c0a-4d9f-bfb9-9b0e5fad1ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:48.216243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6ac7e-9c0a-4d9f-bfb9-9b0e5fad1ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:48.216908 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6ac7e-9c0a-4d9f-bfb9-9b0e5fad1ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:48.220723 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6ac7e-9c0a-4d9f-bfb9-9b0e5fad1ce1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:48.231018 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1407/2817] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:48.235988 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1eb980-35de-44bc-a6ca-0841f1808114 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:48.248509 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1eb980-35de-44bc-a6ca-0841f1808114 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:48.254213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799eea1-d174-4276-9e4f-ae394ffd2b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:48.255179 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799eea1-d174-4276-9e4f-ae394ffd2b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:48.255464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799eea1-d174-4276-9e4f-ae394ffd2b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:48.255746 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799eea1-d174-4276-9e4f-ae394ffd2b87 admin admin] PATH_INFO: `/v3/projects/d0c16dab5ea64623806b40e015cfcdbd/users/13c5eb4ccb244d679d8e4f6b491ddf7e/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:48.272830 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799eea1-d174-4276-9e4f-ae394ffd2b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c16dab5ea64623806b40e015cfcdbd, user_id=13c5eb4ccb244d679d8e4f6b491ddf7e, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:48.275572 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799eea1-d174-4276-9e4f-ae394ffd2b87 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:48.291978 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1411/2818] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:48 2022] PUT /identity/v3/projects/d0c16dab5ea64623806b40e015cfcdbd/users/13c5eb4ccb244d679d8e4f6b491ddf7e/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:48.312014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdebfea-4914-4552-ae63-71bf197f9879 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:48.312479 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdebfea-4914-4552-ae63-71bf197f9879 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:48.313113 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdebfea-4914-4552-ae63-71bf197f9879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:48.349636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-6cdebfea-4914-4552-ae63-71bf197f9879 None None] MFA Rules not processed for user `13c5eb4ccb244d679d8e4f6b491ddf7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:48.351801 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6cdebfea-4914-4552-ae63-71bf197f9879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:48.447402 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1408/2819] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:23:48.452236 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799eea1-d174-4276-9e4f-ae394ffd2b87 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:48.552704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799eea1-d174-4276-9e4f-ae394ffd2b87 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:48.561288 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c48ea-9fd7-490c-8619-2d68b0264b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:48.561288 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c48ea-9fd7-490c-8619-2d68b0264b6a admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:48.561288 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c48ea-9fd7-490c-8619-2d68b0264b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:48.561628 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c48ea-9fd7-490c-8619-2d68b0264b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:48.562114 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c48ea-9fd7-490c-8619-2d68b0264b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:48.564800 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c48ea-9fd7-490c-8619-2d68b0264b6a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:48.572346 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:48.610705 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1412/2820] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:23:48 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:23:48.615254 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdebfea-4914-4552-ae63-71bf197f9879 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:48.628797 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdebfea-4914-4552-ae63-71bf197f9879 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:48.690464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:48.724997 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b054dd-b5e5-479b-b831-dc92e328fd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:48.725957 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b054dd-b5e5-479b-b831-dc92e328fd06 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:48.727350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b054dd-b5e5-479b-b831-dc92e328fd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:48.727650 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b054dd-b5e5-479b-b831-dc92e328fd06 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:48.728732 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b054dd-b5e5-479b-b831-dc92e328fd06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:48.731039 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b054dd-b5e5-479b-b831-dc92e328fd06 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:48.764639 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1409/2821] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:23:48 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 12:23:48.776753 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c48ea-9fd7-490c-8619-2d68b0264b6a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:48.793238 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c48ea-9fd7-490c-8619-2d68b0264b6a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:48.801008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae3eb3-eadf-4eb3-9c80-ef68d14d70df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:48.802092 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3eb3-eadf-4eb3-9c80-ef68d14d70df admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:48.802526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3eb3-eadf-4eb3-9c80-ef68d14d70df admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:48.802990 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3eb3-eadf-4eb3-9c80-ef68d14d70df admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:48.804042 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae3eb3-eadf-4eb3-9c80-ef68d14d70df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:48.806352 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae3eb3-eadf-4eb3-9c80-ef68d14d70df admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:48.818949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1413/2822] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:48.824673 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b054dd-b5e5-479b-b831-dc92e328fd06 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:48.839717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b054dd-b5e5-479b-b831-dc92e328fd06 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:48.844771 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4922e-e654-4c3b-bb18-6c1ccb393029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:48.845708 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4922e-e654-4c3b-bb18-6c1ccb393029 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:48.846027 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4922e-e654-4c3b-bb18-6c1ccb393029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:48.846300 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4922e-e654-4c3b-bb18-6c1ccb393029 admin admin] PATH_INFO: `/v3/projects/12fff263accd41c085a831b66d589609/users/b8daa42a4a2a4b17bcc2e80415208fed/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:48.868237 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4922e-e654-4c3b-bb18-6c1ccb393029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12fff263accd41c085a831b66d589609, user_id=b8daa42a4a2a4b17bcc2e80415208fed, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:48.871123 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4922e-e654-4c3b-bb18-6c1ccb393029 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:48.886595 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1410/2823] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:48 2022] PUT /identity/v3/projects/12fff263accd41c085a831b66d589609/users/b8daa42a4a2a4b17bcc2e80415208fed/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:48.891344 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae3eb3-eadf-4eb3-9c80-ef68d14d70df admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:48.904316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae3eb3-eadf-4eb3-9c80-ef68d14d70df admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:48.966489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3145f-6ccf-4293-a56c-9b231bd7ca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:48.967146 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3145f-6ccf-4293-a56c-9b231bd7ca73 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:48.967432 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3145f-6ccf-4293-a56c-9b231bd7ca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:48.967721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3145f-6ccf-4293-a56c-9b231bd7ca73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:48.968464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3145f-6ccf-4293-a56c-9b231bd7ca73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:48.970168 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3145f-6ccf-4293-a56c-9b231bd7ca73 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:48.981213 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1414/2824] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:23:48.986081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4922e-e654-4c3b-bb18-6c1ccb393029 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:48.996978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4922e-e654-4c3b-bb18-6c1ccb393029 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:49.002052 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89872e13-0db7-448f-8aae-b42a7eacb35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:49.003004 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89872e13-0db7-448f-8aae-b42a7eacb35d admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:49.003435 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89872e13-0db7-448f-8aae-b42a7eacb35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:49.003703 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89872e13-0db7-448f-8aae-b42a7eacb35d admin admin] PATH_INFO: `/v3/projects/12fff263accd41c085a831b66d589609/users/b8daa42a4a2a4b17bcc2e80415208fed/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:49.005760 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89872e13-0db7-448f-8aae-b42a7eacb35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12fff263accd41c085a831b66d589609, user_id=b8daa42a4a2a4b17bcc2e80415208fed, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:49.008562 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89872e13-0db7-448f-8aae-b42a7eacb35d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:49.022120 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1411/2825] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:23:48 2022] PUT /identity/v3/projects/12fff263accd41c085a831b66d589609/users/b8daa42a4a2a4b17bcc2e80415208fed/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:23:49.033072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52095ff9-2903-4579-9c12-539de77caf75 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:49.033699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52095ff9-2903-4579-9c12-539de77caf75 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:49.033699 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52095ff9-2903-4579-9c12-539de77caf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:49.068322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-52095ff9-2903-4579-9c12-539de77caf75 None None] MFA Rules not processed for user `b8daa42a4a2a4b17bcc2e80415208fed`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:49.069647 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-52095ff9-2903-4579-9c12-539de77caf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:49.148526 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1415/2826] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:23:49.161626 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89872e13-0db7-448f-8aae-b42a7eacb35d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:49.163504 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-89872e13-0db7-448f-8aae-b42a7eacb35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:49.231717 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89872e13-0db7-448f-8aae-b42a7eacb35d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:49.235467 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7797c8-5580-4d68-acc2-315a6bd8e166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:49.236125 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7797c8-5580-4d68-acc2-315a6bd8e166 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:49.236407 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7797c8-5580-4d68-acc2-315a6bd8e166 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:49.236682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7797c8-5580-4d68-acc2-315a6bd8e166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:49.296345 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7797c8-5580-4d68-acc2-315a6bd8e166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:49.297890 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7797c8-5580-4d68-acc2-315a6bd8e166 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:49.308807 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1412/2827] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:23:53.724372 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52095ff9-2903-4579-9c12-539de77caf75 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:53.725860 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-52095ff9-2903-4579-9c12-539de77caf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:53.737199 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7797c8-5580-4d68-acc2-315a6bd8e166 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:53.738888 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8e7797c8-5580-4d68-acc2-315a6bd8e166 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:53.742738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52095ff9-2903-4579-9c12-539de77caf75 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:53.747765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be6ae7-cc3d-4cb0-9f50-b5889748af91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:53.748360 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be6ae7-cc3d-4cb0-9f50-b5889748af91 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:53.748648 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be6ae7-cc3d-4cb0-9f50-b5889748af91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:53.748927 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be6ae7-cc3d-4cb0-9f50-b5889748af91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:53.762585 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be6ae7-cc3d-4cb0-9f50-b5889748af91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:53.764102 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be6ae7-cc3d-4cb0-9f50-b5889748af91 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:53.775961 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1416/2828] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:53.814239 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:53.817472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be6ae7-cc3d-4cb0-9f50-b5889748af91 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:53.818841 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-78be6ae7-cc3d-4cb0-9f50-b5889748af91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:53.864163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7797c8-5580-4d68-acc2-315a6bd8e166 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:53.871327 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbe690-15c6-493c-8506-6cdf1bcbb48d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06c172bcd99f469f83728c98d061a7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:53.872483 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbe690-15c6-493c-8506-6cdf1bcbb48d service placement] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:53.872827 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbe690-15c6-493c-8506-6cdf1bcbb48d service placement] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:53.873110 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbe690-15c6-493c-8506-6cdf1bcbb48d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:53.875433 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cecbe690-15c6-493c-8506-6cdf1bcbb48d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:53.878065 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:53.894682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbe690-15c6-493c-8506-6cdf1bcbb48d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:53.896636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbe690-15c6-493c-8506-6cdf1bcbb48d service placement] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:53.906202 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be6ae7-cc3d-4cb0-9f50-b5889748af91 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:53.909678 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1413/2829] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:53.918483 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed214c7a-0250-45dd-a292-843b46e9b19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:53.919505 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed214c7a-0250-45dd-a292-843b46e9b19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:53.920007 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed214c7a-0250-45dd-a292-843b46e9b19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:53.920343 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed214c7a-0250-45dd-a292-843b46e9b19d admin admin] PATH_INFO: `/v3/users/9cad08b5d46a4fce898e8978f1e84edb` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:53.921914 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed214c7a-0250-45dd-a292-843b46e9b19d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cad08b5d46a4fce898e8978f1e84edb)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:53.928017 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed214c7a-0250-45dd-a292-843b46e9b19d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:53.999439 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ed214c7a-0250-45dd-a292-843b46e9b19d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cad08b5d46a4fce898e8978f1e84edb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:54.009238 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ed214c7a-0250-45dd-a292-843b46e9b19d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cad08b5d46a4fce898e8978f1e84edb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:54.010036 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ed214c7a-0250-45dd-a292-843b46e9b19d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cad08b5d46a4fce898e8978f1e84edb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:54.024987 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ed214c7a-0250-45dd-a292-843b46e9b19d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cad08b5d46a4fce898e8978f1e84edb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:54.025887 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ed214c7a-0250-45dd-a292-843b46e9b19d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cad08b5d46a4fce898e8978f1e84edb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:54.045470 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1417/2830] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:53 2022] DELETE /identity/v3/users/9cad08b5d46a4fce898e8978f1e84edb => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:54.260879 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbe690-15c6-493c-8506-6cdf1bcbb48d service placement] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:54.284203 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbe690-15c6-493c-8506-6cdf1bcbb48d service placement] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:54.358536 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8dd92-0e6c-44ea-8649-06c9d587a766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:54.359786 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8dd92-0e6c-44ea-8649-06c9d587a766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:54.360074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8dd92-0e6c-44ea-8649-06c9d587a766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:54.360350 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8dd92-0e6c-44ea-8649-06c9d587a766 admin admin] PATH_INFO: `/v3/projects/394590a1bfdc474e9ff2cb1bf2d69f0d` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:54.361547 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8dd92-0e6c-44ea-8649-06c9d587a766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=394590a1bfdc474e9ff2cb1bf2d69f0d)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:54.363463 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8dd92-0e6c-44ea-8649-06c9d587a766 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:54.414606 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2bb8dd92-0e6c-44ea-8649-06c9d587a766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394590a1bfdc474e9ff2cb1bf2d69f0d', 'request_id': 'req-2bb8dd92-0e6c-44ea-8649-06c9d587a766'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:54.423749 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2bb8dd92-0e6c-44ea-8649-06c9d587a766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394590a1bfdc474e9ff2cb1bf2d69f0d', 'request_id': 'req-2bb8dd92-0e6c-44ea-8649-06c9d587a766'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:54.429568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2bb8dd92-0e6c-44ea-8649-06c9d587a766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394590a1bfdc474e9ff2cb1bf2d69f0d', 'request_id': 'req-2bb8dd92-0e6c-44ea-8649-06c9d587a766'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:54.440919 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2bb8dd92-0e6c-44ea-8649-06c9d587a766 admin admin] The token cache is being invalidate because project 394590a1bfdc474e9ff2cb1bf2d69f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:54.441204 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2bb8dd92-0e6c-44ea-8649-06c9d587a766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:54.441826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2bb8dd92-0e6c-44ea-8649-06c9d587a766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:54.443414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1414/2831] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:54 2022] DELETE /identity/v3/projects/394590a1bfdc474e9ff2cb1bf2d69f0d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:58.788742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed214c7a-0250-45dd-a292-843b46e9b19d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:58.790598 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ed214c7a-0250-45dd-a292-843b46e9b19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:58.804460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed214c7a-0250-45dd-a292-843b46e9b19d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:58.867493 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5be6a-8237-4c64-8c3d-35a76f40f96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:58.868842 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5be6a-8237-4c64-8c3d-35a76f40f96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:58.869301 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5be6a-8237-4c64-8c3d-35a76f40f96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:58.869743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5be6a-8237-4c64-8c3d-35a76f40f96b admin admin] PATH_INFO: `/v3/users/13c5eb4ccb244d679d8e4f6b491ddf7e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:58.871895 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5be6a-8237-4c64-8c3d-35a76f40f96b admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c5eb4ccb244d679d8e4f6b491ddf7e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:58.874843 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5be6a-8237-4c64-8c3d-35a76f40f96b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:58.936018 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6aa5be6a-8237-4c64-8c3d-35a76f40f96b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c5eb4ccb244d679d8e4f6b491ddf7e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:58.943062 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6aa5be6a-8237-4c64-8c3d-35a76f40f96b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c5eb4ccb244d679d8e4f6b491ddf7e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:58.943753 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6aa5be6a-8237-4c64-8c3d-35a76f40f96b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c5eb4ccb244d679d8e4f6b491ddf7e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:58.950666 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:58.958020 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6aa5be6a-8237-4c64-8c3d-35a76f40f96b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c5eb4ccb244d679d8e4f6b491ddf7e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:58.958931 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6aa5be6a-8237-4c64-8c3d-35a76f40f96b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c5eb4ccb244d679d8e4f6b491ddf7e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:58.974521 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1418/2832] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:58 2022] DELETE /identity/v3/users/13c5eb4ccb244d679d8e4f6b491ddf7e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:58.979426 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56001b-afb1-4550-bdc4-f4635554ce42 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:58.980024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56001b-afb1-4550-bdc4-f4635554ce42 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:58.980024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56001b-afb1-4550-bdc4-f4635554ce42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:58.997882 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9d56001b-afb1-4550-bdc4-f4635554ce42 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:23:58.999191 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9d56001b-afb1-4550-bdc4-f4635554ce42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:59.045547 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:59.063211 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1415/2833] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:23:59.073233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5be6a-8237-4c64-8c3d-35a76f40f96b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:59.074877 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6aa5be6a-8237-4c64-8c3d-35a76f40f96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:59.176351 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5be6a-8237-4c64-8c3d-35a76f40f96b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:59.180468 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6487e-ed1c-4e31-a999-f609f7cfed84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:59.181266 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6487e-ed1c-4e31-a999-f609f7cfed84 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:59.181638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6487e-ed1c-4e31-a999-f609f7cfed84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:59.182010 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6487e-ed1c-4e31-a999-f609f7cfed84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:59.193672 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6487e-ed1c-4e31-a999-f609f7cfed84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:59.195232 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6487e-ed1c-4e31-a999-f609f7cfed84 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:59.207856 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1419/2834] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:23:59.530868 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56001b-afb1-4550-bdc4-f4635554ce42 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:59.532632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9d56001b-afb1-4550-bdc4-f4635554ce42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:23:59.546550 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56001b-afb1-4550-bdc4-f4635554ce42 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:59.552352 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:59.553299 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:59.553694 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:59.553912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] PATH_INFO: `/v3/projects/d0c16dab5ea64623806b40e015cfcdbd` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:59.555330 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c16dab5ea64623806b40e015cfcdbd)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:59.557317 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:59.615235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c16dab5ea64623806b40e015cfcdbd', 'request_id': 'req-0657722c-308c-4774-bd48-881e6f17c947'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:59.628756 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c16dab5ea64623806b40e015cfcdbd', 'request_id': 'req-0657722c-308c-4774-bd48-881e6f17c947'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:59.636195 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c16dab5ea64623806b40e015cfcdbd', 'request_id': 'req-0657722c-308c-4774-bd48-881e6f17c947'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:59.653641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] The token cache is being invalidate because project d0c16dab5ea64623806b40e015cfcdbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:23:59.653895 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:59.654543 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:59.656139 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1416/2835] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:23:59 2022] DELETE /identity/v3/projects/d0c16dab5ea64623806b40e015cfcdbd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:23:59.660188 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6487e-ed1c-4e31-a999-f609f7cfed84 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:23:59.672001 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6487e-ed1c-4e31-a999-f609f7cfed84 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:23:59.736366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61722f32-9153-4c88-a275-6ea40a3c47f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:23:59.737319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61722f32-9153-4c88-a275-6ea40a3c47f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:23:59.737703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61722f32-9153-4c88-a275-6ea40a3c47f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:23:59.738071 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61722f32-9153-4c88-a275-6ea40a3c47f1 admin admin] PATH_INFO: `/v3/users/b8daa42a4a2a4b17bcc2e80415208fed` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:23:59.739178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61722f32-9153-4c88-a275-6ea40a3c47f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8daa42a4a2a4b17bcc2e80415208fed)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:23:59.741103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61722f32-9153-4c88-a275-6ea40a3c47f1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:23:59.796418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-61722f32-9153-4c88-a275-6ea40a3c47f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8daa42a4a2a4b17bcc2e80415208fed'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:59.805767 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-61722f32-9153-4c88-a275-6ea40a3c47f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8daa42a4a2a4b17bcc2e80415208fed'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:59.806532 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-61722f32-9153-4c88-a275-6ea40a3c47f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8daa42a4a2a4b17bcc2e80415208fed'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:59.819270 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:23:59.827428 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-61722f32-9153-4c88-a275-6ea40a3c47f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8daa42a4a2a4b17bcc2e80415208fed'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:59.828253 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-61722f32-9153-4c88-a275-6ea40a3c47f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8daa42a4a2a4b17bcc2e80415208fed'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:23:59.845103 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1420/2836] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:23:59 2022] DELETE /identity/v3/users/b8daa42a4a2a4b17bcc2e80415208fed => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:24:00.152341 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:00.153912 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:00.170163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657722c-308c-4774-bd48-881e6f17c947 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:00.260458 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e768b-9231-436a-8c9f-1474dfec9b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:00.261252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e768b-9231-436a-8c9f-1474dfec9b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:00.261535 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e768b-9231-436a-8c9f-1474dfec9b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:00.262975 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e768b-9231-436a-8c9f-1474dfec9b32 admin admin] PATH_INFO: `/v3/projects/12fff263accd41c085a831b66d589609` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:00.264601 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e768b-9231-436a-8c9f-1474dfec9b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12fff263accd41c085a831b66d589609)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:00.266965 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e768b-9231-436a-8c9f-1474dfec9b32 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:00.325454 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-587e768b-9231-436a-8c9f-1474dfec9b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12fff263accd41c085a831b66d589609', 'request_id': 'req-587e768b-9231-436a-8c9f-1474dfec9b32'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:00.334058 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-587e768b-9231-436a-8c9f-1474dfec9b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12fff263accd41c085a831b66d589609', 'request_id': 'req-587e768b-9231-436a-8c9f-1474dfec9b32'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:00.341026 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-587e768b-9231-436a-8c9f-1474dfec9b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12fff263accd41c085a831b66d589609', 'request_id': 'req-587e768b-9231-436a-8c9f-1474dfec9b32'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:00.353636 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-587e768b-9231-436a-8c9f-1474dfec9b32 admin admin] The token cache is being invalidate because project 12fff263accd41c085a831b66d589609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:24:00.353922 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-587e768b-9231-436a-8c9f-1474dfec9b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:00.354615 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-587e768b-9231-436a-8c9f-1474dfec9b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:00.356271 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1417/2837] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:24:00 2022] DELETE /identity/v3/projects/12fff263accd41c085a831b66d589609 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:24:00.362634 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f9b68-43de-4f60-9a2a-0ae46221bb30 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:00.363034 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f9b68-43de-4f60-9a2a-0ae46221bb30 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:00.363397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f9b68-43de-4f60-9a2a-0ae46221bb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:00.384518 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9b4f9b68-43de-4f60-9a2a-0ae46221bb30 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:00.385869 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9b4f9b68-43de-4f60-9a2a-0ae46221bb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:00.453121 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1421/2838] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 12:24:00.463456 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbe5ea-50f7-4dca-9686-49998ce52d67 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:00.463808 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbe5ea-50f7-4dca-9686-49998ce52d67 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:00.464080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbe5ea-50f7-4dca-9686-49998ce52d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:00.472723 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:24:00.486794 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fcfbe5ea-50f7-4dca-9686-49998ce52d67 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:00.488873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fcfbe5ea-50f7-4dca-9686-49998ce52d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:00.497682 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1418/2839] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:00.502173 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f9b68-43de-4f60-9a2a-0ae46221bb30 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:00.512805 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f9b68-43de-4f60-9a2a-0ae46221bb30 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:00.518751 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9badbf-742d-494b-b045-0799d27a7a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:00.519429 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9badbf-742d-494b-b045-0799d27a7a99 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:00.519977 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9badbf-742d-494b-b045-0799d27a7a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:00.520296 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9badbf-742d-494b-b045-0799d27a7a99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:00.521172 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9badbf-742d-494b-b045-0799d27a7a99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:24:00.521492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9badbf-742d-494b-b045-0799d27a7a99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:00.523192 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9badbf-742d-494b-b045-0799d27a7a99 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:00.536940 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1422/2840] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 12:24:00.541969 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbe5ea-50f7-4dca-9686-49998ce52d67 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:00.553216 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbe5ea-50f7-4dca-9686-49998ce52d67 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:00.558325 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e9941-6125-4e50-aaf0-7063220b3ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:00.559024 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e9941-6125-4e50-aaf0-7063220b3ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:00.559307 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e9941-6125-4e50-aaf0-7063220b3ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:00.559569 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e9941-6125-4e50-aaf0-7063220b3ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:00.560313 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e9941-6125-4e50-aaf0-7063220b3ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:00.562229 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e9941-6125-4e50-aaf0-7063220b3ca5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:00.593880 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1419/2841] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:24:00 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:24:00.598472 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9badbf-742d-494b-b045-0799d27a7a99 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:00.611139 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9badbf-742d-494b-b045-0799d27a7a99 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:00.677356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408c37-fb76-40b4-b1d4-a966b9a6816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:00.678181 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408c37-fb76-40b4-b1d4-a966b9a6816d admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:00.678410 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408c37-fb76-40b4-b1d4-a966b9a6816d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:00.678760 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408c37-fb76-40b4-b1d4-a966b9a6816d admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:00.679973 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa408c37-fb76-40b4-b1d4-a966b9a6816d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:00.681972 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa408c37-fb76-40b4-b1d4-a966b9a6816d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:00.709837 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1423/2842] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:24:00 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:24:00.714356 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e9941-6125-4e50-aaf0-7063220b3ca5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:00.733487 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e9941-6125-4e50-aaf0-7063220b3ca5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:00.741714 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922df0da-e8af-4b83-8b9d-09c170f795d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:00.742876 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922df0da-e8af-4b83-8b9d-09c170f795d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:00.743377 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922df0da-e8af-4b83-8b9d-09c170f795d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:00.743876 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922df0da-e8af-4b83-8b9d-09c170f795d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:00.745227 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922df0da-e8af-4b83-8b9d-09c170f795d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:00.748228 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922df0da-e8af-4b83-8b9d-09c170f795d1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:00.768508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1420/2843] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:24:00.773489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408c37-fb76-40b4-b1d4-a966b9a6816d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:00.784468 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408c37-fb76-40b4-b1d4-a966b9a6816d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:00.789826 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4725659-3d57-4de4-a760-2d708136ca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:00.791048 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4725659-3d57-4de4-a760-2d708136ca67 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:00.791333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4725659-3d57-4de4-a760-2d708136ca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:00.791761 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4725659-3d57-4de4-a760-2d708136ca67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:00.792689 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4725659-3d57-4de4-a760-2d708136ca67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:00.794461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4725659-3d57-4de4-a760-2d708136ca67 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:00.807514 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1424/2844] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:24:00.812584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922df0da-e8af-4b83-8b9d-09c170f795d1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:00.823978 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922df0da-e8af-4b83-8b9d-09c170f795d1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:00.829624 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d95279-aae8-45d6-b6e2-fe172d1e96d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:00.830538 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d95279-aae8-45d6-b6e2-fe172d1e96d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:00.830849 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d95279-aae8-45d6-b6e2-fe172d1e96d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:00.831107 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d95279-aae8-45d6-b6e2-fe172d1e96d0 admin admin] PATH_INFO: `/v3/projects/f5b05b505138493b9dd181dc7b2dd2e3/users/db5b15add04b41d2ac1e26ca47c9aeab/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:00.846848 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d95279-aae8-45d6-b6e2-fe172d1e96d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b05b505138493b9dd181dc7b2dd2e3, user_id=db5b15add04b41d2ac1e26ca47c9aeab, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:00.849459 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d95279-aae8-45d6-b6e2-fe172d1e96d0 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:00.864929 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1421/2845] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:24:00 2022] PUT /identity/v3/projects/f5b05b505138493b9dd181dc7b2dd2e3/users/db5b15add04b41d2ac1e26ca47c9aeab/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:24:00.936171 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b20f-5303-4385-99d0-889162537675 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:00.936578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b20f-5303-4385-99d0-889162537675 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:00.937051 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b20f-5303-4385-99d0-889162537675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:00.967623 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a260b20f-5303-4385-99d0-889162537675 None None] MFA Rules not processed for user `db5b15add04b41d2ac1e26ca47c9aeab`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:00.969520 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a260b20f-5303-4385-99d0-889162537675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:01.023269 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:24:01.058529 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1425/2846] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:01.069961 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d95279-aae8-45d6-b6e2-fe172d1e96d0 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:01.071750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-26d95279-aae8-45d6-b6e2-fe172d1e96d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:01.155160 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d95279-aae8-45d6-b6e2-fe172d1e96d0 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:01.159942 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533217c-3d03-463e-8c45-86173c30edd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:01.160605 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533217c-3d03-463e-8c45-86173c30edd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:01.160891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533217c-3d03-463e-8c45-86173c30edd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:01.161265 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533217c-3d03-463e-8c45-86173c30edd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:01.171588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533217c-3d03-463e-8c45-86173c30edd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:01.173011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533217c-3d03-463e-8c45-86173c30edd6 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:01.182599 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1422/2847] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:24:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:24:06.691703 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b20f-5303-4385-99d0-889162537675 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:06.762244 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b20f-5303-4385-99d0-889162537675 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:06.767622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b698a2a-e87b-4b28-9722-ea1c7959f739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:06.768544 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b698a2a-e87b-4b28-9722-ea1c7959f739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:06.768834 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b698a2a-e87b-4b28-9722-ea1c7959f739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:06.769111 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b698a2a-e87b-4b28-9722-ea1c7959f739 admin admin] PATH_INFO: `/v3/users/db5b15add04b41d2ac1e26ca47c9aeab` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:06.770433 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b698a2a-e87b-4b28-9722-ea1c7959f739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5b15add04b41d2ac1e26ca47c9aeab)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:06.772461 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b698a2a-e87b-4b28-9722-ea1c7959f739 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:06.827807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1b698a2a-e87b-4b28-9722-ea1c7959f739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5b15add04b41d2ac1e26ca47c9aeab'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:06.835583 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1b698a2a-e87b-4b28-9722-ea1c7959f739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5b15add04b41d2ac1e26ca47c9aeab'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:06.836347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1b698a2a-e87b-4b28-9722-ea1c7959f739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5b15add04b41d2ac1e26ca47c9aeab'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:06.848685 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1b698a2a-e87b-4b28-9722-ea1c7959f739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5b15add04b41d2ac1e26ca47c9aeab'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:06.849280 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1b698a2a-e87b-4b28-9722-ea1c7959f739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5b15add04b41d2ac1e26ca47c9aeab'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:06.865305 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1426/2848] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:24:06 2022] DELETE /identity/v3/users/db5b15add04b41d2ac1e26ca47c9aeab => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:24:06.871242 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cac4d-53ff-4f9f-adc8-aaa74befa468 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:06.871743 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cac4d-53ff-4f9f-adc8-aaa74befa468 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:06.871861 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cac4d-53ff-4f9f-adc8-aaa74befa468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:06.891655 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-503cac4d-53ff-4f9f-adc8-aaa74befa468 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:06.892883 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-503cac4d-53ff-4f9f-adc8-aaa74befa468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:06.958785 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1423/2849] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:06.968726 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b698a2a-e87b-4b28-9722-ea1c7959f739 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:06.970385 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1b698a2a-e87b-4b28-9722-ea1c7959f739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:07.029587 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b698a2a-e87b-4b28-9722-ea1c7959f739 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:07.033287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b3d02-916e-4a6c-8a7e-2f9c05005e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:07.033951 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b3d02-916e-4a6c-8a7e-2f9c05005e6e service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:07.034219 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b3d02-916e-4a6c-8a7e-2f9c05005e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:07.034501 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b3d02-916e-4a6c-8a7e-2f9c05005e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:07.044145 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b3d02-916e-4a6c-8a7e-2f9c05005e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:07.045556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b3d02-916e-4a6c-8a7e-2f9c05005e6e service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:07.055540 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1427/2850] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:24:07.348603 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cac4d-53ff-4f9f-adc8-aaa74befa468 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:07.350161 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-503cac4d-53ff-4f9f-adc8-aaa74befa468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:07.363635 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cac4d-53ff-4f9f-adc8-aaa74befa468 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:07.369724 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76834aa7-c256-4986-9152-e2d646b727b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:07.370710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834aa7-c256-4986-9152-e2d646b727b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:07.371001 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834aa7-c256-4986-9152-e2d646b727b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:07.371276 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834aa7-c256-4986-9152-e2d646b727b3 admin admin] PATH_INFO: `/v3/projects/f5b05b505138493b9dd181dc7b2dd2e3` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:07.372664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76834aa7-c256-4986-9152-e2d646b727b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b05b505138493b9dd181dc7b2dd2e3)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:07.374621 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76834aa7-c256-4986-9152-e2d646b727b3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:07.398207 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:24:07.428042 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-76834aa7-c256-4986-9152-e2d646b727b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b05b505138493b9dd181dc7b2dd2e3', 'request_id': 'req-76834aa7-c256-4986-9152-e2d646b727b3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:07.436638 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-76834aa7-c256-4986-9152-e2d646b727b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b05b505138493b9dd181dc7b2dd2e3', 'request_id': 'req-76834aa7-c256-4986-9152-e2d646b727b3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:07.442167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-76834aa7-c256-4986-9152-e2d646b727b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b05b505138493b9dd181dc7b2dd2e3', 'request_id': 'req-76834aa7-c256-4986-9152-e2d646b727b3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:07.454444 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-76834aa7-c256-4986-9152-e2d646b727b3 admin admin] The token cache is being invalidate because project f5b05b505138493b9dd181dc7b2dd2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:24:07.454763 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-76834aa7-c256-4986-9152-e2d646b727b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:07.455532 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-76834aa7-c256-4986-9152-e2d646b727b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:07.457252 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1424/2851] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:24:07 2022] DELETE /identity/v3/projects/f5b05b505138493b9dd181dc7b2dd2e3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:24:07.464349 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250db023-0081-432b-bc00-6c6a5e27954d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:07.465490 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250db023-0081-432b-bc00-6c6a5e27954d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:07.465490 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250db023-0081-432b-bc00-6c6a5e27954d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:07.471882 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:24:07.486362 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-250db023-0081-432b-bc00-6c6a5e27954d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:07.487581 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-250db023-0081-432b-bc00-6c6a5e27954d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:07.548048 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1428/2852] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:07.556215 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff3a11-c645-46bc-ad76-fe3930c95f44 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:07.556505 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff3a11-c645-46bc-ad76-fe3930c95f44 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:07.556779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff3a11-c645-46bc-ad76-fe3930c95f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:07.577540 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-6dff3a11-c645-46bc-ad76-fe3930c95f44 None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:07.578778 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6dff3a11-c645-46bc-ad76-fe3930c95f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:07.588640 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1425/2853] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:07.593694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250db023-0081-432b-bc00-6c6a5e27954d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:07.605859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250db023-0081-432b-bc00-6c6a5e27954d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:07.611184 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dda2f-9b35-491a-b890-ae4f32fff3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:07.612033 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dda2f-9b35-491a-b890-ae4f32fff3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:07.612316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dda2f-9b35-491a-b890-ae4f32fff3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:07.612654 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dda2f-9b35-491a-b890-ae4f32fff3b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:07.613665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dda2f-9b35-491a-b890-ae4f32fff3b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:24:07.613974 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dda2f-9b35-491a-b890-ae4f32fff3b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:07.616252 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dda2f-9b35-491a-b890-ae4f32fff3b9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:07.632122 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1429/2854] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:24:07.637102 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff3a11-c645-46bc-ad76-fe3930c95f44 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:07.647011 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff3a11-c645-46bc-ad76-fe3930c95f44 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:07.652329 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83a9a0-4831-46a8-8a40-0c00bc395eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:07.653053 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a9a0-4831-46a8-8a40-0c00bc395eab admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:07.653331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a9a0-4831-46a8-8a40-0c00bc395eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:07.653607 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a9a0-4831-46a8-8a40-0c00bc395eab admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:07.654328 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83a9a0-4831-46a8-8a40-0c00bc395eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:07.656301 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83a9a0-4831-46a8-8a40-0c00bc395eab admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:07.694559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1426/2855] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:24:07 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:24:07.699330 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dda2f-9b35-491a-b890-ae4f32fff3b9 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:07.710237 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dda2f-9b35-491a-b890-ae4f32fff3b9 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:07.773772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51cd5c-7c02-42a4-ac9f-12ef1925c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:07.774473 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51cd5c-7c02-42a4-ac9f-12ef1925c803 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:07.774796 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51cd5c-7c02-42a4-ac9f-12ef1925c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:07.775082 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51cd5c-7c02-42a4-ac9f-12ef1925c803 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:07.775809 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51cd5c-7c02-42a4-ac9f-12ef1925c803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:07.777742 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51cd5c-7c02-42a4-ac9f-12ef1925c803 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:07.803938 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1430/2856] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:24:07 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:24:07.805596 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83a9a0-4831-46a8-8a40-0c00bc395eab admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:07.817167 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83a9a0-4831-46a8-8a40-0c00bc395eab admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:07.822836 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1a445-fcc4-4341-9b27-03baa4c2815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:07.823530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1a445-fcc4-4341-9b27-03baa4c2815c admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:07.823810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1a445-fcc4-4341-9b27-03baa4c2815c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:07.824079 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1a445-fcc4-4341-9b27-03baa4c2815c admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:07.824819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1a445-fcc4-4341-9b27-03baa4c2815c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:07.826438 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1a445-fcc4-4341-9b27-03baa4c2815c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:07.838521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1427/2857] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:24:07.843043 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51cd5c-7c02-42a4-ac9f-12ef1925c803 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:07.854298 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51cd5c-7c02-42a4-ac9f-12ef1925c803 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:07.860118 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442a420-d38f-4200-ba80-adf4be116c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:07.860805 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442a420-d38f-4200-ba80-adf4be116c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:07.861086 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442a420-d38f-4200-ba80-adf4be116c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:07.861356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442a420-d38f-4200-ba80-adf4be116c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:07.862093 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442a420-d38f-4200-ba80-adf4be116c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:07.863730 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442a420-d38f-4200-ba80-adf4be116c40 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:07.875602 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1431/2858] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:24:07.880667 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1a445-fcc4-4341-9b27-03baa4c2815c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:07.891187 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1a445-fcc4-4341-9b27-03baa4c2815c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:07.896209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34d03a-afa7-425c-8756-743e90941d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:07.900530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34d03a-afa7-425c-8756-743e90941d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:07.900530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34d03a-afa7-425c-8756-743e90941d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:07.900530 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34d03a-afa7-425c-8756-743e90941d4a admin admin] PATH_INFO: `/v3/projects/85baca47f92c4bf49cd7662a2200580d/users/2bb36024a8af4727a9ecde97344cd337/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:07.915698 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34d03a-afa7-425c-8756-743e90941d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=85baca47f92c4bf49cd7662a2200580d, user_id=2bb36024a8af4727a9ecde97344cd337, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:07.918406 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34d03a-afa7-425c-8756-743e90941d4a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:07.935333 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1428/2859] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:24:07 2022] PUT /identity/v3/projects/85baca47f92c4bf49cd7662a2200580d/users/2bb36024a8af4727a9ecde97344cd337/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:24:07.947080 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718bc4f-fa84-407a-ae2e-1b96c803161e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:07.947338 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718bc4f-fa84-407a-ae2e-1b96c803161e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:07.947625 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718bc4f-fa84-407a-ae2e-1b96c803161e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:07.977418 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b718bc4f-fa84-407a-ae2e-1b96c803161e None None] MFA Rules not processed for user `2bb36024a8af4727a9ecde97344cd337`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:07.978675 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b718bc4f-fa84-407a-ae2e-1b96c803161e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:08.048326 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:24:08.055397 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1432/2860] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:08.069521 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34d03a-afa7-425c-8756-743e90941d4a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:08.071272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1b34d03a-afa7-425c-8756-743e90941d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:08.140571 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34d03a-afa7-425c-8756-743e90941d4a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:08.144841 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e645d-308c-4815-84ad-83df346b23c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af1aad6bd5c486192345b3747ed3e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:08.145553 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e645d-308c-4815-84ad-83df346b23c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:08.145892 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e645d-308c-4815-84ad-83df346b23c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:08.146174 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e645d-308c-4815-84ad-83df346b23c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:08.156457 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e645d-308c-4815-84ad-83df346b23c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:08.157931 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e645d-308c-4815-84ad-83df346b23c2 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:08.169568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1429/2861] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:24:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:24:11.333797 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718bc4f-fa84-407a-ae2e-1b96c803161e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:11.419172 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718bc4f-fa84-407a-ae2e-1b96c803161e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:11.426489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233df628-e62b-4259-bb4f-3f90130eefad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:11.427947 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df628-e62b-4259-bb4f-3f90130eefad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:11.428445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df628-e62b-4259-bb4f-3f90130eefad admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:11.428762 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df628-e62b-4259-bb4f-3f90130eefad admin admin] PATH_INFO: `/v3/users/2bb36024a8af4727a9ecde97344cd337` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:11.430917 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233df628-e62b-4259-bb4f-3f90130eefad admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb36024a8af4727a9ecde97344cd337)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:11.434849 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233df628-e62b-4259-bb4f-3f90130eefad admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:11.509307 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-233df628-e62b-4259-bb4f-3f90130eefad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb36024a8af4727a9ecde97344cd337'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:11.520684 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-233df628-e62b-4259-bb4f-3f90130eefad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb36024a8af4727a9ecde97344cd337'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:11.521605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-233df628-e62b-4259-bb4f-3f90130eefad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb36024a8af4727a9ecde97344cd337'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:11.540525 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-233df628-e62b-4259-bb4f-3f90130eefad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb36024a8af4727a9ecde97344cd337'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:11.541653 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-233df628-e62b-4259-bb4f-3f90130eefad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb36024a8af4727a9ecde97344cd337'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:11.560287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1433/2862] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:24:11 2022] DELETE /identity/v3/users/2bb36024a8af4727a9ecde97344cd337 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:24:11.565489 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69c3d3-fcdd-4416-a0ab-33fab86bb9fc None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:11.566087 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69c3d3-fcdd-4416-a0ab-33fab86bb9fc None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:11.566087 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69c3d3-fcdd-4416-a0ab-33fab86bb9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:11.586161 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ae69c3d3-fcdd-4416-a0ab-33fab86bb9fc None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:11.587471 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ae69c3d3-fcdd-4416-a0ab-33fab86bb9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:11.637003 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:24:11.657650 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1430/2863] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:11.669455 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233df628-e62b-4259-bb4f-3f90130eefad admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:11.671002 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-233df628-e62b-4259-bb4f-3f90130eefad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:11.877558 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233df628-e62b-4259-bb4f-3f90130eefad admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:11.883014 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9f6a2-f0d1-4195-9d7c-98d5da032f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:11.884032 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9f6a2-f0d1-4195-9d7c-98d5da032f8d service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:11.884458 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9f6a2-f0d1-4195-9d7c-98d5da032f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:11.884878 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9f6a2-f0d1-4195-9d7c-98d5da032f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:11.899574 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9f6a2-f0d1-4195-9d7c-98d5da032f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:11.901233 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9f6a2-f0d1-4195-9d7c-98d5da032f8d service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:11.916460 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1434/2864] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:24:12.249782 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69c3d3-fcdd-4416-a0ab-33fab86bb9fc None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:12.251680 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ae69c3d3-fcdd-4416-a0ab-33fab86bb9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:12.267583 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69c3d3-fcdd-4416-a0ab-33fab86bb9fc None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:12.272722 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:12.273709 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:12.274081 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:12.274427 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c admin admin] PATH_INFO: `/v3/projects/85baca47f92c4bf49cd7662a2200580d` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:12.275761 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=85baca47f92c4bf49cd7662a2200580d)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:12.277750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:12.335710 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85baca47f92c4bf49cd7662a2200580d', 'request_id': 'req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:12.346006 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85baca47f92c4bf49cd7662a2200580d', 'request_id': 'req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:12.352593 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85baca47f92c4bf49cd7662a2200580d', 'request_id': 'req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:12.368664 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c admin admin] The token cache is being invalidate because project 85baca47f92c4bf49cd7662a2200580d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:24:12.368939 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:12.369623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-33bd43b2-6900-41c6-bf90-dceca9aa6f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:12.371600 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1431/2865] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:24:12 2022] DELETE /identity/v3/projects/85baca47f92c4bf49cd7662a2200580d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:24:13.278289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9f6a2-f0d1-4195-9d7c-98d5da032f8d service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:13.280141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-afe9f6a2-f0d1-4195-9d7c-98d5da032f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:13.302702 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9f6a2-f0d1-4195-9d7c-98d5da032f8d service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:13.329782 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:24:13.393249 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7f5a1-d7c5-4be3-b28c-48537ee328fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:13.394156 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7f5a1-d7c5-4be3-b28c-48537ee328fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:13.394444 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7f5a1-d7c5-4be3-b28c-48537ee328fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:13.394730 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7f5a1-d7c5-4be3-b28c-48537ee328fb admin admin] PATH_INFO: `/v3/users/dc51cb83ce8b48c19a67361471abc474` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:13.396098 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7f5a1-d7c5-4be3-b28c-48537ee328fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc51cb83ce8b48c19a67361471abc474)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:13.398101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7f5a1-d7c5-4be3-b28c-48537ee328fb admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:13.456645 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c4c7f5a1-d7c5-4be3-b28c-48537ee328fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc51cb83ce8b48c19a67361471abc474'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:13.468847 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c4c7f5a1-d7c5-4be3-b28c-48537ee328fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc51cb83ce8b48c19a67361471abc474'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:13.469469 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c4c7f5a1-d7c5-4be3-b28c-48537ee328fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc51cb83ce8b48c19a67361471abc474'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:13.486141 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c4c7f5a1-d7c5-4be3-b28c-48537ee328fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc51cb83ce8b48c19a67361471abc474'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:13.487012 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c4c7f5a1-d7c5-4be3-b28c-48537ee328fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc51cb83ce8b48c19a67361471abc474'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:13.502287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1435/2866] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:24:13 2022] DELETE /identity/v3/users/dc51cb83ce8b48c19a67361471abc474 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:24:13.507200 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7979209-22f1-47b8-a56c-d514bcaac94a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:13.507790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7979209-22f1-47b8-a56c-d514bcaac94a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:13.507790 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7979209-22f1-47b8-a56c-d514bcaac94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:13.528382 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d7979209-22f1-47b8-a56c-d514bcaac94a None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:13.529758 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d7979209-22f1-47b8-a56c-d514bcaac94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:13.602437 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1432/2867] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:13.613406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7f5a1-d7c5-4be3-b28c-48537ee328fb admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:13.615028 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c4c7f5a1-d7c5-4be3-b28c-48537ee328fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:13.681230 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7f5a1-d7c5-4be3-b28c-48537ee328fb admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:13.685128 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad58647-fdea-4c0e-8f5a-cfac03c7bc02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:13.685783 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad58647-fdea-4c0e-8f5a-cfac03c7bc02 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:13.686081 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad58647-fdea-4c0e-8f5a-cfac03c7bc02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:13.686356 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad58647-fdea-4c0e-8f5a-cfac03c7bc02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:13.697206 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad58647-fdea-4c0e-8f5a-cfac03c7bc02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:13.698963 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad58647-fdea-4c0e-8f5a-cfac03c7bc02 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:13.710304 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1436/2868] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:24:14.072238 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7979209-22f1-47b8-a56c-d514bcaac94a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:14.073889 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d7979209-22f1-47b8-a56c-d514bcaac94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:14.100141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7979209-22f1-47b8-a56c-d514bcaac94a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:14.105986 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07b56e-a529-4de4-af9e-afeac8ed9f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:14.107036 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07b56e-a529-4de4-af9e-afeac8ed9f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:14.107335 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07b56e-a529-4de4-af9e-afeac8ed9f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:14.107559 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07b56e-a529-4de4-af9e-afeac8ed9f00 admin admin] PATH_INFO: `/v3/projects/755b47e8f2a94287b424a1c2c6dd385f` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:14.109097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07b56e-a529-4de4-af9e-afeac8ed9f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=755b47e8f2a94287b424a1c2c6dd385f)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:14.111201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07b56e-a529-4de4-af9e-afeac8ed9f00 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:14.163226 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ca07b56e-a529-4de4-af9e-afeac8ed9f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755b47e8f2a94287b424a1c2c6dd385f', 'request_id': 'req-ca07b56e-a529-4de4-af9e-afeac8ed9f00'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:14.171873 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ca07b56e-a529-4de4-af9e-afeac8ed9f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755b47e8f2a94287b424a1c2c6dd385f', 'request_id': 'req-ca07b56e-a529-4de4-af9e-afeac8ed9f00'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:14.178446 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ca07b56e-a529-4de4-af9e-afeac8ed9f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755b47e8f2a94287b424a1c2c6dd385f', 'request_id': 'req-ca07b56e-a529-4de4-af9e-afeac8ed9f00'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:14.179716 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:24:14.194122 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ca07b56e-a529-4de4-af9e-afeac8ed9f00 admin admin] The token cache is being invalidate because project 755b47e8f2a94287b424a1c2c6dd385f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:24:14.194414 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ca07b56e-a529-4de4-af9e-afeac8ed9f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:14.195132 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ca07b56e-a529-4de4-af9e-afeac8ed9f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:24:14.196788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1433/2869] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:24:14 2022] DELETE /identity/v3/projects/755b47e8f2a94287b424a1c2c6dd385f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:24:14.202142 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63591119-a50d-43b6-b905-4895a2e06f3b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:14.202578 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63591119-a50d-43b6-b905-4895a2e06f3b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:14.202986 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63591119-a50d-43b6-b905-4895a2e06f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:14.223878 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-63591119-a50d-43b6-b905-4895a2e06f3b None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:14.225129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-63591119-a50d-43b6-b905-4895a2e06f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:14.267605 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:24:14.293176 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1437/2870] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:14.302479 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146f15f-4bb3-461c-974f-a5a288c168dd None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:14.302797 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146f15f-4bb3-461c-974f-a5a288c168dd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:14.303087 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146f15f-4bb3-461c-974f-a5a288c168dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:14.323260 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5146f15f-4bb3-461c-974f-a5a288c168dd None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:14.324508 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5146f15f-4bb3-461c-974f-a5a288c168dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:14.333760 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1434/2871] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:14.338732 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63591119-a50d-43b6-b905-4895a2e06f3b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:14.349615 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63591119-a50d-43b6-b905-4895a2e06f3b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:14.355373 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53550a7-01cc-458d-849d-b868b1d96b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:14.356064 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53550a7-01cc-458d-849d-b868b1d96b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:14.356350 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53550a7-01cc-458d-849d-b868b1d96b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:14.356626 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53550a7-01cc-458d-849d-b868b1d96b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:14.357384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53550a7-01cc-458d-849d-b868b1d96b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 12:24:14.357694 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53550a7-01cc-458d-849d-b868b1d96b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:14.359465 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53550a7-01cc-458d-849d-b868b1d96b80 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:14.375265 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1438/2872] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jul 21 12:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 12:24:14.380382 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146f15f-4bb3-461c-974f-a5a288c168dd None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:14.390488 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146f15f-4bb3-461c-974f-a5a288c168dd None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:14.396094 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcc95b-9956-41d9-a8f1-186bcae5ff9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:14.396788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc95b-9956-41d9-a8f1-186bcae5ff9e admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:14.397072 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc95b-9956-41d9-a8f1-186bcae5ff9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:14.397349 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc95b-9956-41d9-a8f1-186bcae5ff9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:14.398074 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcc95b-9956-41d9-a8f1-186bcae5ff9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:14.400146 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcc95b-9956-41d9-a8f1-186bcae5ff9e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:14.429641 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1435/2873] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:24:14 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:24:14.434765 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53550a7-01cc-458d-849d-b868b1d96b80 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:14.446333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53550a7-01cc-458d-849d-b868b1d96b80 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:14.511850 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7fd9e-c53c-4f40-af24-dae685e087f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:14.512533 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7fd9e-c53c-4f40-af24-dae685e087f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:14.512858 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7fd9e-c53c-4f40-af24-dae685e087f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:14.513129 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7fd9e-c53c-4f40-af24-dae685e087f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:14.513883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7fd9e-c53c-4f40-af24-dae685e087f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:14.516312 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7fd9e-c53c-4f40-af24-dae685e087f9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:14.546832 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1439/2874] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:24:14 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:24:14.548902 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcc95b-9956-41d9-a8f1-186bcae5ff9e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:14.560393 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcc95b-9956-41d9-a8f1-186bcae5ff9e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:14.565618 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9a61e-eaa6-4ad0-9003-933ed40ba238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:14.566314 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a61e-eaa6-4ad0-9003-933ed40ba238 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:14.566588 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a61e-eaa6-4ad0-9003-933ed40ba238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:14.567014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a61e-eaa6-4ad0-9003-933ed40ba238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:14.567886 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9a61e-eaa6-4ad0-9003-933ed40ba238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:14.569498 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9a61e-eaa6-4ad0-9003-933ed40ba238 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:14.582173 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1436/2875] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:24:14.586806 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7fd9e-c53c-4f40-af24-dae685e087f9 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:14.600743 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7fd9e-c53c-4f40-af24-dae685e087f9 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:14.605665 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c8b61-716c-4082-9f53-8383c4c36ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:14.606364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c8b61-716c-4082-9f53-8383c4c36ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:14.606692 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c8b61-716c-4082-9f53-8383c4c36ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:14.607072 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c8b61-716c-4082-9f53-8383c4c36ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:14.607879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c8b61-716c-4082-9f53-8383c4c36ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:14.609804 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c8b61-716c-4082-9f53-8383c4c36ea6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:14.621492 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1440/2876] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:24:14.626632 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9a61e-eaa6-4ad0-9003-933ed40ba238 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:14.639235 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9a61e-eaa6-4ad0-9003-933ed40ba238 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:14.647222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499490b-bd4a-4e9c-bb2d-27ea36585b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:14.648779 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499490b-bd4a-4e9c-bb2d-27ea36585b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:14.649083 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499490b-bd4a-4e9c-bb2d-27ea36585b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:14.649363 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499490b-bd4a-4e9c-bb2d-27ea36585b47 admin admin] PATH_INFO: `/v3/projects/aa285cd4ac5f4dd98bafffc48ece2855/users/31a8e399f47f4b3e897bb87ae88bcc66/roles/67ad028192f24536a65fa57450a563b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:14.669507 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499490b-bd4a-4e9c-bb2d-27ea36585b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa285cd4ac5f4dd98bafffc48ece2855, user_id=31a8e399f47f4b3e897bb87ae88bcc66, role_id=67ad028192f24536a65fa57450a563b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:14.672998 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499490b-bd4a-4e9c-bb2d-27ea36585b47 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:14.689826 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1437/2877] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:24:14 2022] PUT /identity/v3/projects/aa285cd4ac5f4dd98bafffc48ece2855/users/31a8e399f47f4b3e897bb87ae88bcc66/roles/67ad028192f24536a65fa57450a563b9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:24:14.695789 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9628fbf-1a07-4813-b5f3-2b66cf3d2f3d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:14.696104 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9628fbf-1a07-4813-b5f3-2b66cf3d2f3d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:14.696384 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9628fbf-1a07-4813-b5f3-2b66cf3d2f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:14.715933 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b9628fbf-1a07-4813-b5f3-2b66cf3d2f3d None None] MFA Rules not processed for user `8e3560d1fa07476590360b2627638a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:14.717178 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b9628fbf-1a07-4813-b5f3-2b66cf3d2f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:14.785859 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1441/2878] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:14.798287 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499490b-bd4a-4e9c-bb2d-27ea36585b47 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:14.800360 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f499490b-bd4a-4e9c-bb2d-27ea36585b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:14.876396 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499490b-bd4a-4e9c-bb2d-27ea36585b47 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:14.882082 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54027cc4-fb37-480f-8fb1-ad1cf626ed61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:14.883092 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54027cc4-fb37-480f-8fb1-ad1cf626ed61 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:14.883568 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54027cc4-fb37-480f-8fb1-ad1cf626ed61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:14.884008 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54027cc4-fb37-480f-8fb1-ad1cf626ed61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:14.895726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54027cc4-fb37-480f-8fb1-ad1cf626ed61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:14.897209 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54027cc4-fb37-480f-8fb1-ad1cf626ed61 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:14.909481 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1438/2879] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:24:20.192776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb600-d0df-4936-ad8c-5b91ab77aa34 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:20.193622 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb600-d0df-4936-ad8c-5b91ab77aa34 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:20.194077 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb600-d0df-4936-ad8c-5b91ab77aa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:20.227040 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c20eb600-d0df-4936-ad8c-5b91ab77aa34 None None] MFA Rules not processed for user `31a8e399f47f4b3e897bb87ae88bcc66`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:20.228319 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c20eb600-d0df-4936-ad8c-5b91ab77aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:20.274273 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:24:20.317754 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1442/2880] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:20.322958 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54027cc4-fb37-480f-8fb1-ad1cf626ed61 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:20.333967 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54027cc4-fb37-480f-8fb1-ad1cf626ed61 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:20.342920 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e595e91-5fa8-40b8-bc9d-3fd4ea917104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:20.343623 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e595e91-5fa8-40b8-bc9d-3fd4ea917104 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:20.343946 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e595e91-5fa8-40b8-bc9d-3fd4ea917104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:20.344201 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e595e91-5fa8-40b8-bc9d-3fd4ea917104 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:20.344891 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e595e91-5fa8-40b8-bc9d-3fd4ea917104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:20.346976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e595e91-5fa8-40b8-bc9d-3fd4ea917104 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:20.382706 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1439/2881] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jul 21 12:24:20 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:24:20.387568 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eb600-d0df-4936-ad8c-5b91ab77aa34 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:20.400966 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eb600-d0df-4936-ad8c-5b91ab77aa34 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:20.475609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91ef85-0d12-43af-9dce-5316e0df5aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:20.476326 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91ef85-0d12-43af-9dce-5316e0df5aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:20.476603 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91ef85-0d12-43af-9dce-5316e0df5aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:20.476879 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91ef85-0d12-43af-9dce-5316e0df5aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:20.477611 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91ef85-0d12-43af-9dce-5316e0df5aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:20.479609 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91ef85-0d12-43af-9dce-5316e0df5aa5 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:20.505287 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1443/2882] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jul 21 12:24:20 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 12:24:20.509805 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e595e91-5fa8-40b8-bc9d-3fd4ea917104 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:20.521066 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e595e91-5fa8-40b8-bc9d-3fd4ea917104 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:20.526090 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62974f63-a3c2-4217-96a6-8f0487394649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:20.526819 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62974f63-a3c2-4217-96a6-8f0487394649 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:20.527108 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62974f63-a3c2-4217-96a6-8f0487394649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:20.527387 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62974f63-a3c2-4217-96a6-8f0487394649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:20.528163 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62974f63-a3c2-4217-96a6-8f0487394649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:20.529810 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62974f63-a3c2-4217-96a6-8f0487394649 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:20.542142 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1440/2883] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 12:24:20.547489 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91ef85-0d12-43af-9dce-5316e0df5aa5 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:20.558557 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91ef85-0d12-43af-9dce-5316e0df5aa5 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:20.565478 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc760222-dd3f-4caa-9c28-ff15b24f8742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:20.566528 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc760222-dd3f-4caa-9c28-ff15b24f8742 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:20.566926 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc760222-dd3f-4caa-9c28-ff15b24f8742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:20.567201 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc760222-dd3f-4caa-9c28-ff15b24f8742 admin admin] PATH_INFO: `/v3/projects/e922a74e32e34074ae7c3047a166e0aa/users/2f7b7719c393494080e33a905bd18eb3/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:20.586445 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc760222-dd3f-4caa-9c28-ff15b24f8742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e922a74e32e34074ae7c3047a166e0aa, user_id=2f7b7719c393494080e33a905bd18eb3, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:20.589131 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc760222-dd3f-4caa-9c28-ff15b24f8742 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:20.606246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1444/2884] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:24:20 2022] PUT /identity/v3/projects/e922a74e32e34074ae7c3047a166e0aa/users/2f7b7719c393494080e33a905bd18eb3/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:24:20.611713 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62974f63-a3c2-4217-96a6-8f0487394649 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:20.622829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62974f63-a3c2-4217-96a6-8f0487394649 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:20.693057 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffd252-d02b-4919-9e53-7f8b04132cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:20.693752 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffd252-d02b-4919-9e53-7f8b04132cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:20.694036 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffd252-d02b-4919-9e53-7f8b04132cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:20.694315 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffd252-d02b-4919-9e53-7f8b04132cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:20.695097 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffd252-d02b-4919-9e53-7f8b04132cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:20.696750 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffd252-d02b-4919-9e53-7f8b04132cc4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:20.698331 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:24:20.715513 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1441/2885] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jul 21 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 12:24:20.719994 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc760222-dd3f-4caa-9c28-ff15b24f8742 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:20.731556 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc760222-dd3f-4caa-9c28-ff15b24f8742 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:20.736922 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343f8c6-46c9-4c8e-ae81-b9bd2403df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:20.737942 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343f8c6-46c9-4c8e-ae81-b9bd2403df87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:20.738271 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343f8c6-46c9-4c8e-ae81-b9bd2403df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:20.738755 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343f8c6-46c9-4c8e-ae81-b9bd2403df87 admin admin] PATH_INFO: `/v3/projects/e922a74e32e34074ae7c3047a166e0aa/users/2f7b7719c393494080e33a905bd18eb3/roles/371a7ac4f7194ce89bcdc3cc5084bf31` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:20.741027 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343f8c6-46c9-4c8e-ae81-b9bd2403df87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e922a74e32e34074ae7c3047a166e0aa, user_id=2f7b7719c393494080e33a905bd18eb3, role_id=371a7ac4f7194ce89bcdc3cc5084bf31)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:20.743949 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343f8c6-46c9-4c8e-ae81-b9bd2403df87 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:20.760704 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1445/2886] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jul 21 12:24:20 2022] PUT /identity/v3/projects/e922a74e32e34074ae7c3047a166e0aa/users/2f7b7719c393494080e33a905bd18eb3/roles/371a7ac4f7194ce89bcdc3cc5084bf31 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 12:24:26.576788 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c1768-3082-419c-a389-b408edb5f698 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:26.577403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c1768-3082-419c-a389-b408edb5f698 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:26.577403 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c1768-3082-419c-a389-b408edb5f698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:26.622736 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3d2c1768-3082-419c-a389-b408edb5f698 None None] MFA Rules not processed for user `2f7b7719c393494080e33a905bd18eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:26.624288 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3d2c1768-3082-419c-a389-b408edb5f698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:26.723976 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1442/2887] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:26.736732 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343f8c6-46c9-4c8e-ae81-b9bd2403df87 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:26.738779 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a343f8c6-46c9-4c8e-ae81-b9bd2403df87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:26.827582 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343f8c6-46c9-4c8e-ae81-b9bd2403df87 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:26.831447 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d2177-bd1d-4d9c-b215-72fd097c70c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10611bf25b9e4604ad769a6902f7f457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:26.832316 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d2177-bd1d-4d9c-b215-72fd097c70c3 service glance] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:26.832603 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d2177-bd1d-4d9c-b215-72fd097c70c3 service glance] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:26.832881 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d2177-bd1d-4d9c-b215-72fd097c70c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:26.887647 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:24:26.905993 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d2177-bd1d-4d9c-b215-72fd097c70c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:26.907525 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d2177-bd1d-4d9c-b215-72fd097c70c3 service glance] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:26.920180 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1446/2888] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:24:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 12:24:27.088741 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafb18a-b6e9-4d68-8a32-0aeba5bc465c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:27.089165 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafb18a-b6e9-4d68-8a32-0aeba5bc465c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:27.089586 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafb18a-b6e9-4d68-8a32-0aeba5bc465c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:27.116602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ecafb18a-b6e9-4d68-8a32-0aeba5bc465c None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:27.118272 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ecafb18a-b6e9-4d68-8a32-0aeba5bc465c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:27.202794 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1443/2889] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:24:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:27.232347 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d2177-bd1d-4d9c-b215-72fd097c70c3 service glance] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:27.234322 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7a6d2177-bd1d-4d9c-b215-72fd097c70c3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:27.370132 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d2177-bd1d-4d9c-b215-72fd097c70c3 service glance] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:27.376334 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09338c7-2c32-4546-99ed-147f3b8afb32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:27.377259 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09338c7-2c32-4546-99ed-147f3b8afb32 service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:27.377744 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09338c7-2c32-4546-99ed-147f3b8afb32 service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:27.378366 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09338c7-2c32-4546-99ed-147f3b8afb32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:27.391101 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09338c7-2c32-4546-99ed-147f3b8afb32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:27.393039 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09338c7-2c32-4546-99ed-147f3b8afb32 service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:27.403996 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1447/2890] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:24:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 12:24:36.762036 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7729e5d-1474-406b-920e-c4266cb242b1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:36.762633 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7729e5d-1474-406b-920e-c4266cb242b1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:36.763057 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7729e5d-1474-406b-920e-c4266cb242b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:36.788144 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d7729e5d-1474-406b-920e-c4266cb242b1 None None] MFA Rules not processed for user `31a8e399f47f4b3e897bb87ae88bcc66`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:36.789729 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d7729e5d-1474-406b-920e-c4266cb242b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:36.797798 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1444/2891] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jul 21 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:37.399122 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=39 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:24:37.634883 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09338c7-2c32-4546-99ed-147f3b8afb32 service swift] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:37.638563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c09338c7-2c32-4546-99ed-147f3b8afb32 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:37.739351 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09338c7-2c32-4546-99ed-147f3b8afb32 service swift] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:37.747766 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4a627-6aa2-426d-8027-47d3596b1520 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06c172bcd99f469f83728c98d061a7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:37.748822 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a627-6aa2-426d-8027-47d3596b1520 service placement] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:37.749289 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a627-6aa2-426d-8027-47d3596b1520 service placement] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:37.749746 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a627-6aa2-426d-8027-47d3596b1520 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:37.752721 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-00a4a627-6aa2-426d-8027-47d3596b1520 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:37.769400 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4a627-6aa2-426d-8027-47d3596b1520 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:37.771355 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4a627-6aa2-426d-8027-47d3596b1520 service placement] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:37.784560 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1448/2892] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:24:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:24:39.188671 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65250d88-0edd-4728-bff9-68def7f82270 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:39.189222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65250d88-0edd-4728-bff9-68def7f82270 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:39.189222 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65250d88-0edd-4728-bff9-68def7f82270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:39.209243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-65250d88-0edd-4728-bff9-68def7f82270 None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:24:39.210554 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-65250d88-0edd-4728-bff9-68def7f82270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:24:39.218582 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1445/2893] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jul 21 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:24:39.234788 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4a627-6aa2-426d-8027-47d3596b1520 service placement] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:24:39.247464 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4a627-6aa2-426d-8027-47d3596b1520 service placement] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:24:39.256340 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d56e6-22cd-40b6-a89e-54d754baef58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:24:39.257416 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d56e6-22cd-40b6-a89e-54d754baef58 service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:24:39.257908 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d56e6-22cd-40b6-a89e-54d754baef58 service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:24:39.258376 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d56e6-22cd-40b6-a89e-54d754baef58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:24:39.273646 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d56e6-22cd-40b6-a89e-54d754baef58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:24:39.276638 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d56e6-22cd-40b6-a89e-54d754baef58 service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:24:39.289738 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1449/2894] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:24:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:24:49.202574 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=67 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:24:49.285075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=38 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:25:00.950343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65250d88-0edd-4728-bff9-68def7f82270 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:25:00.951968 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-65250d88-0edd-4728-bff9-68def7f82270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:25:01.025680 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65250d88-0edd-4728-bff9-68def7f82270 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:25:01.030015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b717d0-4944-4c8a-b90d-7208651f0104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:25:01.030729 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b717d0-4944-4c8a-b90d-7208651f0104 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:25:01.031015 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b717d0-4944-4c8a-b90d-7208651f0104 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:25:01.031285 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b717d0-4944-4c8a-b90d-7208651f0104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:25:01.041466 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b717d0-4944-4c8a-b90d-7208651f0104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:25:01.042935 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b717d0-4944-4c8a-b90d-7208651f0104 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:25:01.052408 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1446/2895] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:25:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:25:11.048464 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=26 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:25:36.339954 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d56e6-22cd-40b6-a89e-54d754baef58 service swift] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:25:36.349733 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d56e6-22cd-40b6-a89e-54d754baef58 service swift] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:25:36.353333 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf13a1-fef6-4a35-81f0-617ca7ae6007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:25:36.353968 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf13a1-fef6-4a35-81f0-617ca7ae6007 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:25:36.354247 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf13a1-fef6-4a35-81f0-617ca7ae6007 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:25:36.354524 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf13a1-fef6-4a35-81f0-617ca7ae6007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:25:36.356401 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d3bf13a1-fef6-4a35-81f0-617ca7ae6007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:25:36.440712 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf13a1-fef6-4a35-81f0-617ca7ae6007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:25:36.442228 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf13a1-fef6-4a35-81f0-617ca7ae6007 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:25:36.464031 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1450/2896] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:25:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:25:37.658141 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b717d0-4944-4c8a-b90d-7208651f0104 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:25:37.668522 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b717d0-4944-4c8a-b90d-7208651f0104 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:25:37.672317 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8ff78-dfed-416c-aba6-266679b972d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:25:37.672963 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ff78-dfed-416c-aba6-266679b972d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:25:37.673243 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ff78-dfed-416c-aba6-266679b972d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:25:37.673506 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ff78-dfed-416c-aba6-266679b972d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:25:37.675870 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0cc8ff78-dfed-416c-aba6-266679b972d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:25:37.704584 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8ff78-dfed-416c-aba6-266679b972d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:25:37.706630 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8ff78-dfed-416c-aba6-266679b972d6 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:25:37.727023 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1447/2897] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:25:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:25:46.461546 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=43 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:25:47.718176 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=6 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:26:20.384776 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf13a1-fef6-4a35-81f0-617ca7ae6007 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:26:20.396613 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf13a1-fef6-4a35-81f0-617ca7ae6007 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:26:20.402685 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9d826-5d9e-4aee-973f-7b8f0a969199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88cfd88c19fd4c979e921e3d8cd9cc3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:26:20.403487 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d826-5d9e-4aee-973f-7b8f0a969199 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:26:20.403986 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d826-5d9e-4aee-973f-7b8f0a969199 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:26:20.404275 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d826-5d9e-4aee-973f-7b8f0a969199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:26:20.406285 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-69c9d826-5d9e-4aee-973f-7b8f0a969199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:26:20.423417 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9d826-5d9e-4aee-973f-7b8f0a969199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:26:20.424984 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9d826-5d9e-4aee-973f-7b8f0a969199 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:26:20.436075 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1451/2898] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:26:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:26:27.680295 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a83ff-c15c-428f-b33f-ba40e180e44e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:26:27.680772 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a83ff-c15c-428f-b33f-ba40e180e44e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:26:27.680879 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a83ff-c15c-428f-b33f-ba40e180e44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:26:27.732660 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-967a83ff-c15c-428f-b33f-ba40e180e44e None None] MFA Rules not processed for user `9410b04623a04e90ac47c4a53cd3c4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 12:26:27.733782 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-967a83ff-c15c-428f-b33f-ba40e180e44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:26:27.752156 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1448/2899] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jul 21 12:26:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 12:26:27.796661 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9d826-5d9e-4aee-973f-7b8f0a969199 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:26:27.820930 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9d826-5d9e-4aee-973f-7b8f0a969199 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:26:27.826601 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ebd0b-5cee-47f9-bef4-ce4709169ed2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd659c33e0f49dc8edf30bd47737e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:26:27.827276 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ebd0b-5cee-47f9-bef4-ce4709169ed2 service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:26:27.827563 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ebd0b-5cee-47f9-bef4-ce4709169ed2 service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:26:27.827839 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ebd0b-5cee-47f9-bef4-ce4709169ed2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:26:27.836838 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ebd0b-5cee-47f9-bef4-ce4709169ed2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:26:27.838406 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ebd0b-5cee-47f9-bef4-ce4709169ed2 service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:26:27.847037 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1452/2900] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jul 21 12:26:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 12:26:35.035443 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a83ff-c15c-428f-b33f-ba40e180e44e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:26:35.123143 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a83ff-c15c-428f-b33f-ba40e180e44e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:26:35.128979 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6ab13-ec51-4848-974d-752644b5f847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:26:35.130022 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6ab13-ec51-4848-974d-752644b5f847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:26:35.130369 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6ab13-ec51-4848-974d-752644b5f847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:26:35.130746 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6ab13-ec51-4848-974d-752644b5f847 admin admin] PATH_INFO: `/v3/users/31a8e399f47f4b3e897bb87ae88bcc66` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:26:35.132262 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6ab13-ec51-4848-974d-752644b5f847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a8e399f47f4b3e897bb87ae88bcc66)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:26:35.134499 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6ab13-ec51-4848-974d-752644b5f847 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:26:35.190602 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-02e6ab13-ec51-4848-974d-752644b5f847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a8e399f47f4b3e897bb87ae88bcc66'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.191286 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-02e6ab13-ec51-4848-974d-752644b5f847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a8e399f47f4b3e897bb87ae88bcc66'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.204037 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-02e6ab13-ec51-4848-974d-752644b5f847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a8e399f47f4b3e897bb87ae88bcc66'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.211515 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-02e6ab13-ec51-4848-974d-752644b5f847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a8e399f47f4b3e897bb87ae88bcc66'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.212519 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-02e6ab13-ec51-4848-974d-752644b5f847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a8e399f47f4b3e897bb87ae88bcc66'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.233051 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1449/2901] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:26:35 2022] DELETE /identity/v3/users/31a8e399f47f4b3e897bb87ae88bcc66 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:26:35.436282 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ebd0b-5cee-47f9-bef4-ce4709169ed2 service swift] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:26:35.449058 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ebd0b-5cee-47f9-bef4-ce4709169ed2 service swift] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:26:35.515915 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:26:35.516818 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:26:35.517095 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:26:35.517364 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] PATH_INFO: `/v3/projects/aa285cd4ac5f4dd98bafffc48ece2855` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:26:35.518536 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa285cd4ac5f4dd98bafffc48ece2855)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:26:35.520443 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:26:35.568222 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa285cd4ac5f4dd98bafffc48ece2855', 'request_id': 'req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.577008 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa285cd4ac5f4dd98bafffc48ece2855', 'request_id': 'req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.586239 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa285cd4ac5f4dd98bafffc48ece2855', 'request_id': 'req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.598480 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] The token cache is being invalidate because project aa285cd4ac5f4dd98bafffc48ece2855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:26:35.598807 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.599504 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.601153 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1453/2902] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:26:35 2022] DELETE /identity/v3/projects/aa285cd4ac5f4dd98bafffc48ece2855 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:26:35.605364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6ab13-ec51-4848-974d-752644b5f847 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:26:35.606843 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-02e6ab13-ec51-4848-974d-752644b5f847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:26:35.620320 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6ab13-ec51-4848-974d-752644b5f847 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:26:35.665133 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:26:35.689883 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f10991-a664-4b0b-a678-d51b44a5b94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:26:35.690811 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f10991-a664-4b0b-a678-d51b44a5b94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:26:35.691093 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f10991-a664-4b0b-a678-d51b44a5b94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:26:35.691368 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f10991-a664-4b0b-a678-d51b44a5b94c admin admin] PATH_INFO: `/v3/users/2f7b7719c393494080e33a905bd18eb3` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:26:35.692666 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f10991-a664-4b0b-a678-d51b44a5b94c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7b7719c393494080e33a905bd18eb3)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:26:35.694619 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f10991-a664-4b0b-a678-d51b44a5b94c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:26:35.765364 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a6f10991-a664-4b0b-a678-d51b44a5b94c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7b7719c393494080e33a905bd18eb3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.766164 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a6f10991-a664-4b0b-a678-d51b44a5b94c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7b7719c393494080e33a905bd18eb3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.781014 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a6f10991-a664-4b0b-a678-d51b44a5b94c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7b7719c393494080e33a905bd18eb3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.789829 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a6f10991-a664-4b0b-a678-d51b44a5b94c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7b7719c393494080e33a905bd18eb3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.790666 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a6f10991-a664-4b0b-a678-d51b44a5b94c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7b7719c393494080e33a905bd18eb3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:35.806493 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1450/2903] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jul 21 12:26:35 2022] DELETE /identity/v3/users/2f7b7719c393494080e33a905bd18eb3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:26:36.009935 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:26:36.011647 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:26:36.027331 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae31a4-2c41-4125-aeb0-a05f94a13b8f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:26:36.102976 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:26:36.113784 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1270f43-9796-49e5-a595-2094429626d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3560d1fa07476590360b2627638a18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea0112c11004c7db4f26fe8670575dc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:26:36.115189 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270f43-9796-49e5-a595-2094429626d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:26:36.115748 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270f43-9796-49e5-a595-2094429626d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:26:36.116467 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270f43-9796-49e5-a595-2094429626d1 admin admin] PATH_INFO: `/v3/projects/e922a74e32e34074ae7c3047a166e0aa` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:26:36.118251 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1270f43-9796-49e5-a595-2094429626d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e922a74e32e34074ae7c3047a166e0aa)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:26:36.121599 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1270f43-9796-49e5-a595-2094429626d1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:26:36.182772 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a1270f43-9796-49e5-a595-2094429626d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e922a74e32e34074ae7c3047a166e0aa', 'request_id': 'req-a1270f43-9796-49e5-a595-2094429626d1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:36.191422 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a1270f43-9796-49e5-a595-2094429626d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e922a74e32e34074ae7c3047a166e0aa', 'request_id': 'req-a1270f43-9796-49e5-a595-2094429626d1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:36.199250 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a1270f43-9796-49e5-a595-2094429626d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e922a74e32e34074ae7c3047a166e0aa', 'request_id': 'req-a1270f43-9796-49e5-a595-2094429626d1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:36.210924 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a1270f43-9796-49e5-a595-2094429626d1 admin admin] The token cache is being invalidate because project e922a74e32e34074ae7c3047a166e0aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 12:26:36.211246 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a1270f43-9796-49e5-a595-2094429626d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:36.211946 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a1270f43-9796-49e5-a595-2094429626d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 12:26:36.217044 dv-cinder-850321-1-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1454/2904] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jul 21 12:26:36 2022] DELETE /identity/v3/projects/e922a74e32e34074ae7c3047a166e0aa => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 12:26:45.803080 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:26:46.208026 dv-cinder-850321-1-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 12:29:43.644253 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f10991-a664-4b0b-a678-d51b44a5b94c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 12:29:43.645933 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a6f10991-a664-4b0b-a678-d51b44a5b94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:29:43.722343 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f10991-a664-4b0b-a678-d51b44a5b94c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 12:29:43.785067 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b8ac2-9b54-4f3d-bc13-8a238815f54c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06c172bcd99f469f83728c98d061a7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0946df6ba381401e8e4958d11c63cb2b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 12:29:43.785726 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b8ac2-9b54-4f3d-bc13-8a238815f54c service placement] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 12:29:43.786012 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b8ac2-9b54-4f3d-bc13-8a238815f54c service placement] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 12:29:43.786388 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b8ac2-9b54-4f3d-bc13-8a238815f54c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 12:29:43.788773 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a51b8ac2-9b54-4f3d-bc13-8a238815f54c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 12:29:43.800400 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b8ac2-9b54-4f3d-bc13-8a238815f54c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 12:29:43.801943 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b8ac2-9b54-4f3d-bc13-8a238815f54c service placement] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 12:29:43.811916 dv-cinder-850321-1-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1451/2905] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jul 21 12:29:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 12:29:53.807795 dv-cinder-850321-1-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=58 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}